Job Description

Title: AI Data Trainer - Generalist 
Remote

Key Responsibilities:
Label and evaluate conversations to identify examples of desired character traits and behaviors
Provide qualitative analysis of model behaviors and interaction patterns
Create and curate datasets for character training and evaluation
Identify and report novel trends, unexpected behaviors, or areas for improvement
Assist in developing benchmarks and evaluation criteria for AI character traits
Contribute to guidelines and documentation for character evaluation
Participate in regular calibration sessions with the team

Quality Standards:
Maintain high levels of precision and consistency in data labeling
Follow annotation guidelines and quality control processes
Participate in regular quality audits and calibration exercises
Document clear rationales for evaluation decisions
Flag edge cases and provide detailed feedback on challenging examples

Required Qualifications:
Bachelor's degree or equivalent experience in relevant field (e.g., linguistics, philosophy, psychology, communications)
Experience with content moderation, data labeling, or quality assessment
Strong attention to detail, analytical and critical thinking skills
Excellent written and verbal communication abilities
Ability to provide nuanced feedback on conversation quality and character traits
Comfortable working independently while maintaining consistent output quality