AI Model Evaluation Specialist
Key Skills
Job Description
We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement. Key Responsibilities Design and implement evaluation metrics for AI models Conduct thorough testing of model performance across different scenarios Analyze model outputs for bias, fairness, and accuracy Collaborate with ML engineers to implement improvements Document findings and recommendations Ideal Candidate PhD or Masters in Computer Science, ML, or related field 5+ years experience in AI/ML model evaluation Strong background in statistical analysis Experience with evaluation frameworks and metrics Excellent communication skills
Core Responsibilities
Design evaluation frameworks and metrics, test AI model performance across scenarios, and analyze outputs for bias, fairness, and accuracy. Collaborate with machine learning engineers on improvements and document findings and recommendations.
Requirements
A master's or PhD in computer science, machine learning, or a related field is required. Candidates should have at least five years of AI/ML model evaluation experience, strong statistical analysis skills, familiarity with evaluation frameworks and metrics, and excellent communication skills.
About Rise Data Labs
Industry: Software Development
Company size: 2-10 employees
Rise Data Labs powers the future of AI with 500K+ US-based talent trained to deliver the highest quality data labeling, annotation, and evaluation services. We combine elite human expertise with automation to help teams train, test, and improve AI models faster and more reliably. From reinforcement learning with human feedback (RLHF) to large-scale image, video, and text annotation, our vetted workforce provides the human-in-the-loop precision that AI companies need to compete. Unlike offshore click-work, Rise Data Labs delivers context-aware, culturally nuanced annotations that align with the demands of cutting-edge generative AI. Whether you’re building frontier models, fine-tuning domain-specific LLMs, or running large-scale evals, Rise Data Labs ensures your AI is powered by clean, consistent, and trustworthy training data. We’re raising the bar for what reliable AI data should look like. Visit risedatalabs.com to learn how we can support your AI development.