Rise Data Labs logo

AI Model Evaluation Specialist

Rise Data Labs

Full-time
5-10 years experience
On-site

Key Skills

AI Model Evaluation
Evaluation Framework Design
Evaluation Metrics
Model Testing
Statistical Analysis
Bias Analysis
Fairness Analysis
Accuracy Analysis
Machine Learning
Model Improvement
Communication

Job Description

We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement. Key Responsibilities Design and implement evaluation metrics for AI models Conduct thorough testing of model performance across different scenarios Analyze model outputs for bias, fairness, and accuracy Collaborate with ML engineers to implement improvements Document findings and recommendations Ideal Candidate PhD or Masters in Computer Science, ML, or related field 5+ years experience in AI/ML model evaluation Strong background in statistical analysis Experience with evaluation frameworks and metrics Excellent communication skills

Core Responsibilities

Design evaluation frameworks and metrics, test AI model performance across scenarios, and analyze outputs for bias, fairness, and accuracy. Collaborate with machine learning engineers on improvements and document findings and recommendations.

Requirements

A master's or PhD in computer science, machine learning, or a related field is required. Candidates should have at least five years of AI/ML model evaluation experience, strong statistical analysis skills, familiarity with evaluation frameworks and metrics, and excellent communication skills.

About Rise Data Labs

Industry: Software Development

Company size: 2-10 employees

Rise Data Labs powers the future of AI with 500K+ US-based talent trained to deliver the highest quality data labeling, annotation, and evaluation services. We combine elite human expertise with automation to help teams train, test, and improve AI models faster and more reliably. From reinforcement learning with human feedback (RLHF) to large-scale image, video, and text annotation, our vetted workforce provides the human-in-the-loop precision that AI companies need to compete. Unlike offshore click-work, Rise Data Labs delivers context-aware, culturally nuanced annotations that align with the demands of cutting-edge generative AI. Whether you’re building frontier models, fine-tuning domain-specific LLMs, or running large-scale evals, Rise Data Labs ensures your AI is powered by clean, consistent, and trustworthy training data. We’re raising the bar for what reliable AI data should look like. Visit risedatalabs.com to learn how we can support your AI development.

Added Today