Healthcare/Nursing AI Training Specialist — Task Creation & Model Evaluation
Key Skills
Job Description
About Rise Data Labs Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including nursing, clinical care, and healthcare documentation. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data. Job Overview As a Healthcare/Nursing AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for clinical and nursing work. This role goes beyond traditional annotation and labeling - you'll author realistic, economically valuable clinical tasks and rubrics based on real patient care scenarios, then grade AI-generated deliverables against them. What You'll Do Create realistic clinical scenarios based on your own professional experience - e.g., patient assessment documentation, care planning, vital sign tracking, lab trend analysis, medication management Supply the kinds of reference materials you'd normally work from (redacted patient charts, care plans, clinical notes) Write detailed rubrics specifying exactly what a correct, clinically sound deliverable requires - accurate assessments, appropriate clinical reasoning, correct terminology Grade AI-generated deliverables (often clinical documents or assessment workbooks) against your rubric Join calibration sessions with other experts to ensure consistent scoring across the benchmark Preferred Qualifications Registered Nurse (RN), Nurse Practitioner, or similar clinical credential Prior hands-on experience in direct patient care, clinical documentation, or care coordination Comfort reviewing detailed clinical work product line by line Prior experience with AI model training, evaluation, or benchmark development is a plus What We Offer At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in healthcare and clinical work.
Core Responsibilities
Create realistic clinical tasks and reference materials, then develop detailed rubrics defining clinically sound deliverables. Evaluate AI-generated clinical work against those rubrics and participate in calibration sessions to support consistent scoring.
Requirements
A preferred qualification is an RN, Nurse Practitioner, or similar clinical credential, along with hands-on experience in patient care, clinical documentation, or care coordination. Candidates should be comfortable reviewing detailed clinical work line by line; experience with AI training, evaluation, or benchmark development is a plus.
Benefits
- Flexible Working Environment
- Professional Development Opportunities
About Rise Data Labs
Industry: Software Development
Company size: 2-10 employees
Rise Data Labs powers the future of AI with 500K+ US-based talent trained to deliver the highest quality data labeling, annotation, and evaluation services. We combine elite human expertise with automation to help teams train, test, and improve AI models faster and more reliably. From reinforcement learning with human feedback (RLHF) to large-scale image, video, and text annotation, our vetted workforce provides the human-in-the-loop precision that AI companies need to compete. Unlike offshore click-work, Rise Data Labs delivers context-aware, culturally nuanced annotations that align with the demands of cutting-edge generative AI. Whether you’re building frontier models, fine-tuning domain-specific LLMs, or running large-scale evals, Rise Data Labs ensures your AI is powered by clean, consistent, and trustworthy training data. We’re raising the bar for what reliable AI data should look like. Visit risedatalabs.com to learn how we can support your AI development.