Artificial Intelligence Engineer
Key Skills
Job Description
Key Responsibilities Develop and validate GenAI evaluation frameworks and metrics. Evaluate LLM/RAG outputs using automated and human assessments. Design statistical experiments and analyse evaluation results. Develop guardrails against hallucinations, prompt injection and sensitive-data exposure. Measure guardrail performance using precision, recall and error analysis. Build production-ready Python solutions and integrate them into CI/CD pipelines. Must-Have Skills Strong Python and production software development experience. Hands-on experience with LLM applications and RAG. GenAI evaluation and metric validation experience. Strong applied statistics and experimental design. Experience with LLM-as-a-Judge and/or human evaluation. Practical understanding of AI guardrails and safety testing. Git, automated testing, CI/CD and API integration. Strong communication and collaboration skills.
Core Responsibilities
Develop and validate generative AI evaluation frameworks, assess LLM and RAG outputs, and analyze results from statistical experiments. Build and measure safety guardrails, then deliver production-ready Python solutions integrated into CI/CD pipelines.
Requirements
Requires strong Python and production software development experience, hands-on experience with LLM applications and RAG, and expertise in generative AI evaluation and applied statistics. Candidates should also have experience with LLM-as-a-Judge or human evaluation, AI guardrails and safety testing, Git, automated testing, CI/CD, API integration, and effective communication and collaboration.
About CodeAnalytiqa Consultancy and Services
Industry: IT Services and IT Consulting
Company size: 11-50 employees
CodeAnalytiqa is an IT consulting, solution and staffing providing organization for next generation business collaborates throughout the world. With comprehensive intelligence system across diverse industries and domains, we dedicatedly work over the client's project to turn them into some most successful and high-performance organizations. Sharpen edges through innovation and continuous learning, all these factors turns it into the most promising brand since 2016. At CodeAnalytiqa, success is guaranteed backed with our efforts, hard work, customer- centric approach and organized team effort. The USP of CodeAnalytiqa lies in its excellent model of project management that help us to deliver the most complicated, advanced web and mobile app solutions. Client satisfaction is our prime concern and to achieve this we use latest generation technology, smart managing skills to ensure on-time delivery. You will get 24*7 customer support from our side to provide the best solution instantly.