CodeAnalytiqa Consultancy and Services logo

Artificial Intelligence Engineer

CodeAnalytiqa Consultancy and Services

Utrecht
Contractor
5-10 years experience
On-site

Key Skills

Python
Production Software Development
LLM Applications
Retrieval-Augmented Generation (RAG)
Generative AI Evaluation
Statistical Analysis
Experimental Design
LLM-as-a-Judge
Human Evaluation
AI Guardrails
Safety Testing
Hallucination Prevention
Prompt Injection Prevention
Sensitive Data Protection
Automated Testing
CI/CD

Job Description

Key Responsibilities Develop and validate GenAI evaluation frameworks and metrics. Evaluate LLM/RAG outputs using automated and human assessments. Design statistical experiments and analyse evaluation results. Develop guardrails against hallucinations, prompt injection and sensitive-data exposure. Measure guardrail performance using precision, recall and error analysis. Build production-ready Python solutions and integrate them into CI/CD pipelines. Must-Have Skills Strong Python and production software development experience. Hands-on experience with LLM applications and RAG. GenAI evaluation and metric validation experience. Strong applied statistics and experimental design. Experience with LLM-as-a-Judge and/or human evaluation. Practical understanding of AI guardrails and safety testing. Git, automated testing, CI/CD and API integration. Strong communication and collaboration skills.

Core Responsibilities

Develop and validate generative AI evaluation frameworks, assess LLM and RAG outputs, and analyze results from statistical experiments. Build and measure safety guardrails, then deliver production-ready Python solutions integrated into CI/CD pipelines.

Requirements

Requires strong Python and production software development experience, hands-on experience with LLM applications and RAG, and expertise in generative AI evaluation and applied statistics. Candidates should also have experience with LLM-as-a-Judge or human evaluation, AI guardrails and safety testing, Git, automated testing, CI/CD, API integration, and effective communication and collaboration.

About CodeAnalytiqa Consultancy and Services

Industry: IT Services and IT Consulting

Company size: 11-50 employees

CodeAnalytiqa is an IT consulting, solution and staffing providing organization for next generation business collaborates throughout the world. With comprehensive intelligence system across diverse industries and domains, we dedicatedly work over the client's project to turn them into some most successful and high-performance organizations. Sharpen edges through innovation and continuous learning, all these factors turns it into the most promising brand since 2016. At CodeAnalytiqa, success is guaranteed backed with our efforts, hard work, customer- centric approach and organized team effort. The USP of CodeAnalytiqa lies in its excellent model of project management that help us to deliver the most complicated, advanced web and mobile app solutions. Client satisfaction is our prime concern and to achieve this we use latest generation technology, smart managing skills to ensure on-time delivery. You will get 24*7 customer support from our side to provide the best solution instantly.

Added Today