AI Engineer - GenAI & Customer Service
Key Skills
Job Description
Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team. Requirements AI Data & Evaluation Engineer to work within a Scrum team, preparing, structuring, enriching, and validating enterprise data for AI knowledge bases and AI chatbots. Build and maintain Databricks data pipelines to process structured and unstructured data for AI knowledge bases. Prepare, clean, transform, and enrich source data to improve the quality and reliability of information used by AI assistants. Develop and maintain evaluation datasets covering realistic conversations, complex scenarios, edge cases, and multi-step workflows. Apply evaluation frameworks to test advanced chatbots across single-turn, multi-turn, simulation-based, and agentic scenarios. Implement automated testing, monitoring, and quality gates for changes to data, prompts, models, retrieval, and orchestration. Deploy and manage cloud infrastructure using Infrastructure as Code, particularly Azure Bicep and CI/CD pipelines. Analyze evaluation results and translate findings into improvements across knowledge, retrieval, prompts, tools, and application logic. Strong proficiency in Python, data engineering, and automated testing. Hands-on experience with Azure, Databricks, DevOps, CI/CD, and Infrastructure as Code, preferably Bicep. Experience building data pipelines and preparing structured and unstructured enterprise data for AI knowledge bases and RAG applications. Experience with chatbot evaluation, including multi-turn, simulated, and agentic interactions. Familiarity with Context Engineering, Agentic AI, Function Calling, retrieval strategies, and tool use. Strong engineering and data-quality mindset with an affinity for Agile development. Strong critical thinking, ownership, accountability, and problem-solving skills. Excellent communication skills and a customer-focused approach. Relevant HBO or university degree and fluency in English. Benefits A challenging, innovating environment. Opportunities for learning where needed.
Core Responsibilities
Prepare, structure, enrich, and validate enterprise data, and build Databricks pipelines to support AI knowledge bases and chatbots. Evaluate chatbot performance across realistic and complex scenarios, automate quality controls, manage Azure infrastructure, and use evaluation findings to improve retrieval, prompts, tools, and application logic.
Requirements
Requires strong Python, data engineering, and automated testing skills, with hands-on experience in Azure, Databricks, DevOps, CI/CD, and Infrastructure as Code. Candidates should have experience preparing enterprise data for AI and RAG applications, evaluating multi-turn and agentic chatbots, and bring strong problem-solving, communication, ownership, and customer-focused skills; a relevant HBO or university degree and fluency in English are also required.
Benefits
- Learning Opportunities
About GeekSoft Consulting
Industry: IT Services and IT Consulting
Company size: 51-200 employees
At GeekSoft - we provide high quality, IT-enabled services with diverse consulting services to improve business challenges and performance. Our expertise is into Technology Consulting. We are a home of Young and Dynamic Professionals, with a customer oriented service model for excellent customer satisfaction. We align ourselves towards your business needs and provide solutions to run your business smarter, faster and simple with an integrated suite of ERP, primarily based in SAP and Salesforce packages. Along with smart solutions, we specialize in Consulting, Development, Implementation and Support of CRM Solutions that deliver a holistic Customer eXperience for your business.