Lead Data & AI Engineer
Key Skills
Job Description
We’re looking for a Lead Data & AI Engineer to join our team in the Netherlands in a hybrid working mode. In this role, you will design and deliver advanced data solutions and AI-assisted capabilities on modern cloud platforms. You’ll build scalable data pipelines, optimize data quality and governance and enable ML feature engineering for analytics and intelligent applications. The role requires hands-on technical expertise in data engineering and AI integration while driving reliability, performance and security for enterprise-scale systems. Responsibilities Design and implement robust data architectures using cloud-native technologies Build large-scale ETL/ELT workflows to process heterogeneous datasets Create data models optimized for AI/ML pipelines and advanced analytics Develop streaming and batch pipelines leveraging tools like Azure Data Factory and Databricks Operationalize ML solutions, integrating feature stores, model registries and inference endpoints Collaborate with data scientists to deploy and monitor AI models using enterprise MLOps frameworks Integrate GenAI-assisted development methods into data workflows for automation and efficiency Ensure data governance, lineage, cataloging and quality frameworks across platforms Optimize platform performance, manage compute cost efficiency and enable observability for critical workloads Contribute to best practices, mentoring engineering teams in advanced data and AI engineering Requirements 5+ years working in data engineering, with proven architecture and leadership experience Advanced proficiency in SQL for performance tuning at large scale Strong programming skills in Python, with applied experience in data engineering workflows Expertise in PySpark for distributed data processing Hands-on experience with Databricks, including Delta Lake and performance optimization Knowledge of Azure Data Factory for orchestration of pipelines (ETL/ELT) Familiarity with AI/ML pipeline development, including integration of models into production Demonstrated exposure to Gen AI-assisted development workflows for accelerating data engineering tasks Strong knowledge of CI/CD for data and ML pipelines (GitHub Actions, Azure DevOps) and experience with large-scale environments English proficiency at B2 level (Upper-Intermediate) or higher Nice to have Prompt Engineering knowledge and experience building RAG workflows Familiarity with Microsoft Foundry platforms Version control and CI/CD experience with GitHub Understanding of ETL/ELT optimization patterns beyond Azure stack Knowledge of data mesh or lakehouse architectural concepts Hands-on exposure to dbt (data build tool), MKDocs and similar developer productivity tooling We offer 26 paid holiday days Pension plan scheme Disability insurance (WGA Shortfall insurance) Long-term disability insurance (WIA Top up insurance) EPAM Employee Stock Purchase Plan (ESPP) Commuting to work - costs reimbursement Laptop + corporate simcard + corporate mobile device (subject to certain eligibility requirements) Bike lease Employee Assistance Program Corporate Programs including Employee Referral Program with rewards Learning and development opportunities including in-house training and coaching, professional certifications, and courses
Core Responsibilities
Design and deliver scalable cloud data architectures, batch and streaming pipelines, and AI/ML-ready data solutions, while integrating models and generative AI-assisted methods into production workflows. Ensure data quality, governance, security, performance, cost efficiency, and observability, and mentor engineering teams in data and AI engineering practices.
Requirements
Requires at least five years of data engineering experience, including architecture and leadership, with strong SQL, Python, and PySpark skills and hands-on experience with Databricks, Delta Lake, and Azure Data Factory. Candidates should also have experience with production AI/ML pipelines, generative AI-assisted development, CI/CD, and large-scale environments, plus English proficiency at B2 level or higher.
Benefits
- 26 Paid Holiday Days
- Pension Plan
- Disability Insurance
- Long-Term Disability Insurance
- Employee Stock Purchase Plan
- Commuting Cost Reimbursement
- Laptop
- Corporate SIM Card
- Corporate Mobile Device
- Bike Lease
- Employee Assistance Program
- Employee Referral Program
- Learning And Development Opportunities
- In-House Training And Coaching
- Professional Certifications
- Courses
About EPAM Systems
Industry: IT Services and IT Consulting
Company size: 10,001+ employees
EPAM (NYSE:EPAM) is a global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, EPAM empowers organizations to become AI-native enterprises, driving measurable value from innovation and digital investments. Recognized by industry benchmarks and leading analysts as a leader in AI, EPAM delivers globally while engaging locally, making the future real for clients, partners and employees. We are proud to be recognized by Forbes, Glassdoor, Newsweek, Time Magazine, Great Place to Work and kununu as a Most Loved Workplace around the world. Learn more at www.epam.com and follow us on LinkedIn.