EPAM Systems logo

Lead Data & AI Engineer

EPAM Systems

Amsterdam
Full-time
5-10 years experience
Hybrid

Key Skills

Data Engineering
Data Architecture
SQL
Python
PySpark
Databricks
Delta Lake
Azure Data Factory
ETL/ELT
AI/ML Integration
MLOps
Generative AI
Data Governance
CI/CD
Prompt Engineering
RAG Workflows

Job Description

We’re looking for a Lead Data & AI Engineer to join our team in the Netherlands in a hybrid working mode. In this role, you will design and deliver advanced data solutions and AI-assisted capabilities on modern cloud platforms. You’ll build scalable data pipelines, optimize data quality and governance and enable ML feature engineering for analytics and intelligent applications. The role requires hands-on technical expertise in data engineering and AI integration while driving reliability, performance and security for enterprise-scale systems. Responsibilities Design and implement robust data architectures using cloud-native technologies Build large-scale ETL/ELT workflows to process heterogeneous datasets Create data models optimized for AI/ML pipelines and advanced analytics Develop streaming and batch pipelines leveraging tools like Azure Data Factory and Databricks Operationalize ML solutions, integrating feature stores, model registries and inference endpoints Collaborate with data scientists to deploy and monitor AI models using enterprise MLOps frameworks Integrate GenAI-assisted development methods into data workflows for automation and efficiency Ensure data governance, lineage, cataloging and quality frameworks across platforms Optimize platform performance, manage compute cost efficiency and enable observability for critical workloads Contribute to best practices, mentoring engineering teams in advanced data and AI engineering Requirements Minimum 8+ years working in data engineering, with proven architecture and leadership experience Advanced proficiency in SQL for performance tuning at large scale Strong programming skills in Python, with applied experience in data engineering workflows Expertise in PySpark for distributed data processing Hands-on experience with Databricks, including Delta Lake and performance optimization Knowledge of Azure Data Factory for orchestration of pipelines (ETL/ELT) Familiarity with AI/ML pipeline development, including integration of models into production Demonstrated exposure to Gen AI-assisted development workflows for accelerating data engineering tasks Strong understanding of CI/CD processes for data and ML pipelines such as GitHub Actions, Azure DevOps Ability to manage enterprise-scale solutions across global environments with compliance in mind Nice to have Prompt Engineering knowledge and experience building RAG workflows Familiarity with Microsoft Foundry platforms Version control and CI/CD experience with GitHub Understanding of ETL/ELT optimization patterns beyond Azure stack Knowledge of data mesh or lakehouse architectural concepts Hands-on exposure to dbt (data build tool), MKDocs and similar developer productivity tooling We offer 26 paid holiday days Pension plan scheme Disability insurance (WGA Shortfall insurance) Long-term disability insurance (WIA Top up insurance) EPAM Employee Stock Purchase Plan (ESPP) Commuting to work - costs reimbursement Laptop + corporate simcard + corporate mobile device (subject to certain eligibility requirements) Bike lease Employee Assistance Program Corporate Programs including Employee Referral Program with rewards Learning and development opportunities including in-house training and coaching, professional certifications, and courses

Core Responsibilities

Design and deliver scalable cloud data architectures, batch and streaming pipelines, and AI/ML-ready data models using technologies such as Databricks and Azure Data Factory. Operationalize and monitor ML solutions, integrate generative AI into data workflows, ensure governance and reliability, optimize performance and costs, and mentor engineering teams.

Requirements

Requires at least 8 years of data engineering experience, including architecture and leadership, with advanced SQL, Python, PySpark, Databricks, Delta Lake, and Azure Data Factory expertise. Candidates should also have experience integrating AI/ML models into production, using GenAI-assisted development and CI/CD practices, and managing compliant enterprise-scale solutions.

Benefits

  • 26 Paid Holiday Days
  • Pension Plan
  • Disability Insurance
  • Long-Term Disability Insurance
  • Employee Stock Purchase Plan
  • Commuting Cost Reimbursement
  • Laptop
  • Corporate SIM Card
  • Corporate Mobile Device
  • Bike Lease
  • Employee Assistance Program
  • Employee Referral Program
  • Learning And Development Opportunities
  • In-House Training And Coaching
  • Professional Certifications
  • Courses

About EPAM Systems

Industry: IT Services and IT Consulting

Company size: 10,001+ employees

EPAM (NYSE:EPAM) is a global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, EPAM empowers organizations to become AI-native enterprises, driving measurable value from innovation and digital investments. Recognized by industry benchmarks and leading analysts as a leader in AI, EPAM delivers globally while engaging locally, making the future real for clients, partners and employees. We are proud to be recognized by Forbes, Glassdoor, Newsweek, Time Magazine, Great Place to Work and kununu as a Most Loved Workplace around the world. Learn more at www.epam.com and follow us on LinkedIn.

Added Today