Azure Data Engineer (ID:3995)
Key Skills
Job Description
- Design, develop, and maintain robust data pipelines using Databricks, PySpark, Azure Data Factory, and Python.
- Implement scalable data solutions with a strong focus on data governance, data quality, and data lineage.
- Develop and optimize data processing workflows to support reliable and high-quality data delivery.
- Work with cloud-based data engineering technologies to build and maintain enterprise-grade data solutions.
- 10+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong experience with PySpark.
- Experience with Azure Data Factory (ADF).
- Strong Python scripting skills.
- Experience implementing data governance, data quality, and data lineage.
- Proven experience designing and maintaining robust data pipelines.
- Build scalable and reliable data pipelines.
- Apply data governance and data quality principles across data solutions.
- Implement effective data lineage practices.
- Develop efficient data processing solutions using PySpark and Python.
- Work effectively with Databricks and Azure Data Factory.
- Troubleshoot and optimize data pipelines and processing workflows.
- Opportunity to work on large-scale data engineering solutions.
- Exposure to modern data technologies including Databricks, PySpark, Azure Data Factory, and Python.
- Opportunity to contribute to data governance, data quality, and data lineage initiatives.
- A professional environment focused on building robust and scalable data solutions.
Core Responsibilities
Design, develop, and maintain robust data pipelines using Databricks, PySpark, and Azure Data Factory. Implement scalable data solutions with a focus on data governance, quality, and lineage.
Requirements
Requires 10+ years of experience in data engineering with strong hands-on skills in Databricks, PySpark, and Python. Proven ability to build scalable data pipelines and implement effective data governance practices is essential.
About STAFIDE
Industry: Staffing and Recruiting
Company size: 11-50 employees
Headquartered in the Netherlands, STAFIDE specializes in Niche Tech Recruitment across Europe, connecting top talent with outstanding opportunities in the IT sector. Our data-driven recruitment model ensures the ideal match between candidates and employers, enhancing both skill alignment and cultural fit. With a strong focus on Skill-Based Hiring, we provide candidates with an in-depth understanding of the organization—whether for permanent positions or temporary assignments (interim opdrachten) like secondment (detachering)—strengthening employer branding for our clients as a recruitment company (uitzendbureau). In today’s fast-evolving tech landscape, we recognize the unique challenges companies face in sourcing highly skilled talent. Our advanced, AI-driven talent intelligence system (ATS) is specifically designed to prioritize Skill-Based Hiring for niche IT roles, empowering organizations to address talent shortages by identifying professionals with the expertise to drive innovation and growth. Whether you’re a company in search of exceptional talent or a professional seeking your next ICT role, STAFIDE is your strategic recruitment (werving en selectie) partner. Our deep expertise in the Dutch market, combined with a steadfast commitment to excellence, makes us the preferred choice for all your recruitment needs.