Senior Azure Databricks Developer (ID: 3819)
Key Skills
Job Description
- Design, develop, and maintain scalable data processing solutions using Azure Databricks.
- Build and optimize batch and streaming data pipelines using Python, PySpark, and SQL.
- Design and implement robust data models within the Databricks ecosystem.
- Manage multiple parallel data processing workloads on shared datasets while ensuring performance and reliability.
- Collaborate with cross-functional teams to deliver high-quality data solutions aligned with business requirements.
- Implement CI/CD pipelines using Azure DevOps and YAML-based deployment frameworks.
- Utilize Infrastructure as Code (ARM/Bicep) to automate cloud resource provisioning and management.
- Participate in Agile ceremonies and contribute to continuous improvement initiatives.
- Ensure solution quality, maintainability, scalability, and adherence to engineering best practices.
- Make informed technical decisions within a complex and evolving cloud data architecture.
- 6–8 years of overall experience in software engineering, data engineering, or cloud data platform development.
- Strong hands-on experience with Azure Databricks as a primary development platform.
- Deep expertise in Python, PySpark, and SQL for large-scale data processing.
- Proven experience building and managing both streaming and batch processing solutions.
- Solid experience with Azure cloud services and CI/CD implementation using YAML pipelines.
- Hands-on experience with Infrastructure as Code tools, particularly ARM Templates and/or Bicep.
- Strong understanding of distributed data processing concepts and performance optimization.
- Experience working in Agile development environments.
- Exposure to end-to-end data platform architectures is an added advantage.
- Design reliable and scalable data processing frameworks within Azure Databricks.
- Handle complex data transformation and processing requirements efficiently.
- Optimize data workloads for performance, scalability, and cost-effectiveness.
- Manage concurrent processing pipelines and shared data dependencies.
- Identify, troubleshoot, and resolve technical issues proactively.
- Communicate technical concepts effectively to stakeholders and team members.
- Balance engineering best practices with practical business requirements.
- Drive continuous improvement initiatives and reduce technical debt.
- Deliver maintainable, production-grade solutions with a strong focus on quality.
- Opportunity to work on large-scale cloud-native data platforms and modern data engineering initiatives.
- Exposure to cutting-edge Azure and Databricks technologies.
- Collaborative Agile work environment focused on innovation and continuous learning.
- Challenging technical projects that encourage ownership and professional growth.
- A culture that values quality engineering, pragmatic problem-solving, and teamwork.
- Opportunities to contribute to architecture decisions and influence technical direction.
- Dynamic and supportive team environment focused on delivering impactful solutions.
Want to discuss this opportunity in more detail? Feel free to reach out.
Recruiter: Giftson Paul Davidson
Phone: +31 20 369 0609 ; Extn : 146
E-mail: [email protected]
LinkedIn: https://www.linkedin.com/in/giftsonpauldavidson
Core Responsibilities
Design, develop, and maintain scalable data processing solutions and pipelines using Azure Databricks. Implement CI/CD pipelines and automate cloud resource provisioning using Infrastructure as Code.
Requirements
Requires 6-8 years of experience in software or data engineering with deep expertise in Python, PySpark, and SQL. Must have proven experience with Azure cloud services, YAML pipelines, and ARM/Bicep templates.
Benefits
- Exposure To Cutting-edge Azure And Databricks Technologies
- Collaborative Agile Work Environment
- Professional Growth Opportunities
- Influence Over Technical Direction
About STAFIDE
Industry: Staffing and Recruiting
Company size: 11-50 employees
Headquartered in the Netherlands, STAFIDE specializes in Niche Tech Recruitment across Europe, connecting top talent with outstanding opportunities in the IT sector. Our data-driven recruitment model ensures the ideal match between candidates and employers, enhancing both skill alignment and cultural fit. With a strong focus on Skill-Based Hiring, we provide candidates with an in-depth understanding of the organization—whether for permanent positions or temporary assignments (interim opdrachten) like secondment (detachering)—strengthening employer branding for our clients as a recruitment company (uitzendbureau). In today’s fast-evolving tech landscape, we recognize the unique challenges companies face in sourcing highly skilled talent. Our advanced, AI-driven talent intelligence system (ATS) is specifically designed to prioritize Skill-Based Hiring for niche IT roles, empowering organizations to address talent shortages by identifying professionals with the expertise to drive innovation and growth. Whether you’re a company in search of exceptional talent or a professional seeking your next ICT role, STAFIDE is your strategic recruitment (werving en selectie) partner. Our deep expertise in the Dutch market, combined with a steadfast commitment to excellence, makes us the preferred choice for all your recruitment needs.