Databricks Technical Lead
Key Skills
Job Description
G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment. The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems. Responsibilities: Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices Maintain technical documentation and internal knowledge resources Provide technical leadership through mentoring, code reviews, and best practice guidance Support architectural design with a focus on scalability, performance, cost efficiency, and reliability Drive CI/CD improvements across cloud and on-premise environments Promote clean coding standards, automated testing, and effective use of AI-assisted development tools Requirements Enterprise SDLC experience Financial services experience, including banking exposure Strong hands-on Databricks experience, including Spark / PySpark, Delta Lake, Databricks SQL, and Workflows, with proficiency in Python and / or Scala Experience of Unity Catalog and data governance within a regulated environment Strong AWS experience (EC2, Lambda, ECS, RDS, S3, IAM) Hands-on Terraform / Infrastructure as Code experience CI/CD experience using Jenkins Degree in Computer Science or related discipline (or equivalent experience) IBM MQ or similar messaging systems Benefits Length: Permanent Location: Cork, Dublin, or Amsterdam
Core Responsibilities
Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS, including the design and optimization of large-scale data pipelines. Own Databricks governance and access controls, manage infrastructure deployments, guide technical architecture, mentor developers, and improve CI/CD and software delivery practices.
Requirements
Requires enterprise SDLC and financial services experience, including banking, along with strong hands-on Databricks, Spark or PySpark, Delta Lake, and Python and/or Scala skills. Candidates should also have experience with Unity Catalog, AWS, Terraform, Jenkins-based CI/CD, and IBM MQ or similar messaging systems; a computer science degree or equivalent experience is required.
About G MASS Consulting
Industry: Business Consulting and Services
Company size: 51-200 employees
G MASS is part of the Good Together Group. G MASS is a specialist resource augmentation consultancy focused on Financial Services & Insurance. We're experts at partnering with clients, providing the exact skills needed to ensure their teams succeed. We combine the sourcing strengths of a market-leading recruitment model with the delivery oversight, governance, and engagement of a tenured consulting business. Our approach is simple; combine the best skills-mapping technology in the market with award-winning employee engagement to produce for our clients the best-fit consulting solutions. We are a modern-day consulting business built around solving modern-day client problems. Our combination of data-led solutions, decades-long track record of delivery, and collaborative design approach serves as a new & exciting proposition in the resource augmentation market. It is time to rethink consultancy. Winner of the 2025 Rapid Expansion Award at the Business Consultancy Awards UK! Powered by the Good Together Group