Key Skills

Job Description

# Lead Data Engineer - dbt & Databricks Migration (Remote) ## About the Role Monks Technology Services is seeking a Lead Data Engineer to drive a large-scale data platform modernization initiative. The role focuses on migrating legacy Python/Spark ETL pipelines to dbt Core models on Databricks and modernizing production reporting for analytics and Business Intelligence (BI). The successful candidate will provide hands-on technical leadership, design scalable data models, and ensure output parity between legacy and modernized pipelines within a collaborative, CI/CD-gated environment. ## Key Responsibilities * Lead the migration of legacy Python/Spark ETL pipelines to dbt Core models on Databricks. * Modernize production reporting for analytics and BI. * Provide hands-on technical leadership throughout the data platform modernization. * Design scalable data models. * Ensure output parity between legacy pipelines and modernized data models. * Work within a collaborative, CI/CD-gated engineering environment. ## Required Qualifications * Experience in Data Engineering and data platform modernization. * Hands-on experience with **dbt Core**. * Experience with **Databricks**. * Experience working with **Python and Spark ETL**. * Experience designing scalable data models. * Experience working in CI/CD-gated environments. * Ability to provide hands-on technical leadership. ## Preferred Qualifications * No additional preferred qualifications are explicitly specified in the source job description. ## Skills & Competencies * Data Engineering * Data platform modernization * dbt Core * Databricks * Python * A

Core Responsibilities

Lead the migration of legacy Python/Spark ETL pipelines to dbt Core models on Databricks. Design scalable data models and modernize production reporting for analytics and Business Intelligence.

Requirements

Requires hands-on experience with dbt Core, Databricks, Python, and Spark ETL. Candidates must have a proven track record in data platform modernization and working within CI/CD-gated environments.