Senior Data Engineer
Key Skills
Job Description
Role: Senior Data Engineer – FM Client Control (WB FM) Role description Location: Amsterdam, Netherlands Duration: Permanent Technical skills we are looking for: - At least 8 years of relevant experience in data engineering, cloud engineering, data analytics or a closely related technical field. - Proven hands-on experience designing and building complex production-grade data pipelines using ETL and ETL patterns. - Strong programming skills in Python and SQL, with practical experience using PySpark for distributed data processing. - Hands-on experience with Apache Spark and workflow orchestration tools such as Apache Airflow. - Experience with cloud data platforms, preferably Google Cloud Platform and BigQuery, and working knowledge of Azure or AWS. - Strong understanding of data modelling, normalization and denormalization, data integration, data lakes and data warehouses. - Experience with relational and non-relational data stores, including technologies such as MS SQL, Hive and dbt, plus object storage such as Amazon S3. - Experience with containerization, orchestration and automated delivery tooling, including Docker, Kubernetes and CI/CD pipelines. - Experience managing and optimizing distributed systems and clusters for large-scale batch processing. - Good command of software engineering practices, including modular design, testing, code review, documentation, security and production support. Soft skills we are looking for: - Curious mindset; you are collaborative and passionate about helping others to grow and improve, - Proactive, hands on - can-do mentality, on top of your delivery (no surprises) and positive mind-set - The ability to facilitate decision-making to drive complex design issues to a conclusion. - Team player with good communication skills (Fluent in English) and experienced in working in an international environment. - Strong organisational sensitivity: ability to understand and consider the underlying issues, opportunities and dynamics of an international organisation with multiple functional and hierarchical lines, dealing with multiple (sometimes conflicting) interests. - A strong resilience: the ability to navigate through ambiguity and simplify complexity without losing essence. - Excellent communication skills, including being able to explain technical terms to non-technical audience Competencies and experience: - Minimum of 8 years working experience in the technical data or cloud role - At least 8 years of proven track record in delivering Data, BI or IT solutions, preferably with an Agile Way of Working - Strong understanding of the main building blocks of data pipelines, ETL/ELT processes, and managing data lakes and warehouses - Experience in data modeling, normalization/denormalization, and integrating data across complex systems - Prior experience in Python, SQL, PySpark, dbt Labs for data processing and automation. - Good to have: Understanding of Financial Markets and Group Treasury business, FM/GT related products, KYC, FM regulations (EMIR, MIFID, SFTR, AFSL, MAS etc) and financial institutions (brokers, CCP’s, venues etc.)
Core Responsibilities
Design and build complex, production-grade data pipelines and data solutions, including ETL/ELT processes, data integration, and data lake and warehouse management. Optimize distributed systems and batch processing, and apply sound software engineering practices to deliver and support reliable solutions.
Requirements
Requires at least eight years of experience in data or cloud engineering and a proven record delivering data, BI, or IT solutions. Candidates should have strong Python, SQL, and PySpark skills, experience with Spark, orchestration and cloud data platforms, and the ability to collaborate and communicate effectively in an international environment.
About Insight International (UK) Ltd
Industry: IT Services and IT Consulting
Company size: 51-200 employees
We provide Software Development, Maintenance and Other Related IT Services, across spectrum, depending on individual client’s needs and dependability on us. Being a young and vibrant software solution company, we believe in harnessing the talent and experience of each member of our team to provide a unique flavor to our offerings within practical considerations and as per need and flexibility as expressed by our clients. We believe in working as a true partner and demonstrate transparency in all our dealings and conduct with our client(s), our supplier(s), Home Office, our employee(s), our associate(s), Solicitors, Accountants and our future prospect(s). We provide innovative and demanding solutions as envisaged within our control and competency and ever increasing desire to serve our customers and stakeholders as per their expectations all the time. We have the confidence to hire , engage and deploy the right resources all the time within an accepted framework of delivery model across various sectors and work in the following areas: Information Technology Banking Training of workforce at all levels and verticals Deploying AI and RPA for Administrative efficiency Marketing and Sales Customer Service Retail