
Senior Data Platform Engineer — Almere, Belgium
Work Arrangement
Office Days per Week: 2 days
Key Skills
Job Description
Opportunity
Your Mission
- Keep the production data stack and the backend services built on top of it reliable and observable in production.
- Define and document deployment patterns, backup procedures and tested recovery runbooks that customer teams can execute independently.
- Instrument the full stack, Spark drivers and executors, PostgreSQL, MinIO and the JVM, with metrics, logs, health checks and clear failure diagnostics.
- Embed security constraints into platform design and address security findings before each release.
- Validate releases across HTTP/HTTPS and FIPS/non-FIPS environments, keeping CI/CD quality gates rigorous and release behaviour predictable.
At twelve months, FIPS and non-FIPS validation is a routine gate, not a release risk, and the runbooks you have written are the authoritative reference, not you.
- Eligibility to obtain and maintain the required national or NATO security clearance for this role (we support candidates through the clearance process).
- Production-depth Python and Spark: you own and operate runtimes, not just write jobs against them.
- Hands-on experience with object storage such as MinIO or S3-compatible stores, and lakehouse table formats such as Iceberg or Hudi.
- Operational PostgreSQL knowledge: backup, recovery, diagnosability and schema management under constraints.
- CI/CD and quality gates, rigour around releases, independent of platform; containerised development in deployment contexts.
- Degree in computer science or software engineering, or equivalent professional experience, the or-equivalent clause is genuine.
- Clear written and verbal communication with both engineers and product stakeholders; you will own design and runbook decisions and explain them.
- Air-gapped delivery experience: offline install bundles, signed packages or tooling such as Zarf; STIG-hardened hosts or FIPS-validated crypto library constraints.
- Kafka, Airflow or comparable streaming/orchestration; Scala sufficient to read Spark source and stack traces; Docker Swarm migration experience.
- Constrained-hardware deployments: single-node or few-node clusters, edge or shipboard scheduling, remote shuffle services and shuffle-heavy job tuning.
Build Your Future with ILIAS
About us
In defence operations, timing and reliable information shape every decision. Many organizations still rely on fragmented systems, limiting visibility and slowing execution. ILIAS Solutions connects logistics, maintenance, and operations into one integrated platform. This creates a single source of truth and enables teams to act on real time data across strategic, operational, and tactical levels. Large volumes of operational data move continuously between systems. This data reflects maintenance cycles, logistics flows, and asset readiness. Accuracy and consistency directly impact operational outcomes.Core Responsibilities
You will engineer and maintain reliable data infrastructure for air-gapped and disconnected environments using Python, Spark, and PostgreSQL. Additionally, you will define deployment patterns, manage security constraints, and ensure system observability through rigorous instrumentation.
Requirements
Candidates must possess production-depth experience with Python, Spark, and object storage, along with the ability to obtain national or NATO security clearance. A degree in computer science or software engineering, or equivalent professional experience, is required.
About ILIAS Solutions
Industry: IT Services and IT Consulting
Company size: 51-200 employees
ILIAS Solutions specializes in information management solutions to support defence and humanitarian aid operations. Our software platforms are centred on the optimisation of operational readiness, and based upon the management of the resources required for those operations. In order to provide our customers with solutions that are tailored to their specific needs, ILIAS Solutions consists of an effective team of experts in the development, implementation and maintenance of software systems, with experience in managing complex and sensitive assets maintenance and logistics systems. Our team can provide you with a wide variety of skills ranging from business analysis, process improvement and project management to software development, testing, training, maintenance, helpdesk services, and much more. ILIAS Solutions is ISO 9001 certified for all activities related to the development, provisioning and maintenance of IT solutions for asset management.