Decentriq AG seeks a Senior Data Pipeline Engineer for a freelance role to build and optimize Spark-based data pipelines and ML models for secure data collaboration.
This freelance position supports the engineering team during a phase of high customer demand. The role focuses on designing and operating robust data infrastructure, with the potential to transition into a full-time employment contract.
Responsibilities
- Design, develop, and maintain Spark-based data pipelines, managing their lifecycle from initial development through to production deployment and ongoing monitoring.
- Enhance and deploy machine learning models tailored for AdTech applications, including lookalike and demographic modeling.
- Utilize LLM-powered code assistants, design generators, and automated testing tools to accelerate development cycles and improve code quality.
- Profile, benchmark, and optimize Spark workloads while establishing best practices for job orchestration and system observability.
Requirements
- A Bachelor’s, Master’s, or PhD degree in Computer Science, Data Engineering, or a closely related discipline.
- At least five years of professional experience in the field.
- Expert-level proficiency in Python and Spark ecosystems, including PySpark or Scala.
- Demonstrated success in constructing resilient, production-grade data pipelines that include rigorous data quality and validation checks.
- Strong skills in data platform operations, such as managing Spark clusters, job schedulers, or orchestration frameworks.
Nice to have
- Practical experience with the machine learning lifecycle and model serving.
- Familiarity with audience segmentation techniques or look-alike modeling strategies.
- Proficiency in the Rust programming language.
What the company offers
- Competitive compensation rates.
- Significant autonomy and ownership over technical work rather than acting solely as an executor.
- The opportunity to collaborate with a vibrant, distributed team spread across Europe.
About the company
Decentriq AG is a leader in data-clean-room technology, enabling secure collaboration on first-party data. The company fosters a fun and amazing team culture, with members distributed across Europe.
- The team is distributed across Europe.
How to apply
Documents to submit:
Quelle: öffentlich zugängliche Karriereseite des Arbeitgebers. Batchly ist nicht der Arbeitgeber und steht nicht notwendigerweise in einem Vertragsverhältnis mit dem Unternehmen.