Decentriq seeks a Senior Data Pipeline Engineer for a freelance role to build and optimize Spark-based data pipelines and ML models, with potential for full-time conversion.
This freelance position supports the engineering team during a phase of high customer demand. The role focuses on designing and operating robust data infrastructure while leveraging modern AI tools to enhance development speed and quality. There is a possibility for the contract to convert into a full-time employment opportunity.
Responsibilities
- Design, develop, and maintain Spark-based data pipelines, managing the lifecycle from initial development through to production deployment and ongoing monitoring.
- Enhance and deploy machine learning models tailored for AdTech applications, including lookalike and demographic modeling.
- Utilize LLM-powered code assistants, design generators, and automated testing tools to accelerate development cycles and improve code quality.
- Profile, benchmark, and optimize Spark workloads while establishing best practices for job orchestration and system observability.
Requirements
- A Bachelor’s, Master’s, or PhD degree in Computer Science, Data Engineering, or a closely related discipline.
- At least five years of professional experience in the field.
- Expert-level proficiency in Python and Spark ecosystems, including PySpark or Scala.
- Demonstrated history of constructing resilient, production-grade data pipelines that include rigorous data quality and validation checks.
- Strong skills in data platform operations, such as managing Spark clusters, job schedulers, or orchestration frameworks.
Nice to have
- Practical experience with the machine learning lifecycle and model serving.
- Familiarity with audience segmentation techniques or look-alike modeling strategies.
- Proficiency in the Rust programming language.
What the company offers
- Competitive compensation rates.
- Significant autonomy and ownership over technical work rather than acting solely as an executor.
- The opportunity to collaborate with a vibrant, distributed team spread across Europe.
About the company
Decentriq is a recognized leader in data-clean-room technology, enabling secure collaboration on first-party data. The company is trusted by prominent institutions in the DACH region and internationally, fostering a distributed team culture across Europe.
- Trusted by renowned institutions in the DACH market and beyond.
- A distributed team structure spanning across Europe.
How to apply
Documents to submit:
Quelle: öffentlich zugängliche Karriereseite des Arbeitgebers. Batchly ist nicht der Arbeitgeber und steht nicht notwendigerweise in einem Vertragsverhältnis mit dem Unternehmen.