SIX Financial Information seeks a Senior Data Engineer in Zürich to design and maintain a cloud-native data science platform serving over 600 users across 14 internal teams.
This position supports an international group responsible for building and sustaining a mature cloud-native data science platform. The platform currently supports more than 14 internal analytics teams and over 600 users, requiring a hands-on engineer to onboard new use cases and optimize existing workflows.
Responsibilities
- Partner with business data science and IT data engineering stakeholders to facilitate their use of the platform.
- Gather new requirements, evaluate platform fit, and demonstrate best practices or existing solutions.
- Serve as a hands-on engineer to integrate new use cases and improve current implementations.
- Develop production-grade ETL pipelines, ML/AI applications, and reporting tools.
- Deploy new infrastructure components using Infrastructure as Code (IaC).
- Develop templates to promote standardization and best practices across analytics teams.
Requirements
- At least 4 years of hands-on experience creating production data pipelines, data models, and BI tools in cloud environments.
- Familiarity with Lakehouse architecture, ideally Databricks, plus strong expertise in Spark and Open Table formats (Delta and/or Iceberg).
- Strong skills in Python (PySpark) and SQL, along with a solid grasp of software development and automation principles like CI/CD for building production data and ML pipelines (DataOps/MLOps).
- Basic understanding of cloud foundation services (IAM, networking, storage...), cloud cost management (FinOps), and IaC tools (Terraform/OpenTofu, Pulumi, bash scripting...) on Microsoft Azure (primary provider) and/or AWS, GCP.
- Fluent written and spoken English.
Nice to have
- Prior experience with Databricks.
About the company
The team operates with a growth mindset and maintains a highly proactive attitude toward continuous learning and professional development.
- Fosters a growth mindset and proactive approach to continuous learning and development.
Quelle: öffentlich zugängliche Karriereseite des Arbeitgebers. Batchly ist nicht der Arbeitgeber und steht nicht notwendigerweise in einem Vertragsverhältnis mit dem Unternehmen.