Remote Senior Data Engineer – Databricks / Azure Data Platform

PROSTAFF Schweiz GmbH seeks a Senior Data Engineer to architect and maintain a modern Azure/Databricks data platform for the insurance sector, focusing on scalable pipelines and data governance.

The company is expanding its data infrastructure within the insurance and reinsurance industry. This role is responsible for centralizing disparate data sources, ensuring high data quality, and organizing information into structured business domains. The resulting platform will support critical processes such as underwriting, pricing, and finance, while also providing a foundation for reporting, analytics, and future AI initiatives.

Responsibilities

• Construct, manage, and refine data pipelines using Databricks.
• Architect scalable Lakehouse and Medallion models.
• Organize data into logical business domains.
• Develop and sustain Bronze, Silver, and Gold data layers.
• Create Gold layers to enable business applications, reports, and analytics.
• Integrate and process data from various sources, with a focus on SAP.
• Establish data quality checks, monitoring, and validation processes.
• Assist in data modeling, database design, storage strategies, and performance tuning.
• Contribute to governance, security, and access management frameworks.
• Build or support CI/CD pipelines for data engineering workflows.
• Address reporting needs, potentially using Power BI or Databricks.
• Prepare the platform for upcoming AI and advanced analytics projects.
• Facilitate onboarding for business users on the data platform.
• Collaborate with infrastructure, architecture, business, reporting, and data teams.

Requirements

• Several years of experience as a Senior Data Engineer or in a similar capacity.
• Proven expertise in building and maintaining data pipelines with Databricks.
• Deep understanding of Lakehouse and Medallion architectures.
• Solid experience with cloud-based data platforms, preferably Azure.
• Strong grasp of data quality, governance, security, and access management.
• Experience in data modeling, database design, storage technologies, and performance optimization.
• Familiarity with CI/CD concepts in data engineering.
• Comprehensive knowledge of the Databricks ecosystem and its components.
• Ability to structure complex data landscapes into scalable solutions.
• Independent, structured, and senior-level working style.
• Strong communication skills with technical and business stakeholders.

Nice to have

• Experience with SAP data sources is highly valued.
• Background in insurance, reinsurance, finance, or actuarial fields is beneficial.
• Knowledge of Power BI and/or Databricks reporting is an advantage.