Senior Data Pipeline Engineer

iGroove AG · Zürich

iGroove AG seeks a Senior Data Pipeline Engineer in Zürich to architect and scale the company's data ingestion backbone using Python and modern orchestration tools.

This position is responsible for owning the data ingestion infrastructure that serves as the core backbone for the company's operations. The engineer will scale existing production pipelines, crawlers, and integrations that feed real products, exercising high ownership and architectural authority from day one while collaborating closely with product and engineering teams.

Responsibilities

  • Assume full ownership of the current data infrastructure and drive its scaling efforts.
  • Enhance system reliability, broaden data coverage, integrate new sources, and refine the overall architecture.
  • Design and construct new data pipelines as required by business needs.
  • Define and implement strategies for collecting and processing external data across the organization.

Requirements

  • At least five years of professional experience developing data pipelines or web crawling systems in live production environments.
  • Proficiency in Python, including experience with scraping libraries such as Scrapy, BeautifulSoup, Selenium, or Playwright.
  • Hands-on experience with workflow orchestration platforms like Airflow, Prefect, or Dagster.
  • Strong knowledge of database systems (e.g., PostgreSQL, MongoDB) and data modeling principles.
  • Proven ability to handle inconsistent, real-world data and implement robust validation layers.
  • Comfort working with cloud providers such as AWS, GCP, or Azure.
  • A demonstrated history of building autonomous, reliable systems that require minimal manual oversight.
  • Deep familiarity with AI tools and workflows, with AI integrated into daily development practices.

Nice to have

  • Experience deploying headless browsers and anti-detection strategies at scale.
  • Background in the music industry, streaming platforms, or media data ecosystems.
  • Familiarity with data warehousing solutions like BigQuery, Snowflake, or Redshift.
  • Experience working with message queue systems such as Kafka, RabbitMQ, or Redis.
  • Track record of developing internal tooling and analytical dashboards.

What the company offers

  • Remote-friendly arrangement with flexible working hours.
  • Access to an office in Zurich for team members who prefer in-person work.
  • Chance to inherit and improve a mature data infrastructure established over more than ten years.
  • Opportunity to work in a small, highly skilled team focused on rapid delivery.
  • Clean technical environment with no legacy systems to maintain.

About the company

iGroove AG is an AI-native company operating within the music industry, building products powered by artificial intelligence. The organization prioritizes high ownership and architectural decision-making over simple task execution, and the team is deeply committed to maintaining exceptional data quality standards.

  • AI-native approach to product development.
  • Focus on music industry and media data.
  • Emphasis on ownership and architectural decisions.
  • Obsessive attention to data quality.

How to apply

Documents to submit:

  • CV
  • Brief note

Auf Firmen-Website bewerben

Ähnliche Stellen

Quelle: öffentlich zugängliche Karriereseite des Arbeitgebers. Batchly ist nicht der Arbeitgeber und steht nicht notwendigerweise in einem Vertragsverhältnis mit dem Unternehmen.