Member of Technical Staff - Research Infrastructure Engineer

Black Forest Labs seeks a Mid-level Research Infrastructure Engineer in Freiburg, CH, to build and scale systems supporting visual intelligence research in a hybrid setup.

This position supports the company's mission to advance visual intelligence by designing and operating the underlying research platforms. The engineer will focus on scaling compute clusters, orchestrating resources, and creating systems that enable long-term model training and breakthrough innovations.

Responsibilities

• Keep research infrastructure healthy and fine-tune components to achieve maximum system performance.
• Expand infrastructure capacity to handle increasing research workloads without compromising reliability or speed.
• Partner with research groups to grasp their specific needs and craft solutions that balance high performance with cost efficiency.
• Analyze distributed systems at scale to pinpoint and fix performance bottlenecks and capacity constraints.
• Develop and improve telemetry and monitoring tools to gain comprehensive insights into infrastructure performance, resource usage, and expenses across cloud and datacenter environments.
• Join on-call schedules and respond to incidents to ensure continuous system reliability.

Requirements

• Background in constructing or managing large-scale training platforms.
• Hands-on experience with large compute clusters featuring GPUs.
• Demonstrated capability to troubleshoot performance and reliability challenges across extensive distributed fleets.
• Excellent problem-solving abilities and capacity to work autonomously.
• Strong communication skills for effective collaboration with internal and external stakeholders.
• Extensive understanding of contemporary cloud infrastructure, including Kubernetes, Infrastructure as Code, AWS, and GCP.
• Familiarity with SLURM.

What the company offers

• The company reimburses reasonable travel expenses to facilitate in-person collaboration.
• Relocation assistance is available, though moving is not mandatory.

About the company

Black Forest Labs operates as a frontier research lab dedicated to research excellence, open science, and developing technology that enhances human creativity. The organization is guided by core values of being obsessed, maintaining a low ego, acting boldly, and treating others with kindness. The team functions with significant breadth and depth to drive innovation.

• The company emphasizes four core values: Obsessed, Low Ego, Bold, and Kind.
• The lab prioritizes research excellence and open science.
• The organization focuses on building technology that expands human creativity.
• The team operates with large breadth and depth.