Member of Technical Staff - Research Infrastructure Engineer
Black Forest Labs
- Company
- Black Forest Labs
- Location
- Freiburg
- Role type
- ML Infrastructure
- Job family
- Infrastructure Engineer jobs, Member of Technical Staff jobs
- Employment type
- Full Time
- Workplace
- Hybrid
- Experience level
- Mid
- Salary
- $150k – $300k
- Last verified open
About Black Forest Labs
We’re the team behind Latent Diffusion, Stable Diffusion, and FLUX—foundational technologies that changed how the world creates images and video. We’re creating the generative models that power how people make images and video—tools used by millions of creators, developers, and businesses worldwide. Our FLUX models are among the most advanced in the world, and we’re just getting started.
Headquartered in Freiburg, Germany with a growing presence in San Francisco, we’re scaling fast while staying true to what makes us different: research excellence, open science, and building technology that expands human creativity.
Why This Role
We're looking for engineers to build and maintain the engine that powers our mission to develop visual intelligence. From maintaining and scaling clusters, to building research platforms to accelerate the rate of innovation, this team operates with large breadth and depth. We build the systems to make multi-week/month long training possible, to orchestrate resources at scale, and at the same time efficiently, enabling the next breakthrough model. If you’re obsessed with distributed systems at scale, infrastructure reliability, scalability, security, and continuous improvement, this team would be perfect for you.
What You’ll Work On
Maintain research infrastructure, ensuring health, and optimizing components to extract peak performance from the system (both on application, and infrastructure side)
Scale infrastructure to meet growing research demands while maintaining reliability and performance
Collaborate with research teams to deeply understand their infrastructure needs, and design solutions that balance performance with cost efficiency.
Identify and resolve performance bottlenecks and capacity hotspots through deep analysis of distributed systems at scale.
Build and evolve telemetry and monitoring systems to provide deep visibility into infrastructure performance, utilization, and costs across our cloud and datacenter fleets.
Participate in on-call rotations and incident response to maintain system reliability
Technical Focus
Python, Bash, Go
Kubernetes
Nvidia GPU drivers, and operators
OTel, Prometheus
What We’re Looking For
Experience building or operating large-scale training platforms
Worked with large scale compute clusters (GPUs)
Proven ability to debug performance and reliability issues across large distributed fleets
Strong problem-solving skills and ability to work independently
Strong communication skills and the ability to work effectively with both internal and external partners
Deep knowledge of modern cloud infrastructure including Kubernetes, Infrastructure as Code, AWS, and GCP
Experience with SLURM
Experience building or operating large-scale training platforms
How We Work Together
We’re a distributed team with real offices that people actually use. Depending on your role, you’ll either join us in Freiburg or SF at least 2 days a week (or one full week every other week), or work remotely with a monthly in-person week to stay connected. We’ll cover reasonable travel costs to make this possible. We think in-person time matters, and we’ve structured things to make it accessible to all. We’ll discuss what this will look like for the role during our interview process.
Everything we do is grounded in four values:
Obsessed. We are a frontier research lab. The science has to be right, the understanding deep, the product beautiful.
Low Ego. The work speaks. The best idea wins, no matter who said it. Credit is shared. Nobody is above any task.
Bold. We take the ambitious bet. We ship, we do not wait for conditions to be perfect.
Kind. People over politics. We treat each other with genuine warmth. Agency without empathy creates chaos.
If this sounds like work you’d enjoy, we’d love to hear from you.
Base Annual Salary:
EU €100,000 - €230,000 + Equity
US $150,000 - $300,000 + Equity
This role is based in our Freiburg / San Francisco office. We operate a hybrid model and cover reasonable travel costs — relocation is encouraged but not required. We do expect a meaningful in-person presence, and we'll discuss what that looks like for your situation during the process.
Note: Our recruitment process uses AI-assisted tools to help manage and organize applications. All hiring decisions are always made by our team.
More jobs at Black Forest Labs
Machine Learning Engineer - Moderation
Black Forest Labs | San Francisco | $220k – $280k
Member of Technical Staff - Infrastructure Security
Black Forest Labs | Remote | $220k – $280k
Solutions Engineer
Black Forest Labs | San Francisco | $180k – $285k
Product Research Lead
Black Forest Labs | Freiburg
Applied Research Engineer, Evaluation
Black Forest Labs | Freiburg
Similar open AI roles
Engineering Manager, Kubernetes Control Plane - Lambda Kubernetes Service
Lambda | San Francisco Office | $297k – $440k
ML Infra Engineer, Compute
Physical Intelligence | San Francisco
Software Engineer, Training Infrastructure
Thinking Machines Lab | San Francisco | $300k – $400k
Data Engineering Manager, Devices
OpenAI | San Francisco | $459k – $536k
Member of Technical Staff - Pre-Training Evals Infra (Inference)
Reflection AI | Global Office
Staff Software Engineer - Data & ML Systems (Behaviors)
Motional | Singapore, Central, Singapore
Member of Technical Staff - Infrastructure Security
Black Forest Labs | Remote | $220k – $280k
Senior Software Engineer II, Inference
CoreWeave | Sunnyvale, CA / Bellevue, WA | $182k – $242k