Software Engineer, Platform & Inference
Chai Discovery
- Company
- Chai Discovery
- Location
- San Francisco office
- Role type
- ML Infrastructure
- Job family
- Software Engineer jobs
- Employment type
- Full Time
- Workplace
- On Site
- Experience level
- Mid
- Last verified open
About Chai Discovery
Chai builds the design suite for molecules. We train frontier models that learn the underlying foundations of biochemical structure and interaction, so scientists can move faster and pursue targets that other methods cannot reach.
AI is reinventing life sciences the same way it reinvented software engineering, and Chai is at the forefront of this shift. Leading pharmaceutical companies like Eli Lilly, Pfizer, and Novartis are adopting our platform to power their drug discovery programs.
We value diverse perspectives and are ready to find greatness in unexpected places.
About the role
Platform engineers make Chai's models fast, cheap, and reliable at scale, and enable the outer loop that accelerates research: the infrastructure and software abstractions used to train, eval, and understand models.
You'll own the serving stack that turns our frontier models into a product scientists depend on: latency, throughput, GPU efficiency, batching, and autoscaling across a large multi-cloud GPU fleet. You'll also contribute to the work that enables turning raw models into product-ready pipelines, and the experiment and observability tooling that lets a researcher ship faster.
You've built high-performance services that developers love, moved ML systems into production at scale, and can see around corners before they become outages.
You'll work closely with the researchers who train the models, the product engineers who build on them, and the commercial team deploying them to the world's largest pharma companies.
About you
We index on systems judgment, ownership, and the scars that come from having run production infrastructure before. We're looking for engineers who get obsessed with hard problems and don't give up easily. We look for:
4+ years building production systems, with real depth in performance, distributed systems, or ML serving
Experience optimizing model inference: GPU utilization, batching, quantization, caching, or kernel-level work
A platform mindset: you like building the tools and abstractions that make other engineers and researchers faster
End-to-end ownership of 24/7 systems, including observability, alerting, and incident response
Experience across both 0-to-1 buildouts and 1-to-n scale-ups, with an always-evolving playbook you bring wherever you go
The instinct to treat cost and efficiency as first-class constraints, not afterthoughts
A background in biology is not required. What makes the difference is technical excellence, curiosity about the domain, and grit.
We offer
The opportunity to work at the vanguard of AI research and frontier biology, with world-class people, on a mission that matters. We protect & promote a culture of high velocity and ownership. We compensate our team accordingly.
More jobs at Chai Discovery
Research Scientist, Pre-training Research
Chai Discovery | San Francisco office
Research Scientist, Applied Research
Chai Discovery | San Francisco office
Software Engineer, AI Platform
Chai Discovery | San Francisco office
Software Engineer, Developer & Research Platform
Chai Discovery | San Francisco office
Research Engineer - ML Infrastructure
Chai Discovery | San Francisco office
Similar open AI roles
Engineering Manager, Kubernetes Control Plane - Lambda Kubernetes Service
Lambda | San Francisco Office | $297k – $440k
ML Infra Engineer, Compute
Physical Intelligence | San Francisco
Software Engineer, Training Infrastructure
Thinking Machines Lab | San Francisco | $300k – $400k
Data Engineering Manager, Devices
OpenAI | San Francisco | $459k – $536k
Member of Technical Staff - Pre-Training Evals Infra (Inference)
Reflection AI | Global Office
Staff Software Engineer - Data & ML Systems (Behaviors)
Motional | Singapore, Central, Singapore
Member of Technical Staff - Infrastructure Security
Black Forest Labs | Remote | $220k – $280k
Senior Software Engineer II, Inference
CoreWeave | Sunnyvale, CA / Bellevue, WA | $182k – $242k