Senior Machine Learning Engineer - Perception 3D Segmentation
Zoox
- Company
- Zoox
- Location
- Foster City
- Role type
- ML Engineering
- Job family
- Machine Learning Engineer jobs
- Level
- Senior roles
- Employment type
- Full Time
- Workplace
- Hybrid
- Experience level
- Senior
- Salary
- $254k – $350k
- Posted
- Last verified open
In this role, you will...
-
Design and implement state-of-the-art multi-modal sensor fusion architectures (Lidar, Camera, Radar) to predict 3D occupancy, semantic segmentation, and flow .
-
Develop "vision-first" fusion strategies to enhance geometric understanding and reduce dependency on sparse sensor modalities .
-
Engineer temporal processing modules to improve the stability and consistency of predictions over time.
-
Optimize model architectures for real-time on-vehicle inference, balancing high-fidelity range extension with strict latency constraints .
-
Collaborate with downstream consumers (Tracking, Prediction, Planner) to refine geometric outputs, such as contours and free-space estimations, for complex maneuvering.
Qualifications
-
MS or PhD in Computer Science, Robotics, Machine Learning, or related field with 6+ years of industry experience.
-
Deep expertise in 3D Computer Vision and Deep Learning, specifically with voxel-based or BEV (Bird's Eye View) architectures.
-
Strong proficiency in Python and deep learning frameworks (PyTorch) for model training and design as well as some experience in C++ for model integration.
-
Experience with multi-sensor fusion (Lidar, Camera, Radar) and handling temporal data sequences.
-
Experience with occupancy networks, implicit representations (NeRF/Gaussian Splats), or scene flow estimation.
Bonus Qualifications
-
Experience optimizing models for TensorRT/CUDA to achieve low-latency inference.
-
Familiarity with sparse convolutions or query-based architectures for efficient 3D processing.
-
Experience with Vision Language Model, or multi-modal 3D foundation model, or World Model, or VLA.
More jobs at Zoox
Data Scientist Intern [Summer 2027]
Zoox | Foster City, CA
Contract Student Worker - Machine Learning Engineer
Zoox | Boston, MA
Data Science Intern [Summer 2027]
Zoox | Foster City, CA
Staff / Senior Staff Machine Learning Engineer - Collision Avoidance System
Zoox | Foster City, CA | $291k – $409k
Senior Data Scientist
Zoox | Boston, MA | $225k – $307k
Similar open AI roles
Machine Learning Engineer - Moderation
Black Forest Labs | San Francisco | $220k – $280k
Contract Student Worker - Machine Learning Engineer
Zoox | Boston, MA
Senior Machine Learning Engineer (Applied Intelligence)
Anduril Industries | Santa Ana, California | $220k – $292k
Principal Engineer, Autonomy Systems Engineering, ODD Definition & Risk
Motional | Boston, Massachusetts, United States; Las Vegas, Nevada, United States; Pittsburgh, Pennsylvania, United States; Remote U.S. | $200k – $275k
Senior/Staff Systems Engineer, Autonomy Verification
Nuro | Mountain View, California
Sr. Model Engineer, Voice
xAI | Palo Alto, CA | $220k – $357k
2027 Summer Intern, PhD, Machine Learning - Generative World Models & Controllable Simulation
Waymo | Mountain View, California
2027 Summer Intern, Machine Learning, MS/PhD, Simulation Realism (World Model)
Waymo | Mountain View, California