Lead Data Platform Engineer - Enterprise, Data & AI
Zoox
- Company
- Zoox
- Location
- Foster City
- Role type
- ML Infrastructure
- Job family
- AI Engineer jobs, Infrastructure Engineer jobs
- Level
- Senior roles
- Employment type
- Full Time
- Workplace
- Hybrid
- Experience level
- Senior
- Salary
- $230k – $277k
- Posted
- Last verified open
Zoox is seeking a high-agency, hands-on Lead Data Platform Engineer to architect, optimize, scale and own the next generation of our enterprise & AI data foundation. In this role, you will architect a high throughput, data fabric that unifies data across Zoox and downstream AI agents. You will drive performance tuning, cost optimization, RBAC, data governance and CI/CD pipelines to deliver secure, low-latency, 'AI-ready' data foundations across the organization.
You will serve as the primary technical driver for our data platform, designing autonomous frameworks, building scalable data infrastructure and establishing strict standards for security and developer velocity. This is an engineering-intensive leadership role for a builder who thrives on solving complex challenges.
In This Role, You Will...
- Scaling self-healing data pipelines that automatically handle schema evolution, detect anomalies, execute circuit breakers and recover from failures without manual intervention.
- Define and enforce company-wide data governance, access, automated data quality testing, schema evolution policies and metadata management to maintain high-fidelity data assets.
- Implement intelligent storage lifecycle strategies, resource throttling and query optimization to minimize compute overhead while delivering high-throughput, low-latency data access for analytics and AI agents. With a focus on Databricks vs EMR (AWS) cloud optimization (cost and performance).
- Build automated CI/CD deployment templates, environment isolation, testing frameworks and version control standards, enabling rapid, reliable and zero-downtime deployments
Qualifications
- 10+ years of hands-on experience in Data Platform Engineering or Software Engineering with a proven track record of architecting and scaling production-grade data foundations.
- Deep expertise in scaling and optimization, query tuning, compute resource allocation and implementing efficient compute-storage lifecycle policies to minimize infrastructure costs.
- Experience implementing enterprise security standards, Role-Based Access Control (RBAC), Active Directory/IAM roles and fine-grained data masking, with strong familiarity supporting enterprise compliance requirements (e.g., SOX, audit trail controls, data retention policies).
- Track record of establishing enterprise data governance frameworks, automated schema evolution controls, data quality audits and near real-time observability/alerting.
- Hands-on experience building automated CI/CD pipelines, environment isolation (branch testing, rollback mechanisms), version control and automated deployment testing for data assets.
Bonus Qualifications
- Experience incorporating LLMs or GenAI directly into pipeline operations (e.g., code generation, triage and root-cause analysis, automated data reconciliation, backfills or anomaly detection).
- Experience with infrastructure-as-code (Terraform) and containerization/orchestration (EKS) for elastic compute management. GPU/CPU performance optimization & utilization.
- Previous experience in the autonomous vehicle, robotics or high-tech manufacturing sectors.
More jobs at Zoox
Data Scientist Intern [Summer 2027]
Zoox | Foster City, CA
Contract Student Worker - Machine Learning Engineer
Zoox | Boston, MA
Data Science Intern [Summer 2027]
Zoox | Foster City, CA
Staff / Senior Staff Machine Learning Engineer - Collision Avoidance System
Zoox | Foster City, CA | $291k – $409k
Senior Data Scientist
Zoox | Boston, MA | $225k – $307k
Similar open AI roles
Engineering Manager, Kubernetes Control Plane - Lambda Kubernetes Service
Lambda | San Francisco Office | $297k – $440k
ML Infra Engineer, Compute
Physical Intelligence | San Francisco
Software Engineer, Training Infrastructure
Thinking Machines Lab | San Francisco | $300k – $400k
Data Engineering Manager, Devices
OpenAI | San Francisco | $459k – $536k
Member of Technical Staff - Pre-Training Evals Infra (Inference)
Reflection AI | Global Office
Staff Software Engineer - Data & ML Systems (Behaviors)
Motional | Singapore, Central, Singapore
Member of Technical Staff - Infrastructure Security
Black Forest Labs | Remote | $220k – $280k
Senior Software Engineer II, Inference
CoreWeave | Sunnyvale, CA / Bellevue, WA | $182k – $242k