State Estimation Engineer - Data Collection Systems
Figure AI
- Company
- Figure AI
- Location
- San Jose
- Role type
- ML Engineering
- Employment type
- Full Time
- Workplace
- On Site
- Experience level
- Mid
- Posted
- Last verified open
Figure is an AI Robotics company autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in the home and commercial markets. We are based in North San Jose, CA and require 5 days/week in-office collaboration. It’s time to build.
We are looking for a State Estimation Engineer to own the architecture, algorithm development, and calibration workflows for a next-generation data collection system. This system powers two core capabilities: low-latency real-time teleoperation of our humanoid robots and ultra-high-precision offline trajectory reconstruction for data collection and policy training. You will build and deploy dual-tier estimation pipelines and user-onboarding calibration routines that fuse heterogeneous sensor modalities to track full-body human kinematics and floating-base motion across dynamic tasks.
Key Responsibilities:
- Design and implement dual-tier state estimation algorithms in modern C++: low-latency, real-time filters for streaming teleoperation and batch optimization/smoothing routines for high-accuracy offline dataset generation.
- Own and develop subject-calibration procedures, designing rapid, intuitive routines to estimate individual body segment dimensions, joint offsets, and sensor-to-body extrinsics whenever a user equips the system.
- Develop robust sensor fusion architectures combining spatial transforms, visual-inertial data, and inertial signals into full-body kinematic pose estimates.
- Address spatiotemporal sensor calibration, dynamic environmental interference, and kinematic constraint enforcement on human skeletal models.
- Develop techniques to extract useful information from compliant tactile sensing in the presence of large sensor deformation, stretching or folding.
- Diagnose and understand limitations of existing hardware or designs and inform future design requirements.
- Evaluate novel sensing modalities to inform future hardware designs.
- Build diagnostic tooling, validation pipelines, and error analysis workflows to evaluate accuracy for both online and offline algorithms.
Requirements:
- 4+ years of experience building multi-sensor fusion and state estimation solutions for dynamic hardware systems.
- Hands-on expertise with both real-time filtering techniques ((E)KFs, sliding-window estimators) and offline batch optimization tools (Factor Graphs, GTSAM, Ceres, Non-Linear Least Squares).
- Proven capability to design fast, reliable calibration, zeroing, and alignment workflows for multi-sensor suites and kinematic models.
- Deep mathematical foundation in 3D spatial kinematics, Lie groups (SE(3), SO(3)), forward/inverse kinematics, and constrained optimization.
- Proven ability to write high-performance, modular C++ for embedded or edge computing platforms alongside Python for data analysis and visualization.
Bonus Qualifications:
- Experience with low-latency streaming pipelines for teleoperation, haptics, or human-in-the-loop control systems.
- Background in human biomechanics, skeletal tracking, or body-mounted telemetry systems.
- Prior experience applying Machine Learning (ML) techniques to motion priors, trajectory smoothing, or learned state estimation/calibration.
The US base salary range for this full-time position is between $150,000 and $300,000 annually.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.
More jobs at Figure AI
Deployment Engineering Intern
Figure AI | San Jose, CA
Helix AI Engineer, Training Performance
Figure AI | San Jose, CA | $200k – $400k
Deployment Engineer (Data Collection)
Figure AI | San Jose, CA | $125k – $185k
Helix AI Engineer, Localization and Mapping
Figure AI | San Jose, CA | $200k – $400k
Staff AI Inference and Acceleration Engineer
Figure AI | San Jose, CA | $180k – $275k
Similar open AI roles
Machine Learning Engineer - Moderation
Black Forest Labs | San Francisco | $220k – $280k
Contract Student Worker - Machine Learning Engineer
Zoox | Boston, MA
Senior Machine Learning Engineer (Applied Intelligence)
Anduril Industries | Santa Ana, California | $220k – $292k
Principal Engineer, Autonomy Systems Engineering, ODD Definition & Risk
Motional | Boston, Massachusetts, United States; Las Vegas, Nevada, United States; Pittsburgh, Pennsylvania, United States; Remote U.S. | $200k – $275k
Senior/Staff Systems Engineer, Autonomy Verification
Nuro | Mountain View, California
Sr. Model Engineer, Voice
xAI | Palo Alto, CA | $220k – $357k
2027 Summer Intern, PhD, Machine Learning - Generative World Models & Controllable Simulation
Waymo | Mountain View, California
2027 Summer Intern, Machine Learning, MS/PhD, Simulation Realism (World Model)
Waymo | Mountain View, California