Senior Software Engineer, Evaluation Infrastructure
Waabi
- Company
- Waabi
- Location
- Toronto
- Job family
- Software Engineer jobs
- Level
- Senior roles
- Employment type
- Full Time
- Workplace
- Hybrid
- Experience level
- Senior
- Salary
- $127k – $223k
- Skills
- None
- Last verified open
The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system’s performance across all development stages. In this role, you will work closely with the systems & safety teams, responsible for defining the requirements & evaluation criteria, and simulation teams to leverage Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of the next generation of autonomous vehicles!
You will…
- Develop the tooling, infrastructure, and pipelines to support complex statistical analyses of driving performance scale.
- Implement metrics and tags to provide a holistic understanding of model performance and enable the discovery of interesting scenarios for training and evaluation.
- Develop and maintain a high availability query service to enable low-latency analysis and curation over large volumes of metric and tag data
- Work with large datasets from various sources including real world driving as well as Waabi World, our high-fidelity simulator.
- Champion engineering excellence, ensuring high-quality, well structured and tested code.
- Assist in project roadmap planning, prioritisation, and delivery.
Qualifications:
- MS/Bachelors degree with 2+ years of industry experience in Computer Science, Machine Learning and/or similar technical field(s) of study.
- Proficient in Python programming and strong software engineering fundamentals with real-world experience writing high quality, well-structured, and well-tested code.
- Open-minded and collaborative team player with the willingness to help others.
- Passionate about self-driving technologies, solving hard problems, and creating innovative solutions.
Bonus Points:
- Experience in data processing pipelines, ETL pipelines, distributed computing.
- Experience in building highly reliable and scalable web services
- Understanding of cloud job orchestration, monitoring, and instrumentation best-practices.
- Experience in evaluating complex ML models or self-driving software stacks.
The US yearly salary range for this role is: $127,000 - $223,000 USD in addition to competitive perks & benefits. Waabi (US) Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. The salary base range is reflective of the minimum and maximum target for new hire salaries for the position across all US locations. Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus.
- Competitive compensation and equity awards.
- Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
- Unlimited Vacation.
- Flexible hours and Work from Home support.
- Daily drinks, snacks and catered meals (when in office).
- Regularly scheduled team building activities and social events both on-site, off-site & virtually.
- As we grow, this list continues to evolve!
More jobs at Waabi
Technical Lead Manager, ML Dataset Platform
Waabi | San Francisco, CA | $200k – $280k
Senior / Staff Research Engineer, Generative AI Deployment
Waabi | Toronto, ON | $200k – $275k
Senior / Staff ML Ops Engineer
Waabi | Remote US & Canada | $184k – $272k
Senior / Staff Software Engineer, AI Tooling
Waabi | Toronto, ON | $165k – $265k
Senior / Staff Software Engineer, ML-based Controls
Waabi | Remote US & Canada | $241k – $320k
Similar open AI roles
Creative AI Engineer
Harvey | San Francisco | $168k – $253k
Creative AI Engineer
Harvey | New York | $168k – $253k
Manager, Solutions Architect
Together AI | San Francisco
Solutions Architect
Together AI | New York, NY
Research Engineer, Finetuning
Anthropic | San Francisco, CA | New York City, NY | Seattle, WA | $500k – $850k
Manager, Applied AI Architect
Anthropic | Seoul, South Korea
Researcher, Cyber Safety Training
OpenAI | San Francisco | $380k – $500k
Base Labs Research Scientist - RL Environments
Baseten | San Francisco