Posted in

Senior Software Engineer – ML Planner Evaluation

Senior Software Engineer – ML Planner Evaluation

CompanyWaymo
LocationMountain View, CA, USA
Salary$192000 – $243000
TypeFull-Time
DegreesMaster’s, PhD
Experience LevelSenior

Requirements

  • M.S. in Computer Science, Machine Learning, Robotics, Statistics, Physics, Math or another quantitative area
  • 5+ years of industry experience building and evaluating large-scale ML systems
  • Proficiency in Python
  • Familiarity with one of the modern deep learning frameworks (e.g. JAX, Tensorflow)
  • Experience with tools for large-scale parallel compute and data manipulation (Apache Beam, SQL)

Responsibilities

  • Develop evaluation methodologies for Foundation Models and production models: Research and propose new ways to assess the quality, safety, and realism of ML models used to generate driving plans and agent trajectories.
  • Contribute to the design and development of robust ML evaluation tools: Design, build, and improve evaluation tools that enable model hillclimbing and inform production model release decisions.
  • Build evaluation products that advance business needs: Partner with teams in Planner and Research to launch new and improved ML evaluation products that directly address business requirements.
  • Leverage Waymo’s industry-leading datasets and evaluation frameworks: Utilize extensive datasets and established evaluation frameworks to conduct robust and reliable evaluations.
  • Employ creative simulation strategies to measure the driving performance of generative AI models: Identify potential edge cases, and provide reliable performance insights that inform model development and deployment.

Preferred Qualifications

  • Ph.D. in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
  • Proficiency in C++