Product Manager – Evaluation
| Company | Waymo |
|---|---|
| Location | San Francisco, CA, USA, Mountain View, CA, USA |
| Salary | $170000 – $216000 |
| Type | Full-Time |
| Degrees | Master’s |
| Experience Level | Mid Level, Senior |
Requirements
- 3+ years experience working on AV, Robotics, or products that utilize Machine Learning or AI
- Experience in analytical roles or machine learning roles, interacting with data scientists
- Experience working in distributed systems, data infrastructure and/or cloud computing
- Ability to think about long-term product vision, and then decompose that into concrete, actionable plans with cross-org alignment
Responsibilities
- Understand our users — there are many different ways we leverage simulation to make data-driven decisions at Waymo: improve models that drive the car, assess our performance in a new environment or validate the readiness of a new vehicle platform. Each of these decisions requires a commitment to safety
- Work with a team of world class data scientists, engineers, machine learning practitioners to evaluate the safety of our driving behavior in a data-driven way.
- Power the launch of the Waymo Driver in new environments (markets, vehicle platforms, and driving scopes) by designing and executing an evaluation plan.
- Land features throughout simulation (such as synthetic data generation, sensor simulation and simulated agents) to increase signal and improve our ability to learn from simulation
- Work closely with Onboard developers who use our products to assess large model launches, to build sim & eval products that increase the quality and speed of launches.
- Develop a scalable framework to evaluate our driving performance across multiple street types, geos, and hardware platforms
Preferred Qualifications
- Experience with Simulation or Evaluation of AVs, Large Foundational Model training / evaluation pipelines or the evaluation / experimentation platforms for large production systems (Ads, Search, Ranking, etc..)
- Experience launching new features in an evaluation / experimentation platform used by Data Scientists or engineers
- Experience building tools, especially simulation or eval platforms used by engineers and / or data scientists. Emphasis on building simple, guided User Experiences.
- Master’s degree in a technical or engineering field, or equivalent practical experience