Machine Learning Engineer – Inference
| Company | ByteDance |
|---|---|
| Location | San Jose, CA, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | |
| Experience Level | Mid Level, Senior |
Requirements
- Extensive experience in developing and deploying large-scale systems.
- Experience contributing to an open sourced machine learning framework (tensorflow / jax / pytorch / torchscript / mxnet / tensorrt).
- Strong background in one of the following fields: Hardware-Software Co-Design, High Performance Computing, ML Hardware Acceleration (e.g., GPU/RDMA) or ML for Systems.
Responsibilities
- Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models.
- Responsible for building monitoring/managing tools to oversee the reliability and scalability of online inference servers.
- Responsible for triaging system inefficiency and bottlenecks and improving system performance.
- Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions.
- Responsible for collaboration with product teams and providing general solutions to meet their requirements.
Preferred Qualifications
-
No preferred qualifications provided.