Posted in

On-device ML Infrastructure Engineer – Compiler & Runtime

On-device ML Infrastructure Engineer – Compiler & Runtime

CompanyApple
LocationCupertino, CA, USA
Salary$175800 – $312200
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • Bachelors in Computer Science, Engineering, or related discipline.
  • Highly proficient in C++. Familiarity with Python and/or Swift
  • Familiarity with Operating Systems and Embedded Programming.
  • Sound understanding of ML fundamentals, including common architectures such as Transformers.

Responsibilities

  • Design, build, and maintain critical machine learning infrastructure that powers Apple’s on device machine learning features.
  • Collaborate with downstream hardware compilers to best leverage Apple’s on device machine learning hardware.
  • Collaborate with first and third party users to adopt our infrastructure and apply best practices when they implement machine learning on Apple devices.
  • Ensure our infrastructure can run optimally for a wide range of first and third party machine learning models.

Preferred Qualifications

  • Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc.
  • Experience with open source machine learning models (Mistral, Phi, Gemma, Huggingface, etc)
  • Experience with any compiler stack (MLIR/LLVM/TVM/…).
  • Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.).
  • Experience with machine learning accelerators and GPU programming.
  • Good communication skills, including ability to communicate with cross-functional audiences.