Posted in

Software Engineer – Systems ML – Pytorch Compiler – Pytorch Framework – Pytorch Performance

Software Engineer – Systems ML – Pytorch Compiler – Pytorch Framework – Pytorch Performance

CompanyMeta
LocationMenlo Park, CA, USA
Salary$85.1 – $251000
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • Advanced in Python or C++ programming.
  • Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • 4+ years of research or industry experience in developing compilers, ML systems, ML accelerators, GPU performance, and similar.

Responsibilities

  • Develop the PT2 compiler (e.g., TorchDynamo, TorchInductor, Export, PyTorch Core).
  • Improve PyTorch performance via systematic solutions for the entire community.
  • Explore the intersection of the PyTorch compiler and PyTorch distributed.
  • Optimize Generative AI models across the stack (pre-training, fine-tuning, and inference).
  • Collaborate with users of PyTorch to enable new use cases of PT2 technologies both inside and outside Meta.

Preferred Qualifications

  • Experience in developing PyTorch/PT2, Triton, MLIR, JAX, XLA, TVM is a huge plus
  • Experience in developing inside other ML frameworks like Caffe2, TensorFlow, ONNX, TensorRT
  • Knowledge in GPU architecture, ML accelerator performance, and developing high-performance kernels.
  • Experience with training models, end-to-end model optimizations, or applying ML to systems.
  • Knowledge of communication collectives, PyTorch distributed, and parallelism.
  • Experience in building OSS communities and extensive social media presence in the ML Sys domain.