Research/Compiler Engineer
| Company | Lightning AI |
|---|---|
| Location | Palo Alto, CA, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | Bachelor’s, Master’s, PhD |
| Experience Level | Senior, Expert or higher |
Requirements
- Strong experience with deep learning frameworks like PyTorch, JAX, or TensorFlow.
- Expertise in compiler development or optimizations in distributed training and inference workflows is highly valued.
- Proven track record contributing to open-source projects, especially in machine learning or high-performance computing. Experience collaborating with external partners is a plus.
- Hands-on experience in model optimization, with a focus on maximizing performance, efficiency, and scalability in large-scale or distributed training setups.
- Passion for engaging with open-source communities, including experience supporting users and advocating for project adoption.
- Strong communication and collaboration skills for working within a close-knit, high-impact team environment.
- Bachelor’s degree in Computer Science, Engineering, or related field. Preferred Master’s or PhD in machine learning and related areas.
Responsibilities
- Develop the Thunder compiler, an open-source project developed in collaboration with one of our strategic partners, using your deep experience in PyTorch, JAX, or other deep learning frameworks.
- Engage in performance-oriented model optimizations, around distributed training as well as inference.
- Develop optimized kernels in CUDA or Triton to target specific use-cases.
- Integrate Thunder throughout the PyTorch Lightning ecosystem.
- Engage with the community and champion its growth.
- Support the adoption of Thunder across the industry.
- Work closely within the Lightning team as a strategic partner.
Preferred Qualifications
- Experience collaborating with external partners is a plus.