Skip to content
Rust Systems Engineer – Inference
| Company | Together AI |
|---|
| Location | San Francisco, CA, USA |
|---|
| Salary | $160000 – $240000 |
|---|
| Type | Full-Time |
|---|
| Degrees | |
|---|
| Experience Level | Mid Level, Senior |
|---|
Requirements
- Demonstrated proficiency in Rust programming language and ecosystem
- Strong experience with Rust frameworks namely `axum`, `tokio`, `jemalloc`, `serde`, `rayon`, and/or `crossbeam`
- Deep understanding of concurrent programming and multiprocessing patterns
- Experience developing and optimizing orchestration and scheduling algorithms
- Knowledge of distributed systems principles and design
- Experience interfacing Rust services with RPC components
- Ability to optimize systems for performance, reliability, and resource efficiency
- Solid understanding of memory management and performance profiling.
Responsibilities
No responsibilities provided.
Preferred Qualifications
- Experience with one or more ML inference frameworks (HuggingFace TGI, NVIDIA Dynamo, Candle, Pixi, uv, llguidance)
- Background in designing and implementing high-throughput, low-latency systems
- Knowledge of disaggregated serving architectures and continuous batching algorithms for ML workloads
- Familiarity with ML/AI inference systems and performance optimization techniques
- Experience with system benchmarking and performance analysis
