Principal Software Engineer – LLM Serving – Cloud AI – Machine Learning Engineering

Principal Software Engineer – LLM Serving – Cloud AI – Machine Learning Engineering

Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field and 8+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
• OR Master’s degree in Computer Science, Engineering, Information Systems, or related field and 7+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
• OR PhD in Computer Science, Engineering, Information Systems, or related field and 6+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
• Proven ability of planning, managing and deliver large commercial software projects
• Experience in serving frameworks, like vLLM
• Strong development skills in PyTorch
• Strong understanding of LLMs, Multi-modal and reasoning models
• Experience in executing, analyzing, and optimizing neural networks
• Experience in writing high performance software for multicore systems
• Experience with C++, Python
• Strong skills in analyzing performance of software/hardware solutions on multi-core architectures; understanding of multi-core architecture fundamentals (core, cache, memory, bus, PCIe, etc)
• Understanding of multi-core processor architecture and SoC architectures (NoCs, caches, memories, etc.)
• Experience with Performance modeling of SoC architectures
• Excellent communication skills (written and verbal) and team player

Responsibilities

No responsibilities provided.

Preferred Qualifications

• Experience with machine learning accelerators and related software is highly desired
• Background and understanding of neural network operators and mathematical operations: linear algebra, math libraries, desirable
• Master’s, Computer Engineering and/or Computer Networks & Systems and/or Computer Science