Skip to content

Staff – Software Engineer
Company | Walmart |
---|
Location | Sunnyvale, CA, USA |
---|
Salary | $143000 – $286000 |
---|
Type | Full-Time |
---|
Degrees | Bachelor’s |
---|
Experience Level | Mid Level, Senior |
---|
Requirements
- Bachelor’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years’ experience in software engineering or related area
- 6 years’ experience in software engineering or related area
Responsibilities
- Design and development of Real Time Inference System which will be used for deploying deep learning models or traditional ML models and run inferences on-demand at low latency.
- Develop capabilities to support inferencing of Gen AI models, and support other LLM techniques like RAG, model fine tuning, building semantic cache.
- Develop and implement best practices in MLOps to streamline the development, deployment, and monitoring of ML models.
- Collaborate with product managers, data scientists, and other engineering teams to understand their needs and translate them into ML platform capabilities.
- Lead architectural and design discussions to ensure our platform is modular, scalable, fault tolerant, and sustainably built.
- Mentor and grow team members while working in an agile environment and ensure best engineering practices are followed.
Preferred Qualifications
- You’re experienced with building real time inference systems for deploying deep learning or traditional ML models.
- Experience with deploying and building real time systems for LLMs.
- Working knowledge of setting up RAG.
- Experience working with model lifecycle management tools like ML Flow and KF Serving.
- Strong Expertise in Java, Object Oriented & Functional Programming, Design Patterns.
- In-depth knowledge of No-SQL and RDBMS technologies.
- Proficient with event driven architecture using Kafka.
- Advanced knowledge of complex software design, distributed system design, design patterns, data structures and algorithms.
- Working knowledge in container and cloud native technologies – Kubernetes, Docker.
- Proficient in building scalable Microservices using Spring framework.
- Experience with CI/CD tools such as Jenkins and Maven.
- Strong expertise with Cloud Technologies like Azure and GCP.
- Experience in monitoring production systems and using different systems like Grafana, Prometheus.
- Strong inclination towards exploring and learning modern technologies.
- You have strong written and oral communication skills.
- Experience with all phases of the software development life cycle, best practices.
- Agile Software Development.
- You have experience working on ranking, online advertising, recommender systems, ecommerce, or relevant areas.