Posted in

Staff – Software Engineer

Staff – Software Engineer

CompanyWalmart
LocationSunnyvale, CA, USA
Salary$143000 – $286000
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • Bachelor’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years’ experience in software engineering or related area
  • 6 years’ experience in software engineering or related area

Responsibilities

  • Design and development of Real Time Inference System which will be used for deploying deep learning models or traditional ML models and run inferences on-demand at low latency.
  • Develop capabilities to support inferencing of Gen AI models, and support other LLM techniques like RAG, model fine tuning, building semantic cache.
  • Develop and implement best practices in MLOps to streamline the development, deployment, and monitoring of ML models.
  • Collaborate with product managers, data scientists, and other engineering teams to understand their needs and translate them into ML platform capabilities.
  • Lead architectural and design discussions to ensure our platform is modular, scalable, fault tolerant, and sustainably built.
  • Mentor and grow team members while working in an agile environment and ensure best engineering practices are followed.

Preferred Qualifications

  • You’re experienced with building real time inference systems for deploying deep learning or traditional ML models.
  • Experience with deploying and building real time systems for LLMs.
  • Working knowledge of setting up RAG.
  • Experience working with model lifecycle management tools like ML Flow and KF Serving.
  • Strong Expertise in Java, Object Oriented & Functional Programming, Design Patterns.
  • In-depth knowledge of No-SQL and RDBMS technologies.
  • Proficient with event driven architecture using Kafka.
  • Advanced knowledge of complex software design, distributed system design, design patterns, data structures and algorithms.
  • Working knowledge in container and cloud native technologies – Kubernetes, Docker.
  • Proficient in building scalable Microservices using Spring framework.
  • Experience with CI/CD tools such as Jenkins and Maven.
  • Strong expertise with Cloud Technologies like Azure and GCP.
  • Experience in monitoring production systems and using different systems like Grafana, Prometheus.
  • Strong inclination towards exploring and learning modern technologies.
  • You have strong written and oral communication skills.
  • Experience with all phases of the software development life cycle, best practices.
  • Agile Software Development.
  • You have experience working on ranking, online advertising, recommender systems, ecommerce, or relevant areas.