Engineering Manager II - AI Infrastructure

Engineering Manager II – AI Infrastructure

7+ years of experience in software engineering / machine learning, with at least 2 years in a people management role.
Proven ability leading collaborative projects involving multiple stakeholders across different functions.
Demonstrated capability building effective engineering teams focused on performance improvement.
Excellent communication skills paired with a collaborative mindset are essential.
Strong background in AI/ML infrastructure, distributed systems and cloud-based platforms.
Hands on experience in programming languages (Python, C++, Java or R) with technical background.
Strong understanding of data structures and algorithms.
Bachelors in Computer Science or related fields.

Lead and mentor a team of infrastructure and ML engineers to develop the AI Platform that powers Box AI.
Drive technical strategy while ensuring security, compliance, and reliability for our AI solutions.
Collaborate with cross-functional teams—including Product, Design, Security, and Legal—to create seamless AI-powered experiences.
Stay informed on trends in AI technology to enhance our platform’s capabilities continuously.
Foster a culture focused on innovation, technical excellence, and ongoing learning.
Work alongside senior leadership to establish a roadmap for team initiatives over the next year.

Masters in Computer Science or a related field
Proven track record of roadmap planning in which short-term projects ladder up to long-term vision
Past experience working with AI Infrastructure related to Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)
Good understanding of one of these areas: information retrieval, natural language processing, query understanding, query expansion
Familiarity with cloud based ML platforms such as Vertex AI, AWS Bedrock, AWS Sagemaker etc
Experience with Kubernetes bases systems