Staff Machine Learning Engineer
Company | ServiceNow |
---|---|
Location | Santa Clara, CA, USA |
Salary | $173100 – $303000 |
Type | Full-Time |
Degrees | Bachelor’s, Master’s, PhD |
Experience Level | Senior, Expert or higher |
Requirements
- Proficient in prompt engineering and developing LLM based features
- Experience with methods of training and fine tuning LLMs, such as distillation, supervised fine-tuning and policy optimization
- Experience in using AI productivity tools such as Cursor, Windsurf, etc.
- Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving
- 6+ years of relevant experience with a Bachelor’s degree; or 4 years with a Master’s degree; or a PhD with no experience; or equivalent work experience
- Solid expertise in Python
- Solid Machine Learning / Deep Learning theoretical knowledge and hands-on experience
- Experience with LLM benchmarking and evaluation is required; experience generating synthetic data is a plus
- Ability to read and experiment with ideas from recent research papers
- High level of creativity, quick problem-solving abilities, and adaptability
- Effective communication skills to convey research findings to both technical and non-technical stakeholders
Responsibilities
- Use AI/ML expertise and creativity to apply existing methods and develop new ones to solve real-world challenges and datasets
- Research, propose and implement appropriate models/techniques for LLM benchmarking
- Participate in data collection and synthetic data generation, and generate custom benchmarks to evaluate diverse LLMs capabilities
- Collaborate daily with a team of developers, applied research scientists, product managers, quality engineers and linguists, to produce quality software
- Contribute to the implementation of tools to facilitate LLMs evaluation and perform model / error analysis
- Develop innovative patentable ideas that ensure the competitiveness of this product within the domain of similar work being done in the industry
- Potentially write research papers in collaboration with our Research Group, to be published to the most notorious AI Conferences
- Work with product owners to understand detailed requirements and own your code from design, implementation, testing and delivery of high-quality & high-impact solutions to our users
Preferred Qualifications
- Experience generating synthetic data is a plus