Advance AI Agent Test Lead
Company | Accenture |
---|---|
Location | Boston, MA, USA, Seattle, WA, USA, Houston, TX, USA, Des Moines, IA, USA, Nashville, TN, USA, San Francisco, CA, USA, Austin, TX, USA, Detroit, MI, USA, Cleveland, OH, USA, Bentonville, AR, USA, Los Angeles, CA, USA, Tampa, FL, USA, Miami, FL, USA, Morristown, NJ, USA, Dallas, TX, USA, Raleigh, NC, USA, Redmond, WA, USA, Philadelphia, PA, USA, Chicago, IL, USA, Charlotte, NC, USA, St. Louis, MO, USA, Arlington, VA, USA, Milwaukee, WI, USA, Carmel, IN, USA, Beaverton, OR, USA, Pittsburgh, PA, USA, Sacramento, CA, USA, Walnut Creek, CA, USA, Kirkland, WA, USA, Albany, NY, USA, Scottsdale, AZ, USA, Columbus, OH, USA, Hartford, CT, USA, Oklahoma City, OK, USA, New York, NY, USA, Minneapolis, MN, USA, Denver, CO, USA, Mountain View, CA, USA, Atlanta, GA, USA, San Diego, CA, USA, St. Petersburg, FL, USA, Cincinnati, OH, USA, Overland Park, KS, USA |
Salary | $87400 – $293800 |
Type | Full-Time |
Degrees | Bachelor’s |
Experience Level | Senior, Expert or higher |
Requirements
- Minimum 15 years of experience with automated test tools such as Cucumber, Selenium, and Behavioral Driven Development/Testing
- Minimum of 5 years of experience in prompt testing and adversarial prompt testing
- Minimum of 5 years of experience in agent functional testing and bias testing
- Minimum of 5 years of experience in developing test strategies specifically for AI agents
- Minimum of 5 years of experience in synthetic test-case generation using LLMs
- Minimum of 5 years of experience in golden-set curation and Reinforcement Learning from AI Feedback (RLAIF) loops
- Bachelor’s degree or equivalent (minimum 12 years) work experience. (If Associate’s Degree, must have minimum 6 years work experience)
Responsibilities
- Define and implement comprehensive test strategies for AI agents
- Manage and maintain test environments for agent-based systems
- Validate the correctness, safety, and reliability of AI systems and agents
- Collaborate with cross-functional teams to ensure alignment on testing goals and outcomes
Preferred Qualifications
- Prior experience leading QA or testing teams in AI or machine learning environments
- Strong understanding of AI safety and ethical testing practices