Posted in

Advance AI Agent Test Lead

Advance AI Agent Test Lead

CompanyAccenture
LocationBoston, MA, USA, Seattle, WA, USA, Houston, TX, USA, Des Moines, IA, USA, Nashville, TN, USA, San Francisco, CA, USA, Austin, TX, USA, Detroit, MI, USA, Cleveland, OH, USA, Bentonville, AR, USA, Los Angeles, CA, USA, Tampa, FL, USA, Miami, FL, USA, Morristown, NJ, USA, Dallas, TX, USA, Raleigh, NC, USA, Redmond, WA, USA, Philadelphia, PA, USA, Chicago, IL, USA, Charlotte, NC, USA, St. Louis, MO, USA, Arlington, VA, USA, Milwaukee, WI, USA, Carmel, IN, USA, Beaverton, OR, USA, Pittsburgh, PA, USA, Sacramento, CA, USA, Walnut Creek, CA, USA, Kirkland, WA, USA, Albany, NY, USA, Scottsdale, AZ, USA, Columbus, OH, USA, Hartford, CT, USA, Oklahoma City, OK, USA, New York, NY, USA, Minneapolis, MN, USA, Denver, CO, USA, Mountain View, CA, USA, Atlanta, GA, USA, San Diego, CA, USA, St. Petersburg, FL, USA, Cincinnati, OH, USA, Overland Park, KS, USA
Salary$87400 – $293800
TypeFull-Time
DegreesBachelor’s
Experience LevelSenior, Expert or higher

Requirements

  • Minimum 15 years of experience with automated test tools such as Cucumber, Selenium, and Behavioral Driven Development/Testing
  • Minimum of 5 years of experience in prompt testing and adversarial prompt testing
  • Minimum of 5 years of experience in agent functional testing and bias testing
  • Minimum of 5 years of experience in developing test strategies specifically for AI agents
  • Minimum of 5 years of experience in synthetic test-case generation using LLMs
  • Minimum of 5 years of experience in golden-set curation and Reinforcement Learning from AI Feedback (RLAIF) loops
  • Bachelor’s degree or equivalent (minimum 12 years) work experience. (If Associate’s Degree, must have minimum 6 years work experience)

Responsibilities

  • Define and implement comprehensive test strategies for AI agents
  • Manage and maintain test environments for agent-based systems
  • Validate the correctness, safety, and reliability of AI systems and agents
  • Collaborate with cross-functional teams to ensure alignment on testing goals and outcomes

Preferred Qualifications

  • Prior experience leading QA or testing teams in AI or machine learning environments
  • Strong understanding of AI safety and ethical testing practices