Posted in

Delivery Quality Lead – GenAI

Delivery Quality Lead – GenAI

CompanyAmerican International Group
LocationCharlotte, NC, USA, Atlanta, GA, USA
Salary$Not Provided – $Not Provided
TypeFull-Time
DegreesBachelor’s, Master’s
Experience LevelSenior, Expert or higher

Requirements

  • Bachelor’s / Master’s degree in Computer Science, Information Technology, or related field (Master’s preferred).
  • 8+ years experience in data quality testing and quality assurance roles.
  • Strong automation experience using automation frameworks and hands on experience with Selenium, Cucumber.
  • Working experience on building technology solutions leveraging GenAI
  • Strong understanding of data quality frameworks and best practices.
  • Familiarity with data profiling, data cleansing, and data enrichment techniques.
  • Excellent analytical and problem-solving abilities.
  • Effective communication and interpersonal skills.
  • Leadership experience and the ability to lead and motivate a team.
  • Knowledge in Snowflake, ETL tools, Python, AWS preferred.
  • DevOps Tools and process knowledge.
  • Any experience in testing GenAI.
  • Knowledge on prompt engineering
  • Strong understanding of SAFe Agile and QA methodologies.
  • Excellent communication and leadership skills.

Responsibilities

  • Develop and implement testing strategies, methodologies and best practices catered towards GEN AI and traditional AI technologies.
  • Implementation of GenAI solution to improve testing strategies and plan.
  • Create detailed test plans, including test scope, objective, resource planning and schedules.
  • Review designing test cases, scenarios and automation scripts to validate data accuracy and integrity. Identify and prioritize critical data elements for testing.
  • Lead the testing team in executing data quality tests according to defined plans.
  • Report any deviations / risks to the leadership with right details.
  • Ensuring that the team performs high quality data validation, reconciliation, and data transformation testing.
  • Work with the teams to document defects, inconsistencies, and anomalies in data sets.
  • Evaluate opportunities for test automation to enhance testing efficiency.
  • Implement and maintain automated testing scripts and frameworks.
  • Monitor automated test execution and analyze results for accuracy.
  • Work closely with data engineers, data analysts, and data stewards to understand data structures and relationships.
  • Develop and manage test artifacts, metrics and reports for QA activity to align to executive communication needs.
  • Identify and document key risk items related to quality and present to program.
  • Collaborate with business analysts to understand data requirements and use cases.
  • Coordinate testing efforts across cross-functional teams to ensure comprehensive coverage.
  • Generate test summary, execution reports and metrics to communicate testing results.
  • Provide actionable insights to stakeholders based on test findings.
  • Contribute to continuous improvement efforts that will enhance data quality processes.
  • Identify areas for process improvement in data quality testing.
  • Implement measures to prevent data quality issues and ensure proactive detection.
  • Enhance testing methodologies based on lessons learned and industry standards.
  • Manage and mentor a team of data quality testers and analysts.
  • Provide guidance, training, and performance evaluations for team members.
  • Foster a collaborative and innovative work environment.
  • Work closely with the DevOps, compliance, audit and engineering teams to adhere to the established process and standards.

Preferred Qualifications

  • Knowledge in Snowflake, ETL tools, Python, AWS preferred.
  • Any experience in testing GenAI.
  • Knowledge on prompt engineering.