Skip to content
Senior Cloud Automation Engineer – Claims Adjudication
| Company | CVS Health |
|---|
| Location | Richardson, TX, USA |
|---|
| Salary | $92700 – $185400 |
|---|
| Type | Full-Time |
|---|
| Degrees | |
|---|
| Experience Level | Senior |
|---|
Requirements
- 5+ years of experience in test automation and software quality assurance, with a focus on API testing
- Proven experience designing and implementing automation frameworks using industry-standard tools
- Strong programming skills (Python, Java, etc.)
- Experience with cloud testing platforms and methodologies
- Comprehensive understanding of API architecture and Testing framework like Playwright, Cypress and similar tools
- Experience with RESTful, SOAP, GraphQL, or similar API technologies
- Experience with CI/CD tools like GitHub, GitLab CI, Jenkins
Responsibilities
- Design, develop, and execute comprehensive API test plans and test cases for AI models and services, covering functional, performance, security, and contract testing
- Conduct rigorous testing of new language models (commercial and open-source) via their APIs, focusing on accuracy, performance, scalability, and cost-effectiveness
- Validate data integrity and consistency across various API endpoints and integrations
- Implement and maintain API test automation frameworks and tools
- Develop and maintain automated test scripts using Python and relevant testing frameworks to maximize test coverage and efficiency
- Automate the testing of containerized microservices running in Google Cloud Platform (GCP) using appropriate CI/CD pipelines
- Champion automation best practices and drive continuous improvement in automation coverage
- Develop and maintain performance testing scripts for API endpoints and backend services
- Ensure the evaluation framework provides a robust and reliable environment for testing the latest AI offerings via automated processes
- Develop automated tests to validate the functionality and performance of the evaluation framework itself
- Implement automated reporting and analysis of test results
- Run automated tests against one or multiple language models simultaneously through API interfaces
- Work closely with software engineers, data scientists, and other stakeholders to understand requirements and ensure the delivery of high-quality AI solutions
- Clearly communicate technical concepts and testing results to both technical and non-technical stakeholders
- Stay abreast of the latest advancements in quality engineering, API testing, and AI technologies, incorporating best practices into the AI Hub’s testing processes
- Continuously evaluate and improve the AI Hub’s quality assurance capabilities, with a focus on automation and efficiency
Preferred Qualifications
- Ability to lead high performance software development testing teams
- Familiarity with AI/ML testing principles (beneficial but not primary)
- Playwright experience is preferred
- Experience in working both independently as well as part of a cross-functional team
- Background in cloud infrastructure testing, cloud-hosted testing, or SaaS testing
- Certification in relevant testing or automation disciplines
- Experience mentoring teams and establishing testing best practices
- Familiarity with GenAI concepts and usability in test automation
- Experience with data quality assurance for systems integration
- Knowledge of IBM i-Series (AS/400) systems and automation tools like UiPath
