About this role
Capco is expanding its technical capability within the financial services and energy sectors by building robust quality assurance systems for modern AI-powered applications. The incoming Senior QA Automation Engineer will focus on designing and maintaining scalable test automation frameworks while validating advanced technologies like Large Language Models and autonomous agents.
This role exists to ensure the quality, safety, and reliability of complex AI-driven workflows and traditional software deliverables across global client projects. A successful candidate brings deep technical expertise in both standard automation tools and emerging AI evaluation frameworks, combined with a collaborative approach to working alongside product owners and development teams.
What you will do
- Design, develop, and maintain robust UI and API automation frameworks using Playwright and TypeScript.
- Validate AI-driven applications, Agentic AI workflows, LLM-powered systems, and intelligent agents through comprehensive test strategies.
- Develop and execute evaluation frameworks to measure AI response quality, accuracy, reliability, safety, and performance.
- Collaborate with developers, product owners, business analysts, and AI/ML teams to align on business and technical requirements.
- Integrate automation suites into CI/CD pipelines to ensure continuous quality delivery.
- Perform defect tracking, root cause analysis, and support issue resolution while mentoring junior QA engineers.
What you need
- Possess 8 to 10 years of experience in software testing and automation.
- Demonstrate strong expertise in UI and API test automation using Playwright with TypeScript.
- Bring hands-on experience in Agentic AI testing, including AI-driven workflows, Large Language Models, AI agents, and evaluation frameworks.
- Show proficiency in automating functional, regression, smoke, integration, and end-to-end test scenarios.
- Have experience automating API testing using REST APIs and validating request and response payloads.
Skills and tech stack
Questions candidates ask
Where is this role located?
This position is located in India - Mumbai.
What kind of projects will this person work on?
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.
What is the company culture like?
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.
What are the career growth opportunities?
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.