Senior AI QA Analyst - RQ02103

Duration - Until 30 Apr (Possibility of extension)

Location- Remote

Senior AI QA Analyst, take ownership of designing, implementing, and maintaining both manual and automated testing processes. Your work will span functional, system, integration, and performance testing, ensuring that our AI technologies are thoroughly evaluated and meet rigorous acceptance standards.

Role Deliverables

• Participate in all testing activities throughout agile product implementation
• Facilitate communication between development teams, UX/UI designers, and product managers
• Contribute to project insights, risk evaluations, and estimation discussions for testing
• Analyze requirements, user feedback, and design documents to ensure completeness and testability
• Formulate and execute robust test strategies tailored to AI projects
• Craft comprehensive test plans and test cases for AI solutions
• Update test documentation and create reports with traceability to project requirements
• Utilize defect tracking systems for issue resolution and documentation
• Propose innovative ideas and improvements to enhance testing effectiveness, speed, and quality
• Identify and implement in-house test automation frameworks

Skills:

• 5+ years experience in QA
• 3+ years experience creating detailed test plans & test cases
• Experience testing complex applications
• Proficiency using automated testing tools and platforms
• Background with Azure DevOps, Jira, and defect tracking systems
• Experience with automation tools such as Playwright, JMeter, SoapUI, and Postman
• Ability to experiment with Python or Typescript
• Database experience (SQL) for testing and analysis
• Knowledge of Python for AI development and testing
• Testing AI-generated responses for factual correctness and relevance
• Experience with observability tools like LangSmith or LangFuse
• Agile methodologies and working with UX principles, user stories, and customer research