QA Engineer / SDET – AI Testing
- Location
- Thiruvananthapuram, Kerala, India
- Salary
- Not specified
- Company
- akash pawar
Job description
• Role & Company / Project Overview: We are looking for an experienced QA Engineer / SDET with strong Python automation skills and hands-on experience testing AI-powered applications and services. If you have expertise beyond traditional UI and functional testing and understand how to validate LLMs, RAG systems, AI agents, and GenAI applications, this opportunity is for you. We are seeking a quality engineering professional who can develop effective testing strategies for AI systems, investigate complex failures, and ensure the reliability and quality of Gen AI-powered products. • Key Responsibilities & Daily Duties: - Design automated tests where exact output matching is not always appropriate. - Conduct reliability, resilience, fault tolerance, and recovery testing. - Perform performance, load, stress, and soak testing using k6, Locust, JMeter, or equivalent tools. - Integrate automated test suites into CI/CD pipelines. - Perform thorough debugging and root-cause analysis on complex AI system failures. - Collaborate closely with developers and understand technical architecture to validate LLMs, RAG systems, AI agents, and GenAI products. • Required Qualifications, Skills & Experience: - 6+ years of experience in QA Automation, SDET, or Quality Engineering. - Strong hands-on experience with Python and Pytest. - Practical experience testing AI-powered applications, LLMs, RAG systems, AI agents, or GenAI products. - Deep understanding of prompts, context, retrieval, tool calling, model responses, and non-deterministic behavior. - Experience designing automated tests for non-deterministic and dynamic outputs. - Hands-on experience with reliability, resilience, fault tolerance, and recovery testing. - Demonstrated experience in performance, load, stress, and soak testing using k6, Locust, JMeter, or equivalent. - Proven track record integrating automated tests into CI/CD pipelines. - Strong debugging and root-cause analysis skills. - Ability to collaborate with developers and understand technical architecture. - Experience with Docker, Kubernetes, or cloud-based services. • Working Hours, Shifts & Location Details: - Location: Trivandrum, Kerala (Hybrid). - Employment Type: Full-time. • Application Instructions: Interested candidates are invited to share their updated CV for consideration.