Senior Software Quality Engineer – AI Acceleration /
- Location
- Brampton, Ontario, Canada
- Salary
- Not specified
- Company
- Akash pawar
Job description
Role & Company / Project Overview: Business Intelli Solutions Inc. is seeking a seasoned Senior Software Quality Engineer specializing in AI Acceleration / Global DevOps. This is a contract engagement operating under a hybrid model based in Brampton, Ontario. The candidate will bring deep expertise across Test Automation, DevOps, AI/GenAI testing, and Quality Engineering. Key Responsibilities & Daily Duties: • Partner with DevOps, Development, Product, and QE teams to define and deliver quality strategies. • Design test plans, test cases, and test data. • Develop and maintain scalable automation frameworks. • Build automated tests for AI-enabled features and GenAI applications. • Validate APIs, microservices, data pipelines, model interactions, and third-party integrations. • Integrate automated testing and AI quality checks into CI/CD pipelines. • Analyze test coverage, quality trends, and AI evaluation results. • Identify, document, and track defects through resolution. • Communicate quality metrics, risks, and test results to technical and business stakeholders. • Drive continuous quality improvement across Agile teams. Required Qualifications, Skills & Experience: • 5+ years of Quality Engineering / QA / Test Automation / Software Development experience. • 5+ years of programming experience with Java, Python, or Groovy. • Strong experience building and maintaining Test Automation Frameworks. • Proficiency in Selenium, Cucumber-Gherkin, and Playwright. • Hands-on expertise with RestAssured and API Testing. • Experience with JUnit and TestNG. • Experience with ReadyAPI and JMeter. • Expertise in Functional, Integration, System, and Regression Testing. • Strong background in Database, API, and Microservices Testing. • Demonstrated experience in CI/CD and Continuous Testing. • Hands-on proficiency with TDD, ATDD, BDD, and Risk-Based Testing. • Comprehensive AI/ML and Generative AI Application Testing experience, including: - Prompt Evaluation & Testing - AI Response Accuracy & Relevance - Hallucination Detection - AI Safety & Reliability Testing - Response Consistency & Regression Testing - Evaluation Datasets & Quality Thresholds - LLM / Conversational AI Testing - AI APIs, Model Interactions & Integrations • Strong hands-on Test Automation + AI/GenAI testing experience is highly preferred. Nice to Have Qualifications: • LLM Testing / AI Evaluation Frameworks • Prompt Engineering • RAG / Embeddings / Model Observability • Git / Bitbucket / Jenkins • Artifactory / SonarQube • Jira / Confluence • AWS / Kubernetes • Maven / Gradle • Performance / Security / Accessibility Testing • Cloud-native & Distributed Microservices Testing Working Hours, Shifts & Location Details: • Work Model: Hybrid. • Job Location: Brampton, Ontario, Canada. • Employment Type: Contract. Application Instructions: • Candidates currently located in Canada are requested to submit their updated resume to the Sourcing Specialist.