AI Agent Evaluation Engineer

Location

Bangalore, Karnataka, India

Salary

Not specified

Company

Akash pawar

Job description

Role & Company / Project Overview: We are hiring an AI Agent Evaluation Engineer to evaluate and benchmark cutting-edge AI Agent workflows, Large Language Models, and GenAI systems. Key Responsibilities & Daily Duties: • Conduct comprehensive evaluation and benchmarking of AI Agent workflows and frameworks. • Assess Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) pipelines for accuracy, quality, and performance. • Utilize Python programming, SQL, and database concepts to build, run, and maintain evaluation scripts and data pipelines. Required Qualifications, Skills & Experience: • Experience: 5+ Years of relevant professional experience. • Strong hands-on proficiency in Python programming. • Sound knowledge of SQL and database concepts. • Proven experience in Generative AI (GenAI) and Large Language Models (LLMs). • Demonstrated experience in AI Agent / LLM Evaluation. • Experience with Retrieval-Augmented Generation (RAG). • In-depth understanding of AI Agent workflows and evaluation frameworks. Working Hours, Shifts & Location Details: • Location: Bangalore, Karnataka, India. • Notice Period: Immediate Joiners or candidates with a 15-day notice period. Compensation & Benefits: • Not specified. Application Instructions: • Interested candidates matching the profile are invited to apply by submitting an updated resume.