AI Evaluation Analyst job opportunity at Ema Unlimited.



bot
Ema Unlimited AI Evaluation Analyst
Experience: 3-years
Pattern: full-time
apply Apply Now
Salary:
Status:

Job

Copy Link Report
degreeGeneral
loacation Bengaluru, Karnataka, India - Bengaluru, India
loacation Bengaluru, Kar..........India

About Ema: Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.Responsibilities:Create Enterprise AI Model Evaluation Test Sets: Develop and maintain comprehensive test sets tailored for various enterprise use cases.Evaluate AI Models: Assess different versions, personas, and prompts of Ema on multiple quality parameters. Ensure new features and updates meet established standards before launch.Generate AI Evaluation Reports: Compile detailed evaluation reports that provide insights for improving persona setups and Ema's AI models.Test UX Flows: Evaluate the efficacy and usability of auxiliary user experience flows to ensure seamless end-to-end GenAI usage for Ema’s users.Automate Testing Flows: Develop and implement scripts and browser automation tools to streamline testing processes. Enhance testing velocity and early issue detection to improve overall product quality.Requirements:Educational Background: Bachelor’s degree in Engineering. Bachelor’s degree in Computer Science, Data Science, or a related field is preferred.Analytical Skills: Exceptional attention to detail with the ability to identify rare and complex edge cases.Communication Skills: Strong verbal and written English communication abilities..Professional Experience: 1-3 years of prior professional experience. Background in analytics, prompt engineering, or QA testing is a plus.Benefits:Stay at the cutting edge of GenAI research, guided and coached by top researchers in the field.Learn best practices for solving user problems with GenAI products.Collaborate across cross-functional teams to effectively achieve customer impact.Ema Unlimited is an equal opportunity employer and is committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity, or genetics.

Other Ai Matches

Agent Product Manager Applicants are expected to have a solid experience in handling Job related tasks
Engineering Lead, AI Application Engineering Applicants are expected to have a solid experience in handling AI Application Engineering related tasks
remote-jobserver Remote
Enterprise Account Executive Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Partner Manager Applicants are expected to have a solid experience in handling Job related tasks
Senior Motion Designer Applicants are expected to have a solid experience in handling Job related tasks
AI Evaluation Analyst Applicants are expected to have a solid experience in handling Job related tasks
AI Application Engineer Applicants are expected to have a solid experience in handling Job related tasks
Product Marketing Manager Applicants are expected to have a solid experience in handling Job related tasks
Technical writer - Agentic AI Applicants are expected to have a solid experience in handling Job related tasks
Software Engineer, Backend Applicants are expected to have a solid experience in handling Backend related tasks
Recruiter - India Applicants are expected to have a solid experience in handling Job related tasks
AI Integrations Specialist Applicants are expected to have a solid experience in handling Job related tasks
Software Engineer, Front-End Applicants are expected to have a solid experience in handling Front-End related tasks
Enterprise Business Development Team Lead Applicants are expected to have a solid experience in handling Job related tasks
Web Developer Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
AI/Data Resident Applicants are expected to have a solid experience in handling Job related tasks
Senior AI Applications Engineer Applicants are expected to have a solid experience in handling Job related tasks
Software Engineering Lead, Backend Applicants are expected to have a solid experience in handling Backend related tasks
Product Manager Applicants are expected to have a solid experience in handling Job related tasks
Senior Support Engineer Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Software Enginner - Product Security Applicants are expected to have a solid experience in handling Job related tasks
Senior Technical Trainer / Developer Advocate Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Senior Customer Success Manager Applicants are expected to have a solid experience in handling Job related tasks