Software Quality Engineer (AI/ML Applications) job opportunity at Vizient, Inc..

Home Jobs In United States Of America Tag: Job Software Quality Engineer (AI/ML Applications) position at Vizient, Inc.


DatePosted 4 Days Ago bot
Vizient, Inc. Software Quality Engineer (AI/ML Applications)
Experience: 2-years
Pattern: full-time
Country:
apply Apply Now
Salary:
Status:

Job

Copy Link Report
degreeOND
loacation Irving, TX 75062 Vizient Corporate HQ, United States Of America
loacation Irving, TX 750..........United States Of America

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves . We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future. Summary:   In this role, you will validate AI and ML-powered healthcare solutions across the full development lifecycle to ensure data quality, model performance, reliability, and safe deployment in production environments. You will apply Agile and Software Development Lifecycle (SDLC) Quality Assurance (QA) methodologies to validate functional software components and the analytical outputs they generate. You will design and execute data-driven and automated test strategies, including model evaluation, prompt regression testing, dataset profiling, and end-to-end pipeline validation. You will partner with data science, engineering, product, and security teams to define measurable quality gates and deliver compliant, explainable, and dependable AI experiences that drive client value. Responsibilities: Develop and execute test strategies for ML and generative AI-powered applications. Create and execute test cases, plans, and scripts based on story-defined acceptance criteria, and review requirements, functional, technical, and use case documents to determine testability. Design and maintain automated test suites using QA automation frameworks to validate UI, API, backend services, and AI-enabled platforms. Integrate automated testing into CI/CD pipelines to enable continuous quality validation and rapid feedback loops. Design and maintain evaluation frameworks for Large Language Models (LLM), including automated scoring and LLM -as-a-judge methodologies. Develop prompt regression test suites to detect performance degradation across model and prompt versions. Evaluate generative AI systems for hallucination risk, factual consistency, grounding accuracy, and safety compliance. Conduct model evaluation, regression testing, and drift monitoring in development and production environments. Build dashboards and monitoring tools to detect degraded evaluation scores, drift, or safety risks and support proactive triage. Design and implement proactive AI-driven alerting and recommendation systems embedded within dashboards and user workflows Automate dashboard metric generation and refresh pipelines using Python and data workflows. Partner with cross-functional teams to define AI quality standards, acceptance criteria, and release gates. Investigate defects, analyze root causes, and recommend corrective actions to improve reliability and performance. Qualifications: Relevant degree preferred. 2 or more years of relevant experience required. Experience in Quality Assurance with a focus on data testing, analytics validation, and BI/ETL systems required. Experience validating ML or generative AI-based applications, including model evaluation and data quality assessment. Experience with QA automation frameworks (Selenium or similar) and Python for scripting, data validation, and automation. Experience evaluating Large Language Model systems, including prompt regression testing and automated or human-in-the-loop judging methodologies. Familiarity with RAG evaluation concepts, including retrieval quality, context relevance, faithfulness, and safety testing. Experience designing AI evaluation metrics and monitoring model performance in production environments. Understanding of Agile methodologies and CI/CD practices. Strong analytical, documentation, and communication skills; self-starter who thrives in fast-paced, iterative environments and drives quality initiatives amid ambiguity and shifting priorities. Estimated Hiring Range: At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $77,400.00 to $135,400.00. This position is also incentive eligible. Vizient has a comprehensive benefits plan! Please view our benefits here: http://www.vizientinc.com/about-us/careers Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Other Ai Matches

Sr Category Mgr - IT Category Mgmt & Strategic Growth Applicants are expected to have a solid experience in handling Job related tasks
Sr Business Analyst Applicants are expected to have a solid experience in handling Job related tasks
VP, Pharmacy Spend Management Delivery Applicants are expected to have a solid experience in handling Pharmacy Spend Management Delivery related tasks
Senior Procurement Specialist Applicants are expected to have a solid experience in handling Job related tasks
Sr. Analyst Comparative Analysis Applicants are expected to have a solid experience in handling Job related tasks
Product Marketing Intern Applicants are expected to have a solid experience in handling Job related tasks
Lead Analyst Applicants are expected to have a solid experience in handling Job related tasks
Senior Analyst Applicants are expected to have a solid experience in handling Job related tasks
Senior Spend Manager Applicants are expected to have a solid experience in handling Job related tasks
Lead Product Advisor Applicants are expected to have a solid experience in handling Job related tasks
VP of R&D Technology Applicants are expected to have a solid experience in handling Job related tasks
Director, Product Delivery (Claims) Applicants are expected to have a solid experience in handling Product Delivery (Claims) related tasks
Senior Analyst - Excelerate Applicants are expected to have a solid experience in handling Job related tasks
Product/Solutions Marketing Associate Applicants are expected to have a solid experience in handling Job related tasks
Senior Sales Executive Applicants are expected to have a solid experience in handling Job related tasks
VP Category Management Orthopedics Applicants are expected to have a solid experience in handling Job related tasks
Associate Principal, 340B Policy Analysis Applicants are expected to have a solid experience in handling 340B Policy Analysis related tasks
Senior Category Manager - Contract Services, Food Applicants are expected to have a solid experience in handling Food related tasks
Summer Intern – Indirect Spend Applicants are expected to have a solid experience in handling Job related tasks
Senior Director, Venture Delivery Applicants are expected to have a solid experience in handling Venture Delivery related tasks
Senior Product Owner Applicants are expected to have a solid experience in handling Job related tasks
Spend Executive - (PA and NY region) Applicants are expected to have a solid experience in handling Job related tasks
Director, Engineering Applicants are expected to have a solid experience in handling Engineering related tasks