携程AI QA(MJ036437)

工作描述

Core Responsibilities
·      AI Quality Assessment Framework & Standards
o  Establish and maintain quality evaluation criteria for Large Language Models (LLMs), covering accuracy, safety, compliance, and instruction-following capabilities.
o  Design evaluation workflows combining automation and human-in-the-loop assessment to quantify model performance regularly.
·      End-to-End Quality Control & Risk Management
o  Own regression testing and acceptance testing for model iterations, enforcing quality gates to prevent performance degradation before launch.
o  Monitor online performance to mine for badcases, identifying model hallucinations, logic errors, or experience defects, and issue timely risk al…