Senior AI Test Engineer

Job Summary

A company is looking for a Senior Agentic AI Test and Evaluation Engineer.

Key Responsibilities

• Develop AI Models Test and Evaluation CONOPS and scalable Test and Model Evaluation plans
• Collaborate with multidisciplinary teams to create test procedures and collect performance metrics
• Integrate testing tools with CI/CD pipelines and recommend improvements based on analysis of existing processes

Required Qualifications

• Bachelor's degree in Computer Science, Data Science, or related field with over 8 years of relevant experience, or a Master's with 6 years of experience
• Strong Python programming fundamentals and experience with system level test processes and automation
• Experience in creating user acceptance test scenarios and SecDevOps tooling
• Familiarity with AI performance assessment and model assurance evaluation
• Understanding of machine learning algorithms and tools