Senior AI Test Engineer (API & AI Validation) at OmegaHires in * Houston, (Multiple states)
- Company: OmegaHires
- Location: * Houston, (Multiple states)
- Posted: Sep 17, 2026
- Type: Contracted
- Experience: 12+ years
Overview
Summary: We are seeking an experienced Senior AI Test Engineer with 10–12 years of experience in Quality Engineering, including hands-on expertise in API testing and AI application validation. The ideal candidate should have strong experience testing AI/LLM-powered applications, validating REST APIs…
Job description
- Summary: We are seeking an experienced Senior AI Test Engineer with 10–12 years of experience in Quality Engineering, including hands-on expertise in API testing and AI application validation. The ideal candidate should have strong experience testing AI/LLM-powered applications, validating REST APIs, designing automation frameworks, and ensuring the quality, reliability, security, and performance of modern AI-enabled systems. This role requires a blend of traditional testing expertise and knowledge of AI-specific validation techniques, including prompt testing, model evaluation, hallucination detection, and retrieval validation.
Responsibilities
- Key Responsibilities:- Define and implement end-to-end test strategies for AI-enabled applications.- Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.- Perform functional, integration, regression, system, and UAT testing.- Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.- Develop and maintain API automation frameworks.- Validate AI model responses for:- Accuracy- Relevance- Consistency- Hallucinations- Bias- Toxicity- Test prompt engineering scenarios and optimize prompt quality.- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.- Verify AI guardrails, content moderation, and responsible AI compliance.- Perform database validation using SQL.- Conduct performance and load testing for APIs and AI services.- Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.
Requirements
- 10–12 years of experience in Quality Engineering
- Hands-on expertise in API testing and AI application validation
- Strong experience testing AI/LLM-powered applications
- Validating REST APIs
- Designing automation frameworks
- Ensuring the quality, reliability, security, and performance of modern AI-enabled systems
Skills
Required
- API testing
- AI application validation
- Testing AI/LLM-powered applications
- Validating REST APIs
- Designing automation frameworks
- Postman
- Swagger
- REST Assured
- SQL
- Performance and load testing
- Prompt testing
- Model evaluation