Back to Careers
Test Automation Engineer (AI Systems)
Quality Assurance
Remote
Contract
Develop innovative testing frameworks to evaluate the reliability, safety, and accuracy of our autonomous AI agents and web platforms.
Key Responsibilities
- Design and implement end-to-end automated test suites for web applications using Playwright or Cypress.
- Create specialized evaluation frameworks to test LLM outputs, agent reasoning paths, and tool-calling accuracy.
- Integrate automated tests into CI/CD pipelines to ensure continuous quality.
Requirements
- Proven experience in software test automation for web applications.
- Strong scripting skills in Python or TypeScript.
- Experience with CI/CD tools (GitHub Actions, Jenkins).
Preferred Qualifications
- Familiarity with LLM evaluation metrics and methodologies (e.g., RAGAS, prompt testing).
- Experience load testing complex agentic workflows.