AI Model Testing Engineer

About the Company

CoVetAI Canada Inc is an innovative, AI-driven company focused on transforming veterinary care through intelligent automation.

Its flagship AI copilot helps veterinarians streamline clinical documentation, enhance accuracy, and improve efficiency during consultations. The company operates as a fast-paced, collaborative, and mission-driven team dedicated to advancing veterinary medicine through cutting-edge artificial intelligence.

Job Overview

CoVet is seeking a creative and detail-oriented AI Model Testing Engineer to design and manage robust testing systems for evaluating AI models.

The role focuses on testing and optimizing Large Language Models (LLMs), transcription systems, and real-time AI inference models from leading providers such as OpenAI, Google, and Anthropic.

You will collaborate closely with the veterinary medical team to create structured test cases, ensuring AI outputs meet high standards of accuracy, quality, and reliability.

Key Responsibilities

• Design and maintain testing pipelines for AI models, especially transcription and LLMs

• Translate veterinary clinical scenarios into structured AI test cases

• Develop frameworks for comparative analysis of AI outputs

• Optimize AI performance balancing accuracy, speed, cost, and quality

• Manage scalable and reliable AI testing infrastructure

• Continuously improve AI systems based on testing feedback and insights

• Collaborate with cross-functional teams including medical professionals

Required Skills & Experience

• Experience building and deploying AI-based software or projects

• Hands-on experience with LLMs and/or transcription models

• Strong knowledge of AI model integration

• Proficiency in Node.js and TypeScript

• Familiarity with APIs such as OpenAI, Google, or Anthropic

• Strong problem-solving and analytical skills

• Ability to work in a fast-paced, resource-constrained environment

• Excellent communication and teamwork skills

Why Join Us?

• Opportunity to impact veterinary care through AI innovation

• Collaborative and agile work environment

• Flexibility with remote work

• Competitive salary and benefits

• Opportunity to experiment with cutting-edge AI technologies

Important Insight

• This role is fully remote

• Company operates in AI + healthcare (veterinary) domain

• Strong focus on LLM testing, AI evaluation, and system optimization