Overview

Job DescriptionJob DescriptionWho are we? At Newcode.ai, we're transforming how law firms and legal professionals harness AI for real-world impact. As part of our collaborative, high-growth team, you'll have the rare opportunity to work side-by-side with visionary founders at the bleeding edge of AI and legal innovation - shaping not just our product, but the future of legal work itself.Note: We believe in being transparent about what it's like to work at Newcode. As a fast-growing startup, we're building and evolving every day. That means not every process, playbook, or framework is already in place, and priorities can shift quickly.The people who thrive here are comfortable with ambiguity, take ownership, and don't wait for perfect direction. They are resourceful, proactive, and able to "figure it out"-solving problems, creating structure where needed, and helping build the company as they go. If you are good with this then, great! Keep reading to learn more.Role OverviewAs Head of Testing, you will own the vision, strategy, and execution of product testing across Newcode. You will develop the frameworks, processes, and standards needed to evaluate our AI-powered products, identify opportunities for improvement, and ensure we deliver reliable, high-quality solutions to our customers.This role requires someone who understands both software testing and AI product evaluation - someone who can think critically about how AI systems should be tested, measured, and improved.You will work closely with Engineering and Legal Engineering to establish a world-class testing function.RequirementsResponsibilities Develop and execute Newcode's overall testing strategy across AI-powered productsCreate testing frameworks and methodologies for evaluating product functionality, usability, accuracy, reliability, and performanceDesign and implement processes for testing AI outputs, including quality benchmarks, evaluation criteria, and success metricsBuild structured test plans, test cases, and documentation to support product releasesIdentify gaps, risks, and improvement opportunities through rigorous product testingPartner with Engineering team to improve product quality and development processesEstablish repeatable workflows for regression testing, user acceptance testing, and release validationAnalyze testing results and provide actionable insights to improve product performanceDevelop best practices for AI evaluation, including assessing accuracy, consistency, hallucination risks, and edge casesHelp define quality standards as Newcode scales its products and customer baseBuild and evolve the testing function, including future team growth and processesQualifications 5+ years of experience in software testing, quality assurance, product quality, or a related technical roleProven experience testing AI-powered products, machine learning systems, or LLM-based applicationsStrong understanding of AI evaluation methodologies and how to measure AI system performanceExperience designing testing frameworks and quality processes from the ground upAbility to translate complex technical issues into clear insights and recommendationsStrong analytical and problem-solving skills with high attention to detailExperience working cross-functionally with Engineering, Product, and Customer-facing teamsComfortable operating in a fast-paced startup environment with changing prioritiesFamiliarity with automated testing frameworks and toolingExcellent written and verbal communication skillsExperience building quality teams or functions within a growing organizationNice to Have Experience working with legal technology, enterprise software, or regulated industriesExperience evaluating LLM applications, AI agents, or generative AI workflowsLegal domain knowledge or experience working with legal professionalsVisa Sponsorship:At this time, Newcode is unable to provide visa sponsorship. Candidates must be authorized to work in the applicable country without employer sponsor