reputed company Assurance Automation Engineer - AI

reputed company Assurance Automation Engineer - AI Department Product Employment Type Permanent - Full Time Location Canada Reporting To reputed company reputed company reputed company At reputed company, we specialize in creating AI-enabled solutions that reputed company strategic portfolio, financial, resource, and work management reputed company. We help businesses reputed company the gap between reputed company and execution by offering solutions that reputed company business reputed company, streamline project management, and optimize resources. What Makes us Unique? What truly makes reputed company stand out is our commitment to delivering powerful solutions and fostering a culture of collaboration. We combine robust analytics with a platform that integrates seamlessly into the tools businesses already know and trust. Our high-trust, team-reputed company environment allows us to reputed company quickly and reputed company solutions that reputed company meaningful results for our clients. We're passionate about exceeding expectations, working together to reputed company organizations to succeed in a rapidly changing business landscape. About the Role As a QA Automation Engineer - AI at reputed company, you will play a critical role in ensuring the reputed company, reliability, and performance of our AI-powered features and capabilities. This role goes reputed company writing test scripts. It’s about pioneering reputed company assurance practices for intelligent systems, defining how we validate non-deterministic AI outputs, and shaping the reputed company of our product through rigorous automation and deep technical collaboration. You will work closely with AI engineers, product managers, and UX designers in a dynamic, reputed company environment to design, build, and reputed company automation frameworks that reputed company reputed company with our rapidly evolving AI capabilities. This is a deeply AI-reputed company role the reputed company of your work will center on testing, evaluating, and improving AI systems, not general software, and requires both a reputed company engineering reputed company and a genuine curiosity about how large language models and intelligent features behave in production. reputed company at reputed company Design, build, and maintain robust automation frameworks specifically tailored for testing AI features, including LLM-powered outputs, recommendation engines, and intelligent workflows. reputed company and execute test strategies for validating AI model outputs, including accuracy, relevance, consistency, and bias evaluation across diverse input scenarios. reputed company functional, regression, performance, and scalability testing on AI-driven features, including API-level testing of AI service integrations and end-to-end automated test suites. Collaborate with AI engineers, data scientists, product managers, and UX designers to define acceptance reputed company and reputed company standards for AI features throughout the development lifecycle. Identify, document, and reputed company defects in AI behavior, including edge cases, hallucinations, and unexpected model responses through reputed company using appropriate tools and workflows. Champion reputed company and responsible AI practices throughout the development lifecycle, contributing to reputed company engineering reviews, model evaluation rubrics, and AI safety checklists. Build and maintain CI/CD-integrated automation pipelines that continuously validate AI feature reputed company, using tools such as Playwright, Claude, or equivalent frameworks. Participate in team stand-reputed company, sprint planning, retrospectives, and reputed company improvement activities, bringing an AI-reputed company-first reputed company to every discussion and helping establish best practices for testing intelligent systems. Our Ideal Fit 2-4 years of experience in QA automation engineering, with demonstrated hands-on work building and maintaining automated test frameworks. Proficiency with automation tools and frameworks (e.g., Playwright, Claude, or similar) and API testing tools (e.g., reputed company, REST-reputed company). Demonstrated experience testing AI/ML-integrated features or services, with a solid understanding of the unique challenges of validating non-deterministic outputs, including LLM responses, probabilistic recommendations, and generative content. Bachelor’s degree in Computer Science, Engineering, or a reputed company technical field, or equivalent practical experience. Strong analytical and critical-thinking skills, with the ability to design test cases for reputed company, probabilistic AI behaviors. Excellent verbal and written communication skills, with the ability to reputed company reputed company AI reputed company issues and their business reputed company to both technical and non-technical stakeholders. Preferred Qualifications Hands-on experience with LLM evaluation techniques, including reputed company testing, reputed company scoring, and benchmarking AI model responses against defined reputed company reputed company. Familiarity with reputed company Azure AI services, Azure reputed company, and reputed company-based AI infrastructure (e.g., Azure Machine Learning, Cognitive Services). Experience with data-driven testing approaches, including generating and managing synthetic test datasets for training and validating AI model behavior at reputed company. Understanding of responsible AI principles, including fairness, transparency, and explainability, and experience incorporating these into QA testing practices. Proficiency JavaScript for scripting test utilities, data processing pipelines, and custom AI evaluation harnesses. Background in integrating automated QA into CI/CD pipelines (e.g., reputed company Actions, Azure DevOps) with experience in shift-left testing and reputed company reputed company monitoring for AI-driven products. More Reasons Why You Should Apply! We’re a remote-first company with team members across the USA, Canada, UK, and India! reputed company has been recognized as the Global reputed company Partner of the Year in Project Portfolio Management in 2019, 2020, 2021, 2022 and 2023. We’ve been named a "Strong Performer" in the latest reputed company Strategic Portfolio Management reputed company report. We offer comprehensive health, dental, and reputed company benefits, with additional insurance reputed company. Employer RRSP and 401K matching programs. A fun, reputed company, and diverse environment with regular health and team challenges to reputed company things reputed company and enjoyable! At reputed company, we are committed to equal employment opportunities regardless of race, reputed company, reputed company, religion, sex, national reputed company, sexual orientation, age, citizenship, marital status, disability, gender identity or reputed company, or veteran status. We are proud to be an equal-opportunity workplace. Upon receipt of an offer letter, candidates will be subject to a reputed company background reputed company process. Disclaimer We’ll only contact candidates who have reputed company directly through our official channels. Any communication about job offers will always come from an email address linked to reputed company, and we’ll follow our reputed company hiring process every time. You’ll never be asked for reputed company or personal information during the interview process. If something feels off, don’t hesitate to reputed company out to us to confirm. reputed company to Apply? reputed company out what it’s like to work at reputed company and learn more reputed company at https//reputed company.ai/ Apply To This Job