AI Engineer – Clinical AI Platform

Description Who We Are Healthcare quality is complex. Medisolv helps make it manageable and actionable. We partner with hospitals, health systems, ACOs, and payers to bring clarity to quality data, connecting clinical and claims information into a single, reliable view. More than 1,800 organizations rely on Medisolv to measure, report, and improve performance across 500+ measures tied to CMS, The Joint Commission, and other programs for 130M+ patient records. With support from Bessemer Venture Partners Forge, we’re continuing to grow our platform and expand our impact by investing in advanced analytics, AI, and new capabilities that help healthcare organizations stay ahead of change and improve outcomes with confidence. The Role We are looking for an AI Engineer to help build and evolve the core application platform behind our clinical AI product. This is not a typical CRUD app role, and it is not purely a data engineering role either. You will work on the application logic, orchestration, operational tooling, and system integrations that allow our platform to process clinical documents, run graph-based AI workflows, and produce reliable outputs across multiple health systems. You will work on software that has to reconcile messy real-world inputs, support multiple customers with different requirements, and make AI behavior operationally trustworthy. The work spans architecture, product behavior, cloud systems, LLM workflows, and internal tooling. It is highly practical, technically challenging, and directly connected to real clinical use cases. This role is ideal for an engineer who likes owning real product behavior end to end: application architecture, workflow orchestration, reliability, developer ergonomics, cloud integrations, and the practical realities of shipping AI-powered software in healthcare. What You'll Be Doing • Core application workflows: Build and maintain the runtime workflows that retrieve clinical data, execute graph-based reasoning pipelines, and write outputs back to the platform in a reliable, observable way. • LLM-powered product logic: Improve how the application uses LLMs for document understanding, evidence generation, and structured extraction, with attention to correctness, latency, cost, and traceability. • Configuration-driven multi-tenant architecture: Extend the platform so it can support new facilities, clinical registries, and customer-specific behavior through shared abstractions and designed configuration layers rather than ad hoc branching. • Operational tooling and internal UX: Improve the tooling that supports configuration updates, node evaluation, issue-driven workflows, and other internal product operations so that engineers and clinical teammates can work faster and safer. • Testing and reliability: Maintain and improve the validation, testing, and monitoring layers so changes to prompts, graph logic, or facility-specific configuration do not silently degrade output quality. • Developer experience and maintainability: Help shape the codebase, patterns, and abstractions so the system stays understandable as we add new registries, workflows, and product surfaces. What You’ll Accomplish - Your Performance Objectives In your first 30 days, you will: • You will onboard and get to know the people, products and departments that make Medisolv run. • Complete onboarding across engineering, product, clinical, and data teams; build working relationships with key partners and understand how the Clinical AI platform supports customer outcomes. • Get familiar with the platform architecture, core services, data flows, deployment model, and operational tooling used to run AI workflows in production. • Set up the local development environment, access required systems, and push meaningful code changes to become productive in the codebase. • Learn the clinical document processing and graph-based workflow lifecycle, including how inputs are retrieved, transformed, evaluated, and written back to the platform. • Review current reliability, testing, observability, and prompt or workflow validation practices to understand how quality is maintained across customer-specific configurations. In Your First 6 Months, You Will • Own an important area of the Clinical AI platform end to end, from design and implementation through operational readiness and ongoing improvement. • Design and ship enhancements that improve multi-tenant scalability, maintainability, and configurability across customers, facilities, and clinical registries. • Improve internal tooling and operator workflows so engineering and clinical teammates can evaluate nodes, troubleshoot issues, and manage configuration changes more efficiently. • Lead root-cause analysis and reliability improvements for production issues, using observability data and test results to harden the system. • Help raise engineering quality by contributing reusable patterns, cleaner abstractions, and better developer ergonomics across the codebase. In Your First 12 Months, You Will • Be a trusted technical owner for a significant portion of the Clinical AI platform, consistently delivering reliable, maintainable, and high-impact product behavior. • Drive architectural improvements that make the platform more scalable, observable, and resilient as new AI workflows, customers, and registries are added. • Demonstrate measurable impact on product quality and operational trustworthiness through stronger validation, reduced incidents, improved workflow performance, or better model-driven outputs. • Influence cross-functional roadmap decisions by bringing sound engineering judgment to product, clinical, and platform tradeoffs. • Help shape how the team builds AI-powered software in healthcare by contributing best practices for testing, evaluation, reliability, and responsible production operations. Who We’re Looking For - The Competencies That Matter You are an owner. You take initiative, move work forward, and are comfortable owning problems from discovery through implementation. You have a strong bias for action and know how to make progress in ambiguous situations without losing sight of quality, reliability, or the needs of the end user. Systems thinker and builder. You can break down complex technical problems, design practical solutions, and build with maintainability in mind. You understand how application logic, workflows, infrastructure, and internal tooling work together, and you make thoughtful design choices that support scale and long-term flexibility. Collaborative and pragmatic. You work effectively across engineering, product, and clinical teams, balancing technical rigor with practical execution. You communicate clearly, incorporate feedback, and build strong working relationships that help move complex work forward. Analytical problem solver. You know how to diagnose issues methodically, evaluate tradeoffs, and make sound decisions in complex systems. Whether the challenge is workflow behavior, model output quality, observability, or production reliability, you can identify root causes and turn insights into practical improvements. Continuous improvement mindset. You look for better ways to build, test, validate, and operate software. You care about reducing friction for both users and internal teams, and you use automation, tooling, and process improvements to make the platform more reliable, scalable, and easier to maintain over time. How To Be a Medisolver – Our Values • Customer Success Obsession • All-Star Team Collaboration • Continuous Improvement through Curiosity & Data-Driven Learning • Courage with Kindness • Execution Focus. We Do Business, Not Just Talk Business Medisolv is committed to creating a diverse and inclusive workplace. We believe that diversity drives innovation, and we are dedicated to fostering an environment where all employees feel valued and respected. All candidates must successfully pass a pre-employment background check and be legally authorized to work in the United States. Sponsorship is not available.