Note: The job is a remote job and is open to candidates in USA. Canvas Medical is accelerating everyday medicine with an EMR platform built for healthcare automation. They are seeking an Applied AI Operations Lead to drive the deployment, adoption, and governance of AI agents in healthcare organizations, ensuring they deliver measurable value and improve clinical workflows.
Responsibilities
- Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation
- Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI
- Configure and optimize agent performance using prompt engineering, context management, and tool selection based on specific customer requirements
- Create and maintain customer-specific evaluation frameworks that demonstrate agent effectiveness and build stakeholder confidence
- Maintain AI governance frameworks that ensure safe, reliable agent operations in production healthcare environments
- Design and implement monitoring systems for agent performance, including accuracy tracking, drift detection, and quality assurance protocols
- Partner with clinical and compliance teams to ensure deployed agents meet regulatory requirements and operational standards
- Develop and deliver training programs that enable care teams to effectively collaborate with AI agents
- Work hands-on with foundation model APIs (OpenAI, Claude, Gemini) and the Canvas SDK to troubleshoot and optimize agent behavior
- Collaborate with Applied AI engineering to translate field insights into product improvements and new capabilities
- Build and maintain a library of best practices, implementation templates, and governance playbooks that accelerate customer success
- Stay current with advances in LLM technology and healthcare AI applications to guide strategic customer conversations
- Serve as the trusted AI advisor for Canvas customers, helping them navigate the transformation to AI-powered healthcare operations
- Drive executive conversations about AI strategy, demonstrating how Canvas's platform capabilities enable competitive advantage
- Create compelling narratives around AI impact using customer success stories, performance metrics, and ROI analyses
- Partner with sales teams on strategic opportunities, providing technical expertise and vision for AI transformation
Skills
- 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering)
- Demonstrated experience deploying and managing LLM-based applications in production environments
- Track record of driving successful enterprise technology implementations with measurable business outcomes
- Strong project management skills with ability to juggle multiple customer engagements simultaneously
- Hands-on experience with products offered from foundation model providers (OpenAI, Anthropic, Google) and AI tools for low-code automation, with understanding of their capabilities and limitations
- Understanding of AI safety, alignment, and governance principles
- Experience with evaluation frameworks, A/B testing, and performance monitoring for AI systems
- Learned experience with the edges and limitations of AI products, and understanding of the iterative process required to get high quality results
- Healthcare technology experience required, with ability to give workflow advice and construct automations that meet the needs of healthcare users
- Understanding of clinical workflows, EMR systems, and healthcare operations a plus
- Familiarity with HIPAA, clinical documentation standards, and healthcare compliance considerations
- Ability to quickly develop domain expertise and speak credibly with clinical stakeholders
- Comfort with ambiguity and ability to define structure in undefined spaces
- Exceptional written and verbal communication skills with ability to create compelling technical content
- Strong analytical and problem-solving abilities with data-driven approach to decision making
- Experience creating and delivering technical training to diverse audiences
- You're energized by ambiguity and thrive in fast-paced environments where you can experiment, iterate, and scale what works
- You have 5+ years of experience implementing workflow tools and automation solutions in enterprise settings, with 2+ years of hands-on experience with LLM-based systems
- You're deeply familiar with foundation model capabilities and have practical experience with context engineering and adversarial testing
- You excel at translating technical complexity into business value, comfortable presenting to both technical teams and C-suite executives
- You bring a consultative approach to customer engagement, able to diagnose problems, design solutions, and drive change management
- You have experience in healthcare technology or a strong willingness to rapidly develop domain expertise in clinical and operational workflows
- You combine technical depth with exceptional communication skills, able to create documentation, deliver training, and influence stakeholders
- San Francisco preferred
Company Overview