Abridge
Software Engineer, GenAI
About this role
Abridge is seeking GenAI Software Engineers to build production-grade LLM-powered clinical systems that transform patient conversations into reliable medical documentation. You'll design agentic workflows, develop rigorous evaluation frameworks, and own the end-to-end deployment of generative AI systems in healthcare environments.
What you'll do
- Design and build agentic systems leveraging retrieval, tool use, and structured outputs for clinical applications
- Develop rigorous evaluation frameworks—both automated and human-in-the-loop—to assess accuracy, robustness, and multilingual capabilities
- Own architectural decisions for LLM workflows including data flow, caching, and output structuring
- Collaborate with ML and infrastructure engineers to scale and optimize workflows for low-latency, high-uptime environments
- Build monitoring, observability systems, and post-processing guardrails for production deployments
- Conduct A/B testing and generate actionable insights to inform model improvement and deployment decisions
What they're looking for
- 3+ years building production systems with 1–2+ years on LLM/agentic products
- LLM APIs, prompting strategies, and orchestration frameworks (LangChain, LlamaIndex, custom pipelines)
- Retrieval systems (vector databases, semantic/lexical search, efficient kNN)
- Model evaluation, dataset building, and human-in-the-loop assessment
- Strong Python with async programming, testing, and deployment experience
- Function calling, tool-use, and agentic workflow patterns
- A/B testing and experiment design
- Working knowledge of healthcare/clinical domain preferred
Benefits
- Work on high-impact AI systems transforming healthcare
- Collaborate with practicing MDs, AI scientists, and clinicians
- Access to cutting-edge LLM capabilities and frontier models
- Offices in San Francisco, New York, and Pittsburgh
- Work on responsible AI deployment at scale
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Abridge
Abridge builds an AI platform that transforms healthcare conversations into clinical documentation using advanced natural language processing and generative AI. The company is hiring ML infrastructure engineers, implementation engineers, and machine learning scientists to develop model serving systems, manage customer deployments, and advance medical NLP research.
- Website
- abridge.com