Notion
Software Engineer, Model Capabilities
About this role
Notion is hiring a Software Engineer for the Model Capabilities team to own the model layer of their AI workspace. You'll integrate frontier LLMs into production, ensure reliable inference at scale, build observability and new capabilities, and collaborate across AI teams to unblock adoption.
What you'll do
- Integrate new frontier models into production and make them available to users and internal teams
- Ensure inference reliability through error categorization, self-healing retries, and cross-provider failover
- Own observability for the model layer, minimizing detection and resolution time
- Build new model-level capabilities and support product teams in adopting them
- Act as connective tissue across AI teams, identifying gaps and unblocking work
- Evaluate model and prompt changes with measurable data before shipping
What they're looking for
- Production LLM systems experience (not just prototyping)
- Token economics, streaming, tool calling, and context limit understanding
- Proficiency with LLM APIs and their failure modes
- AI fluency as a practitioner with hands-on experience
- Cost and performance optimization mindset
- Evaluation framework design and experimentation
- Ability to keep up with rapidly evolving model landscape
- Production infrastructure and observability
Benefits
- Competitive cash compensation and equity
- Opportunity to work on frontier AI models at scale
- Collaborative in-person environment (3 days/week in office)
- Access to cutting-edge AI tools and technology
- Cross-functional collaboration with product and AI teams
- Equal opportunity employer with accommodation support
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Notion
Notion builds an AI-powered collaborative workspace platform used by millions for productivity, featuring capabilities like search, automations, and AI-assisted features. The company is hiring software engineers for core product and AI development, technical support engineers for enterprise customers, data platform engineers for foundational systems, and security engineers for infrastructure and AI safety initiatives.
- Website
- notion.so
Likely interview questions
- Walk us through a production LLM system you've built—what were the biggest operational challenges and how did you solve them?
- How do you stay current with the rapidly evolving model landscape, and give us an example of a recent model or capability you evaluated for adoption?