Skip to main content

Litellm

AI Engineer

  • Confirmed live in the last 24 hours
  • $200k–$250k
  • Mid level
  • Full-time
  • On-site · San Francisco
  • 1+ yrs exp
  • Added 2 months ago

About this role

LiteLLM is seeking an AI Engineer to contribute to their AI Gateway, a product used by major companies. You'll focus on unifying LLM API interactions, ensuring interoperability across various providers and building key features for millions of users. This is a chance to directly impact the future of AI infrastructure and tooling within a fast-paced, collaborative environment.

What you'll do

  • Transform API requests between OpenAI/Anthropic and various LLM provider formats.
  • Develop provider-agnostic unification functionality (e.g., session management).
  • Design systems for provider-level features (skills, compaction, batches).
  • Enhance developer experience through the LiteLLM Python SDK.
  • Maintain an excellent LLM interoperability layer.
  • Support diverse MCP Auth flows and Agent use-cases.

What they're looking for

  • Python
  • LLM APIs
  • FastAPI
  • OpenAI API
  • Redis
  • Postgres

Benefits

  • Competitive salary
  • Equity
  • Health benefits
  • Dental benefits
  • Vision benefits
Apply with Autofill

Opens the application — the Jobs AI extension fills it for you. Set up autofill

Opens the official application on the employer’s site. No login required.

Litellm

Industry
Technology & Software
View all jobs at Litellm

Likely interview questions

  • Describe your experience with the OpenAI API and explain the difference between /chat/completions and /responses.
  • How would you approach designing a system to handle session management across different LLM providers?
Unlock all 7 questions free — and practice them live →