Town
AI Context & Data Infrastructure Engineer
- Confirmed live in the last 24 hours
- $250k–$300k
- Mid level
- Full-time
- On-site · San Francisco
- Added 1 month ago
About this role
Town is seeking an AI Context & Data Infrastructure Engineer to build the foundational search and data infrastructure for their personalized AI assistant. As the first engineer on this team, you'll design and implement a unified retrieval layer, data pipelines, and a scalable data model. This is a unique opportunity to shape the architecture of a groundbreaking AI product from the ground up.
What you'll do
- Build a unified search and retrieval layer combining lexical and semantic search.
- Design a durable data model for context relevance, speed, and cost-effectiveness.
- Develop and operate both realtime/streaming and batch data pipelines.
- Manage the indexing and storage layer for scalability, latency, and reliability.
- Lay the groundwork for a knowledge graph to relate content by meaning.
- Evaluate tradeoffs between vector vs. lexical search, precompute vs. fetch, and hybrid retrieval.
What they're looking for
- Lexical Search
- Semantic Search
- BM25
- Embeddings
- ANN/Vector Indexes
- Hybrid Retrieval
- Ranking
- Data Pipelines
- Data Infrastructure
- Knowledge Graphs
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Town
Likely interview questions
- Describe your experience with both lexical and semantic search techniques and when you would choose one over the other.
- Explain your approach to designing a durable data model for a large-scale AI application.