Shift Technology
Data Scientist/ Engineer (Hybrid -Boston)
About this role
Shift Technology seeks a Data Scientist/Engineer to develop AI agents for insurance workflows, focusing on LLM-based solutions and agentic frameworks. You'll build production data pipelines, design autonomous subrogation systems, and ensure responsible AI practices in a hybrid Boston role within a 200+ person data science team.
What you'll do
- Build and productionize data pipelines for structured data, text, documents, and images optimized for LLMs and multi-modal models
- Design, develop, and deploy LLM-based solutions including RAG, embeddings, and instruction tuning for claims handling and document understanding
- Develop Chain-of-Thought and ReAct prompting strategies to justify agent decisions based on Comparative Negligence laws across jurisdictions
- Create custom tools enabling agents to query databases, call external APIs, and calculate metrics from telemetry data
- Establish evaluation frameworks using LLM-as-a-judge to ensure unbiased, legally sound, and explainable agent decisions
- Lead client workshops, present prototypes, gather feedback, and help define roadmap priorities for US Insurance solutions
What they're looking for
- Object-oriented programming and production-level code design
- Large Language Models and generative AI (RAG, embeddings, prompt engineering, fine-tuning)
- Agentic frameworks (LangChain, LangGraph, OpenAI Agent SDK, CrewAI, A2A/MCP)
- Machine learning fundamentals and full lifecycle management
- Data pipeline design for documents, OCR, and multi-modal workflows
- Responsible AI practices (privacy, hallucination mitigation, explainability)
- Azure or Databricks model integration
- Python or similar production-grade programming language
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Shift Technology
Shift Technology builds AI-driven solutions for healthcare payment integrity, helping insurers detect and prevent fraudulent or erroneous claims. The company is hiring Data Scientists and Engineers to develop data pipelines, work with diverse data sources, and implement responsible AI practices in close collaboration with clients.
- Website
- shift-technology.com
Likely interview questions
- Can you walk us through a production RAG system you've built, including how you handled retrieval quality and hallucination mitigation?
- Describe your experience with agentic frameworks like LangChain or LangGraph—what challenges did you face integrating them with external tools and APIs?