Virio
Harness Engineer
- Confirmed live in the last 24 hours
- $150k–$250k
- Mid level
- Full-time
- On-site · San Francisco
- Added 1 month ago
About this role
Virio is seeking a Harness Engineer to build and refine the intelligence layer between its AI models and product. You'll own the data feedback loop, evaluations, and harness design, ensuring the agent’s reliability and quality. This full-time, in-person role offers a chance to significantly impact a rapidly growing company focused on revolutionizing content creation.
What you'll do
- Build and refine system prompts, tool integrations, and context windows.
- Design and implement an evaluation framework to measure agent quality.
- Architect the abstraction layer between the product and the model’s capabilities.
- Own prompt versioning, experimentation, and iteration through A/B testing.
- Collaborate with product and engineering to identify and address agent failures.
- Drive architectural decisions and create technical content.
What they're looking for
- System prompts
- Tool integration
- Context management
- Evaluation frameworks
- LLM
- Data feedback loops
- Architecture design
Benefits
- Competitive compensation
- Meaningful equity
- Medical, dental, and vision insurance
- 401(k) plan
- Working meals covered
- Relocation support
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Virio
Likely interview questions
- Describe your experience designing and implementing evaluation frameworks for AI models.
- How would you approach A/B testing different prompt variations?