Eloquent AI
AI Engineer, AIOps & Infrastructure
San FranciscofulltimemidAdded 2 days ago
About this role
Eloquent AI seeks a Senior Software Engineer to design and operate scalable infrastructure for deploying autonomous AI agents in production. You'll automate LLMOps and MLOps workflows, optimize GPU workloads, and ensure enterprise-grade reliability for large-scale AI systems across financial services.
What you'll do
- Design and build scalable ML infrastructure for production AI agent deployment
- Automate LLMOps and MLOps workflows including model training, fine-tuning, and monitoring
- Optimize GPU and cloud compute workloads to improve efficiency and reduce latency
- Develop Kubernetes-based solutions and custom operators for ML orchestration
- Implement system observability, logging, and performance tracking for AI models
- Participate in on-call rotations ensuring 24/7 reliability of critical systems
What they're looking for
- Kubernetes and containerized workload management
- Cloud platforms (AWS, GCP, Azure)
- Python development for ML/AI services
- ML model deployment and inference optimization
- Distributed computing and system architecture
- GPU workload optimization
- Vector databases and RAG architectures
- Monitoring, logging, and observability tools
Opens the official application on the employer’s site. No login required.