ML Engineer

About this role

CreatorIQ seeks an ML Engineer to join their Product Innovations team, responsible for deploying and maintaining production ML systems—from NLP and embeddings to LLM features—that process millions of records daily. You'll own the evaluation stack, build vector ecosystems, and partner with data science and engineering teams to turn experimental models into reliable, cost-efficient products at scale.

What you'll do

• Deploy and monitor ML systems in production handling millions of records per day, including NLP, embeddings, and LLM-powered features
• Build and maintain evaluation frameworks with golden datasets, model-as-judge systems, and regression tests to gate releases
• Own the vector embeddings ecosystem and develop retrieval, classification, and similarity patterns
• Partner with Data Science on annotation workflows, PII scrubbing, and ground-truth data pipelines
• Improve MLOps foundations including model versioning, observability, and drift detection
• Translate product requirements into measurable AI features with clear success criteria

What they're looking for

• Python and modern ML/data stack
• Production ML deployment and monitoring on AWS or GCP
• NLP and embeddings systems experience
• ML/LLM evaluation frameworks and metrics
• Vector databases and retrieval systems
• Cloud platforms (SageMaker, Vertex AI)
• Cross-functional communication with technical and non-technical stakeholders
• Data annotation workflows and PII handling

Benefits

• Flexible hybrid work model combining in-person and remote work
• Work on cutting-edge AI products used by 1,300+ global brands
• Collaborate with experienced Data Science and Engineering teams
• Mix of production-focused and research opportunities
• Recognition as a best company to work for (BuiltIn LA/NY)
• Part of a Deloitte Technology Fast 500 company