Sciforium
Pre-training Research Engineer
- Confirmed live in the last 24 hours
- $165k–$225k
- Mid level
- Full-time
- On-site · San Francisco, CA
- 5+ yrs exp
- Added 1 month ago
About this role
Sciforium is seeking a Pre-training Research Engineer to contribute to the development and scaling of cutting-edge multimodal AI models. This role involves implementing research ideas, building production-ready training code, and analyzing model behavior to enhance the quality of foundation models. You'll be working within a rapidly growing team backed by AMD, focused on building the full stack for frontier AI applications.
What you'll do
- Training large language and multimodal models across diverse datasets.
- Implementing and evaluating new model architectures and optimization techniques.
- Developing and scaling pre-training recipes for novel architectures.
- Analyzing training dynamics and model quality through experimentation.
- Collaborating with data and distributed training engineers to improve efficiency.
- Conducting ablation studies and analyzing model behavior.
What they're looking for
- Machine Learning
- Deep Learning
- GPU Training
- Distributed Training
- Software Engineering
- JAX
- Flax
- XLA
Benefits
- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary
- Equity
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Sciforium
Likely interview questions
- Describe your experience with pre-training large language or multimodal models.
- Walk me through a time you implemented and evaluated a new model architecture. What metrics did you use?