# Principal Research Engineer, Post-Training

**Company:** [character.ai](https://hotfix.jobs/companies/characterai)
**Location:** Redwood City, CA
**Role:** ML Engineering
**Salary:** $275k – $400k/yr
**Experience:** 7+ years
**Skills:** Transformers, Reinforcement Learning, LLMs, Alignment Methods, Gpu-Based Systems, Distributed Training, Kubernetes, Docker, Python, A/B Testing
**Posted:** 2026-06-22

> Lead technical vision and execution for post-training systems that transform foundation models into intelligent, engaging products. Drive alignment algorithms, RL, and infrastructure for large-scale LLM training and serving.

## Job Description

## What You'll Do

### Technical Leadership & Mentorship
- Define and drive the technical roadmap for mid- and post-training systems, balancing research innovation with production reliability and scalability
- Mentor and grow a team of researchers and engineers through technical guidance, design reviews, and career development
- Establish best practices for experimentation, model development, and deployment

### Research & Model Development
- Lead the development of alignment algorithms, optimization techniques, and training objectives to improve model capabilities and data efficiency
- Drive advances in mid- and post-training methodologies including reinforcement learning, preference optimization, supervised fine-tuning, and emerging alignment approaches
- Identify and execute high-impact research opportunities that improve model behavior, safety, and user engagement
- Develop robust evaluation frameworks and quality signals to measure real-world model performance

### Systems & Infrastructure
- Lead the design of efficient training and inference systems for large-scale generative models
- Architect scalable data pipelines that transform diverse data sources into high-quality training datasets
- Partner with infrastructure teams to optimize distributed training, GPU utilization, and serving efficiency
- Drive improvements in experimentation platforms, data quality systems, and model observability

## Required Qualifications
- PhD in Computer Science, Machine Learning, AI, or a related field, or equivalent industry experience
- Significant experience leading technical projects or teams in machine learning, AI research, or large-scale distributed systems
- Experience scaling and mentoring high-performing research and engineering teams
- Deep understanding of modern machine learning techniques, including transformers, reinforcement learning, alignment methods, and large language models
- Strong track record of delivering impactful research or applied ML systems in production environments
- Expertise in designing, building, and maintaining production-quality ML systems and infrastructure
- Experience training, serving, debugging, and optimizing large-scale models on GPU-based systems
- Experience leading teams working on large language model training, mid-training, or post-training
- Experience with product experimentation, online evaluation, and A/B testing frameworks
- Strong software engineering skills with the ability to write clean, maintainable, and scalable code
- Excellent communication skills and the ability to influence technical direction across teams
- Lead complex, cross-functional initiatives across data, training infrastructure, evaluation, and model serving

## Nice to Have
- Hands-on experience working directly with open-source models like Mistral and Qwen, particularly adapting them via mid- and post-training for specific personas, creative writing, or role-playing applications
- Familiarity with cloud-native ML infrastructure, including Kubernetes, Docker, and modern orchestration platforms
- Publications in leading machine learning conferences or demonstrated contributions to the broader AI community

## Similar roles

- [Principal Engineer, State Estimation](https://hotfix.jobs/jobs/d5dba46a-f8da-4ec9-b475-1da0fe91c3ec) - Shield AI - Dallas, TX - $275k – $412k/yr
- [Principal AI Engineer (Remote)](https://hotfix.jobs/jobs/ba23f41e-b7e2-4d1a-b8cc-bfc95a0eb5ae) - Rula - Remote - $281k – $330k/yr
- [Principal Machine Learning Engineer- LLM Fine-tuning and Optimization](https://hotfix.jobs/jobs/47fef849-e819-4ae8-a6ae-b7ebb7ead24c) - Airbnb - Remote - $292k – $365k/yr
- [Sr. Principal AI Systems Architect](https://hotfix.jobs/jobs/029c0c1f-69d5-426a-b3e7-a3e152458bf8) - Fivetran - Oakland, CA - $252k – $315k/yr
- [Principal Software Engineer, AI Platform](https://hotfix.jobs/jobs/5e4c180b-8da3-43de-8eef-10386db7551d) - Redpanda Data - San Francisco, CA - $245k – $290k/yr

**Apply:** https://hotfix.jobs/jobs/e07fc34f-a48e-45f2-b532-f50532c58292
**Canonical:** https://hotfix.jobs/jobs/e07fc34f-a48e-45f2-b532-f50532c58292