Anthropic· AI Research & Engineering· San Francisco, CA
Research Engineer/Research Scientist, Audio
Classified Tasks (17)
Automate 0%Augment 82%Human-Only 18%
Augment (14)
AI assists, human decides
Develop audio codecs and representations
technical
Source and synthesize high-quality audio data
operational
Train large-scale speech-language models
technical
Train large audio diffusion models
technical
Build end-to-end conversational speech systems
technical
Develop speech and audio understanding models
technical
Develop speech synthesis capabilities
technical
Train state-of-the-art neural audio codecs for 48 kHz stereo audio
technical
Scale audio datasets to millions of hours of high-quality audio
operational
Create robust evaluation methodologies for qualities such as naturalness and expressiveness
analytical
Study training dynamics of mixed audio-text language models
analytical
Optimize latency and inference throughput for deployed streaming audio systems
technical
Debug performance issues across the full stack, from signal processing to distributed training
technical
Benchmark system performance and perform kernel and infrastructure optimizations
technical
Human-Only (3)
Requires human judgment
Develop novel architectures for incorporating continuous signals into LLMs
creative
Collaborate with pretraining, finetuning, reinforcement learning, production inference, and product teams to transition audio research into deployed systems
communication
Develop novel algorithms for diffusion pretraining and reinforcement learning
creative
Job description
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. Anthropic’s Audio team pushes the boundaries of what's possible with audio with large language models. We care about making safe, steerable, reliable systems that can understand and generate speech and audio, prioritizing not only naturalness but also steerability and robustness. As a researcher on the Audio team, you'll work across the full stack of audio ML, developing audio codecs and representations, sourcing and synthesizing high quality audio data, training large-scale speech language models and large audio diffusion models, and developing novel architectures for incorporating continuous signals into LLMs. Our team focuses primarily but not exclusively on speech, building advanced steerable systems spanning end-to-end conversational systems, speech and audio understanding models, and speech synthesis capabilities. The team works closely with many collaborators across pretraining, finetuning, reinforcement learning, production inference, and product to get advanced audio technologies from early research to high impact real-world deployments. You may be a good fit if you: Have hands-on experience with training audio models, whether that's conversational speech-to-speech, speech translation, speech recognition, text-to-speech, diarization, codecs, or generative audio models Genuinely enjoy both research and engineering work, and you'd describe your ideal split as roughly 50/50 rather than heavily weighted toward one or the other Are comfortable working across abstraction levels, from signal processing fundamentals to large-scale model training and inference optimization Have deep expertise with JAX, PyTorch, or large-scale distributed training, and can debug performance issues across the full stack Thrive in fast-moving environments where the most important problem might shift as we learn more about what works Communicate clearly and collaborate effectively; audio touches many parts of our systems, so you'll work closely with teams across the company Are passionate about building conversational AI that feels natural, steerable, and safe Care about the societal impacts of voice AI and want to help shape how these systems are developed responsibly Strong candidates may also have experience with: Large language model pretraining and finetuning Training diffusion models for image and audio generation Reinforcement learning for large language models and diffusion models End-to-end system optimization, from performance benchmarking to kernel optimization GPUs, Kubernetes, PyTorch, or distributed training infrastructure Representative projects: Training state-of-the art neural audio codecs for 48 kHz stereo audio Developing novel algorithms for diffusion pretraining and reinforcement learning Scaling audio datasets to millions of hours of high quality audio Creating robust evaluation methodologies for hard-to-measure qualities such as naturalness or expressiveness Studying training dynamics of mixed audio-text language models Optimizing latency and inference throughput for deployed streaming audio systems The annual compensation range for this role is listed below. For sales roles, the range provide