Applied Research Scientist, AI Research

descript· 11 open roles

Remote RemoteFull-time2 weeks ago

Salary

Undisclosed

Experience

Mid

Job Type

Full-time

Posted

2 weeks ago

Apply Now

Boost your chances at descript

Tailor your resume to this exact job and generate a matching cover letter in about 60 seconds with JobEase — our AI application assistant.

ATS-optimized resume
Personalized cover letter
Match score & keyword gaps

Tailor my application

Free to start · no card required

Get more other jobs in your inbox

Verified daily — no ghost listings.

About This RoleAI processing…

Descript's Research team builds the models behind the product's most distinctive features: Video Regenerate and lipsync, video translation, zero-shot voice and roomtone cloning, and Studio Sound. We don't build general-purpose generative models. We pick specific problems in the editing workflow and build specialized models for them. This isn't research for its own sake. Everything we build is meant to ship, and most of it has, going from prototype to a production feature used by millions of creators within months.

This role is focused on multimodal understanding: training models to perceive edited media the way a human video editor does. Underlord, our AI editing agent, reasons about a project largely through a textual representation of it. Giving it direct perception of the media it's working on is what will let it judge its own output and reason about the creative choices in an edit, not just the structure of a project. It's also an open research problem, since there's no settled way to represent or evaluate editorial craft, whether a cut lands or whether the pacing works. We have a unique dataset to work with.

Some recent work from the team:

Key Responsibilities

1
Multimodal understanding: build vision-language systems that let Descript's agentic editing features reason over the visual and audio content of a project.
2
Evaluation: design the benchmarks and evals that make editorial quality measurable, and that balance quality against cost and latency.
3
Data: build the datasets your work depends on, including synthetic data generation where real examples don't exist at scale.
4
Training: train specialized models from scratch or fine-tune existing foundation models, whichever gets the capability we need.
5
Shipping: take models from prototype to production with the agent and engineering teams.
6
Direction-setting: identify the next research direction that should become a Descript feature, not just a paper. More senior candidates should expect to own this directly; more junior candidates will grow into it.
7
Publishing: take your work to academic venues if you'd like. We support it, but it isn't a requirement of the role.
8
Proven ability to design and implement deep learning algorithms, demonstrated by publications, open-source work, or models you've shipped.
9
Strong programming skills and deep fluency in PyTorch.
10
A track record of generating new ideas in machine learning. You produce more ideas than you can implement, and once an experiment setup is established, you can run and evaluate many of them quickly rather than being bottlenecked on infrastructure.
11
Strong experimental judgment. You test ideas fast, and you're honest with yourself and the team about which ones don't pan out.
12
Clear written and verbal communication, including when a direction isn't working, so the team doesn't waste time following a lead that's already dead.
13
A PhD or Master's in deep learning or a related field, or equivalent experience. We care about the track record more than the credential.
14
Lead or first author of an accepted publication in a top venue: CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, or similar.
15
Played a key role in shipping a production feature with deep learning as a core component.

Requirements

A track record of generating new ideas in machine learning. You produce more ideas than you can implement, and once an experiment setup is established, you can run and evaluate many of them quickly rather than being bottlenecked on infrastructure.
A PhD or Master's in deep learning or a related field, or equivalent experience. We care about the track record more than the credential.
What you bring Required Proven ability to design and implement deep learning algorithms, demonstrated by publications, open-source work, or models you've shipped.
A track record of generating new ideas in machine learning.
A PhD or Master's in deep learning or a related field, or equivalent experience.
We care about the track record more than the credential.
More senior candidates (Senior and Staff) should also bring a track record of owning research direction rather than executing a plan handed to them, and experience mentoring or technically leading other researchers or engineers.
Where breadth helps Direct experience in multimodal understanding is welcome but not required, and we don't require domain-specific expertise in computer vision or speech and audio.
Final offer amounts will carefully consider multiple factors, including prior experience, expertise, location, and level, and may vary from the amount above.