PCMag editors select and review products independently. If you buy through affiliate links, we may earn commissions, which help support our testing.

Adobe Brings AI Text-Based Editing to Video

You can now edit video based on automatic text transcription, and new AI-based automatic tone matching from different cameras including HDR content.

 & Michael Muchmore Contributor

Our team tests, rates, and reviews more than 1,500 products each year to help you make better buying decisions and get more from technology.

Our Expert
LOOK INSIDE PC LABS HOW WE TEST
65 EXPERTS
43 YEARS
41,500+ REVIEWS

Among the most intriguing updates coming to Adobe's video editing and motion graphics software are text-based editing and enhanced transcription in Premiere Pro.

Ahead of NAB 2023, the video industry's major conference in Las Vegas, Adobe also detailed upgrades coming to After Effects and Frame.io. And no tech software announcement can avoid mentioning generative AI these days. Adobe talked up its text-prompt-based image generator, Firefly, and posited some use cases that could someday come to Premiere Pro and After Effects.

“We’re exploring the potential of natural language content creation with Firefly so you can describe what look you want and instantly change the colors and settings to match," Adobe says.


Text-Based Editing

Text-based editing in Adobe Premiere Pro

Adobe previously added automatic transcription to Premiere Pro, but with this update, you can edit video based on that text. You can search for words or phrases and add the clip section to the timeline with a click. This also enables you to quickly remove sections where the speaker pauses with ripple deletes based on the transcript. Once you’ve cut and moved the bits around based on the transcript, you can instantly create captions in the project.

These editing features are currently in public beta and are expected to ship in May.


New Color-Editing Tools

Premiere Pro’s new Automatic Tone Mapping and log video detection automatically manages color in a project. It lets editors mix and match video from SDR and HDR sources, and automatically applys the correct LookUp Tables (LUT), which saves editors from having to search for the right LUT for each source camera and apply it separately.

It’s a simple matter of making sure you check the new Auto Tone Map box in the Sequence Settings panel and the Auto Detect Log Video Color Space box in the Preferences panel. The feature supports smartphone content as well as pro video cameras from DGI, Panasonic, Sony, and Canon. Adobe reps didn’t mention pro cameras from RED and Arri, but it’s a good bet that support for those is coming, since the company announced improved format support for the RED V-Raptor X and the ARRI Alexa 35 at the press briefing.


Better Performance

Adobe also announced that this is the fastest version of Premiere Pro the company has ever released, and it will take advantage of GPU acceleration for more functions, including transitions, effects, title templates, and color scopes.


Small But Noteworthy User Requests

Adobe likes to address user requests, and this version update is no exception. None of these will make headlines, but they could certainly make editors’ lives easier. Here’s a snapshot from Adobe’s presentation of these less-earth-shattering helps:

Adobe Premiere user requested featurs

Collaboration Improvements

Collaboration tools in Premiere Pro also see improvements, like progressive project loading, which saves editors from having to wait for a whole large project to load before they can start working. Another new feature that editors will love (trust me, as one who’s lost work by forgetting to save) is background auto-save. And the new Sequence Locking feature means that collisions between editors can be avoided, with one editor able to lock a sequence, which becomes temporarily read-only to other collaborators.


After Effects Updates

After Effects, now in its 30th year, sees updates in this announcement, too. Its new Properties panel saves motion graphics editors from having to dig down into timeline layers and choices to change the object they’re looking at and working on. New integrations for OpenColorIO (OCIO) and its Academy Color Encoding System (ACES) will be important for motion picture editors, allowing them to achieve consistent colors while working in various other applications. After Effects also gets community-requested capabilities, such as multi-frame shape rendering and keyboard shortcuts for Selectable Track Mattes.


Frame.io Now Works With Photos

Frame.io photo support

Frame.io, the standard cloud collaboration service for pro video editors, having come into the Adobe fold, gets a few notable new capabilities at this year’s NAB.

Interestingly, it will now support camera raw files, courtesy of Photoshop’s Camera Raw module. Still photo cameras will be able to take advantage of the platform’s Camera to Cloud feature, which is similar to tethering, except instead of photos appearing on a connected PC, they appear in the cloud, ready for collaborators.

The company announced Camera-to-Cloud support for Fujifilm X-H2 and X-H2S cameras. And an open API will let third-party applications like Capture One integrate with the cloud sharing service. Frame.io’s security is being beefed up, meanwhile, with “forensic watermarking” that follows content no matter how it’s copied, edited, or transferred. 

About Our Expert

Michael Muchmore

Michael Muchmore

Contributor

My Experience

I've been testing PC and mobile software for more than 20 years, focusing on photo and video editing, operating systems, and web browsers. Prior to my current role, I covered software and apps for ExtremeTech and headed up PCMag’s enterprise software team. I’ve attended trade shows for Microsoft, Google, and Apple and written about all of them and their products.

I still get a kick out of seeing what's new in video and photo editing software, and how operating systems change over time. I was privileged to byline the cover story of the last print issue of PC Magazine, the Windows 7 review, and I’ve witnessed every Microsoft misstep and win, up to the latest Windows 11.

I’m an avid bird photographer and traveler—I’ve been to 40 countries, many with great birds! Because I’m also a classical music fan and former performer, I’ve reviewed streaming services that emphasize classical music.

Technology I Use

For everyday work, I use a good-old Dell tower with 16GB of RAM, a 12th-gen Intel Core i7 processor, and an Nvidia RTX 3060 Ti GPU that runs on Windows 11. I pair it with a 4K Lenovo ThinkVision P27u-10 monitor and a Logitech MX Vertical mouse. For offsite work, I use a 2024 Microsoft Surface Laptop with a Qualcomm Snapdragon X Elite processor. Camera-wise, I moved to mirrorless from a Canon EOS 80D with a Canon 70-300mm IS USM lens. I now have a Canon EOS R7 with a 100-400mm lens, but I miss my DSLR for several reasons.

In order of usage, the software I turn to most frequently is the Edge web browser, Slack, Adobe Creative Cloud, Microsoft 365, Firefox, Brave, and WhatsApp. I use the Windows Phone link app to see everything on my Samsung Galaxy S21 Ultra phone, which has excellent telephoto capability.

For fitness monitoring, I have a Fitbit Charge 6 and use an Anker Smart Scale P1. I’m also a streaming fan, so I subscribe to both Amazon Music Unlimited (especially for its Dolby Atmos content) and Qobuz (for its high-res sound quality and classical catalog). I recently added a Vizio 5.1 Soundbar SE, which sounds surprisingly good given its low price. To holler commands instead of using a remote control, I have the Amazon Fire TV Cube in the living room, which lets me verbally tell the TV what I want to watch. It hooks up to an LG B4 OLED TV. I have a Sonos One speaker in my kitchen that also ties in with Alexa, as does the Echo Dot 2 With Clock in my bedroom. For serious listening, I have B&W 601 speakers plugged into a Conrad-Johnson Sonographe amp and preamp, with a Cambridge Audio AXN10 streamer as source. For reading, I also have a Nook GlowLight 3.

Read full bio