Some people are predicting that the future of video editing is going to be agentic. What that means is that we, people, won't be editing our video, but AI tools like Claude will do everything from cutting out silences to adding transitions to adding cool zooms, b roll, etcetera. The thing is that future is already here. Just last week, I went viral on Twitter by sharing a clipping tool that turns long form content into short form content. I made that in an hour using Claude. My video on Remotion where you can use Claude to generate motion graphics and you no longer need motion graphic skills to add to your videos is now 20,000 views. And some of my favorite creators like Renee are already editing their YouTube videos using Claude. Renee is actually the one who put me on to using Claude for video editing. I've since personalized my workflow a little bit, but credits due where it's due. In this video, I'm sharing my end to end workflow using Claude to edit my videos. I'll go over how it does things like cutting silences, ums and ahs. It'll find places to add b roll as well as generate said b roll either using tools like c dance or in our case, Remotion. We're gonna create motion graphics. I'll show you how you can easily add photos, sounds, etcetera without going into your editor and actually finding the spots to add them. And I'll hint at how you can turn longer form content into social short form content. You'll also learn how in this age of agentic editing, you can avoid all of your videos looking the same as other people's videos by making sure that you use sounds that only you know or memes that are really niche or or really specific references. Let's get into the workflow. Okay. Step one of my video editing process is making a rough cut, a big cut to remove any silences,
repetitions,
mistakes,
filler words, etcetera. I created a skill for this that you can give to Claude or Codex, whatever you're using. It removes all silences, etcetera, and makes a cut while preserving laughter for comedic effect. So I'm gonna show you how to use this skill in Claude. We're just gonna open Claude, and then we're gonna go cut video.
So just to install this, if you haven't done so already, just grab the the link to the skill and give it to Claude and say install this skill, and then you're gonna probably have to restart your terminal.
So here we have cut video, and then what we need is obviously a source file or raw recording.
This is a recording with my dad. It's seven and a half minutes long, and as you can see, it hasn't been cut at all.
So I'm gonna give it that, and then we're gonna wait for the output. If you don't like this aggressive
cut, I tend to cut all of the silences out and leave very little space just because I want my videos to be engaging to watch, then you can just prompt it and do this differently to match your editing style.
Or what I did to create this skill is I actually gave it a reference video of mine initially, so it knows how I manually edit my videos. So that might be an idea for you to customize it to your editing style. Just so you know what's going on in the background, it's easier to edit. And then it uses tools like Whisper to analyze the transcript, as well as FFmpeg to look at the frames in the video,
and then it's gonna decide what to cut out. Just as a time estimate, there's lucky days and unlucky days with Claude, but it takes a few minutes to make these cuts, especially if you're asking for a lot of cuts. So this is a seven minute video,
and it is already running for three minutes. But again, this means you won't have to manually
touch a video editor ever again,
which I think is great. Especially if you build agents around this, you can just give your raw cuts and give it instructions on how to cut this, and it'll do it in the background while you do other work. Alright. It has outed a video, and it reduced it by a minute and a half. Let's watch some of this to see how well it did. Number one, we're gonna guess if a photo is AI or real? Yes. Yes. Show me the picture. It's a fake. It's AI. Very good. This is a picture. Yeah. It's real? It's a go. Okay. It's AI. Okay. Remember what you talked about yesterday? Cool. So I think it did a good job of cutting things out. I can see that in the beginning,
I mean, I was speaking as I was getting the camera set up. So you could also tell it to get rid of that point. Just gonna tell it to cut out
the so again, it looks at transcript. So it assumes that when you're speaking, you might wanna that in there. To be honest, depending on the style of the video, I would wanna keep it in there. So you see here, it's saying check out the lights. That's good. So it's gonna drop that part where I say checking the lights, and I think it picks up on that well. Let's check if it cut it out. Okay. So we're gonna speak in this little mic. Yeah. Great. So it cut it out just based on a prompt, which is kinda crazy.
Now that's step one of our editing process. So you can see this is an interview with my dad, and you may have noticed that we're showing something on screen.
So I wanna overlay whatever I'm showing him on screen. He's doing an AI guessing game, basically. So I'll show you what this looks like in the video
already edited here.
So I'm just gonna play that, and you can see that he's looking at these photos and guessing whether or not they're AI. I kinda wanna give Claude the slide deck where I have all of these photos just because I'm a little bit lazy. So here is my quiz that I made for my dad. I'm just gonna share this and make it accessible
for everyone.
And so I'm gonna tell Claude,
extract
all of the our images
in this slide. So I'm saying that it should put it in my assets folder. I have an assets folder where I save things like screenshots
or,
yeah, funny photos that I wanna use in
videos, as well as videos or sounds that I can give Claude while I'm editing. Funnily enough, I just created a Slack bot where I just drop any screenshot into, and then it saves it to that assets folder. So this way, whenever I'm working on a project and I see a fun screenshot or a stat or anything that I need for a video project, I save it to my finder,
and then Claude can easily access that. I forgot to give it my Google Slide link, so I'm gonna do that now. Right. So here we can see that it created a folder called projects.
I'm gonna move that to projects soon, but we'll see when we open this, we have some PDFs,
and it's probably gonna extract the photos from that PDF and cut them. And then we'll see that we can magically overlay all of these photos at the exact right time stamps. Now this process is a bit longer than it would have been in the beginning because as I was editing this video manually, I was saving all of these photos to my computer. I just wanted to show you that you can literally give it any format, a PDF or anything else, and it can extract photos for you to use as well. So you can do this with logos,
with anything you want. So here we have the raw,
and it's outputted that. I wanted to get rid of the the white padding, so I'm gonna just ask it to do that. So we can see it also recognizes what's on the slide. So it obviously took all of the slides out of the PDF,
but it sees that not every slide contains a photo.
So hopefully, it's just gonna grab the photo once. Alright. Live. We're seeing that it's cropping all of these images. So that saved me a lot of time finding these images again. Great. And now we're gonna tell it to overlay the image for maybe a second or three, two to three, right before my dad needs to guess what the image is. But I just wanna show you that step two of overlaying images is very much possible
with Claude editing without doing any manual work. We can see here that it's mapping the 20 photo moments, slides one to 20, to when my dad is doing the guessing.
So let's take a look at these overlays. That's where the game starts.
Number one, we're gonna guess if a photo is AI or real. Right. Yes. I will. Yes. Show me the picture. It's
fake. It's AI.
Good. This is a picture. Yeah. It's real? It's real. Okay. It's AI. Okay. Remember what we talked about yesterday? Okay. So here, it looked at the transcript and mistakenly added an overlay, but that's an easy fix. We just need to tell it to move that one.
This is
I think I I too, but it could be real because it existed.
You can see here that it actually overlaid that one at the right moment. So it did well for the majority of these. I looked at the the video. And for any ones that are not aligned well or like come at the wrong moment, you could just say it should move that. But that should show you that you can add any image to a specific time stamp. So so even if you are going through your video like this, no longer in an editor, you say, hey, at minute one fifty six, I wanna add this image.
And then you just refer to your assets library, and it's gonna add that image. So my third step in this case would be to add sound effect. So I'm just gonna show you how I'm gonna use the Duolingo
correct sound to add to my video whenever my dad gets something correct, and then I'll do the wrong sound if he gets it incorrect. And I'm gonna show you exactly how I save a sound effect from YouTube. I give it to my Slackbot,
and then it saves it to my sounds folder. So I'll only have to save this once in my life. My Slackbot recognizes what it is, so it's gonna say it's the Duolingo sound, and I'm then always gonna be able to refer to it. Alright. So I'm gonna go to my Slack bot, and I'm gonna copy paste the Duolingo sound effect link.
And then it's gonna pick up on what this is. In this case, it's a sound effect. It's gonna automatically save it as we can see here. It's gonna save it directly to my sound effects asset folder.
So here we have it. It's gonna open
here, but that's fine. Now we're gonna tell Claude to add the Duolingo sound effects to whenever my dad is correct in the video.
And then find it in my
assets folder under sounds.
Let's see if it applied the Duolingo sound effects whenever he gets something right. So let's play this first one. It's a fake. It's AI.
Good. Very good. It's AI. Nice. So it applies the whenever
he's right. Just always make sure to do a double, triple check, especially if he's doing a lot of them. Like, is or he Claude is basing himself off the transcript, and sometimes it's kinda hard to tell where to add it. But he did a good job of adding those sound effects. So that was step three. I showed you how to add sound effects. I wanna show you in a similar technique using my Slack bot how I can save a meme and then use that in my videos. So I'm just gonna go to Slack, and I'm gonna drop this link in there, and it's gonna download it as a video. And then that way, I have the confused math ladies meme in my assets folder forever. Let's head over to my assets folder. Again, you'll you're seeing this is turning into the holy grail.
And here we can see it described as confused
math lady.
We can actually play that.
I kinda wanna use this meme after my dad's confused about something. And and as it's older.
And and to make my life a little bit easier, I'm gonna have some manual intervention where I wanna add it to a specific moment in the video. So let me just rewatch this and find the specific time stamp that I wanna add it. Okay. I think it'd be funny to add it at around the 01:50 mark. 01:50
mark. So let's see how it does, and it's gonna play that meme. Of course, you can also cut the meme. You can shorten it. Just tell it to shorten it or only include a small excerpt of a video. So here, it's gonna search for that meme in my assets folder, and it's gonna add it. The best way, in my opinion, to edit with Claude is to do a lot of the prep work where you source all of the screenshots or the memes that you wanna use, and then it can just go into one folder in your finder and add those where it thinks it's right. Let me just head over to the one fifty mark. Here we go. Was it?
Yeah.
So great job adding the meme at actually corrected one forty six instead of one fifty because it noticed that my dad was the most confused there. So you can see Claude's already doing good thinking here. Alright. Next part of editing might be to add fun transitions between clips, or I kinda wanna add zooms on my face or my dad's face whenever he says something really funny to
one of the two speakers
when ever something
funny happens or
awkwardness.
So let's see how it does there. You could also give it cinematic terms like use a Ken Burns effect, which just zooms into something slowly. You could also say you wanna add a harsh zoom and just kind of play around with how you like to edit your videos. Again, if you have a lot of reference videos, maybe you found on YouTube, from other people's editing, or your own, then you can ask Claude to describe
what those cuts are or what those effects are that are being used. Okay. Let's have a look at these zooms that it did or not. It did a few. Let's see towards the end here.
Are you an Unc? No. I am. Okay. I
think this did an okay job, but I think I I need to be a bit more specific with the the times I wanted to zoom in. He'd actually gave us a list here of when it zooms in. No. It's not the last one. Let's look at 03:15, and let's see if I agree with that.
Very
good. Do you know who it is? Don't worry. He
was prepared. Yeah.
So at this moment, that was actually a really good idea to zoom to my dad's face because he was arguing with me. So you can definitely look at your video and say, I would have added Zooms whenever my dad completes a sentence of mine. So I can say, add a Zoom to
dad when
rots. So
that's my manual intervention there. You can actually see that it found the exact timestamp where it should add that zoom. So let's wait for the zoom. Okay. So he added that at 05:37.
Let's watch that together.
Because it's so addicting
without learning anything. So your brain
What? Very good. Important part here is to explain in as much detail as possible how you like your edits to be done and which transitions, etcetera, you'd like to use. Now before we move on to my demo of how I would edit screen recordings, specifically ones recorded in Intelli, I'm just gonna show you how we can use another skill that I've built to turn this long form video into a short form clip and actually add captions as well. So, yes, you can even add captions to this. So this completely gets rid of the need for a tool like Opus clip, which generates captions and turns something into a
video. Here, it's pulling what he thinks are the funniest moments in terms of clips. I want the clip where he describes what I do, and we can select a few more if we want. But let's just do next. And then the format, I want it to be Reels format.
And then and then we're gonna submit those answers. So as I said, you can get this specific Clipify clip that actually got 300
stars on my GitHub. So you can get that repo there, and you can just set that up in Clon and use it for any long form to short form flow. So let's wait it to generate this, and I'll show you what the final result is. It's asking us if it wants the hard cut version, and let's do big
you know what? I kinda want kinda want big bold
captions. So it asks us about the format of the captions, and if you wanted our vertical video to have our faces in a split screen or if it should zoom in on me when I'm speaking, zoom in on my dad when he's speaking, and I prefer that version. Let's take a quick look at the vertical video portion of this video. Now I'd like you to describe as best you can what you think I do as a job.
It's I can't describe it because I have no clue.
Everybody asking me this. I don't know. He makes money to have a computer. That's accurate. That's all. You could see it clipped it here, and also you could tell it to do this on the raw recording instead of the already zoomed in version of this video. So, yeah. That was it for the non screen recording,
editing your videos with Claude. There's so much you can do connecting it to tools like 11 labs as well, uh, to do narration,
for example, or even connected to an AI generation video tool like Cdance to generate AI b roll.
Alright. For this last portion, very quickly, I wanna show you how you can edit your screen recordings that you record in Tele using our MCP.
So you can actually perform actions in Claude that are directly reflected in your Tele editor. So you're just gonna go to our docs page and find the MCP doc. And then if you haven't done so already, you're just gonna copy this and then through your terminal.
Now I've already installed RMCP.
So I'm just gonna open Claude,
and I'm gonna show you where it is or the tools that exist. So you can obviously list your videos, etcetera. But we can also upload clips. So you can upload your own clips next to your screen recordings. You can sorry. You can cut clips. You can even get frames from your video that would be good for a thumbnail, for instance. So I just did that earlier today. You can remove filler words, etcetera. But I'm gonna show you how I'm gonna cut my video in Tala because it's super easy to do that there with AutoCut.
And then I'm gonna add a b roll layout, which is super new, which is essentially layout where we add b roll. And the b roll I'm gonna add is gonna be generated in another tool called Remotion,
and all of that's gonna happen in Claude. First thing we're gonna do is we're gonna grab a video. You can see here that it has no cuts applied to it. So I'm gonna remove all of these silences,
remove the filler words, etcetera.
I would maybe do a more clean-cut here. But here we can see that there are no gaps applied beside the base layout.
So we're gonna ask Claude to go through and apply where it thinks it's would be right. We're just gonna grab the video link here, and we're gonna head over to Claude again. Layouts. Graphic
generated
in Remotion
as b roll.
I'm being I'm being purposely lazy and vague because I know what I talked about in this intro, and I always wanna add b roll in my intros to make them more exciting. So I'm gonna see if it can add b roll there to describe a process. This video was about how Bod is now editing video,
and I just wanna show that with motion graphics. So let's see how well it does in our first go. I should add, if you haven't done so already, watch my video on how to generate motion graphics with
Remotion because I go over the steps of installing Remotion into Claude, is super easy.
But you do need to set that up before you can actually generate motion graphics in this way. So Claude will just remember Remotion as a skill, and then it can actually use it to do such things and generate b roll. So be sure to watch that first. Cool. We can see the steps here. So it's looking at the uncut transcript,
and it's checking for b roll moments. It's gonna generate the motion graphic. It's gonna upload that motion graphic as m before in Totella, and then it's gonna add
b roll layouts with said m p four. So it's asking me yeah. It's giving me three suggestions,
and I like the idea of messy files flying in and then going into organized folders, and then I'm gonna go with fast and submit those answers. Getting the motion graphic, and then it's gonna upload it as an m before to the b roll segment,
which is new,
and you should try. Alright. Supposedly, it has generated these layouts, so let's have a look together. We're just gonna have to always refresh our page whenever we add changes. So here we can already see it applied our new b roll layout. So let's play this together.
First impressions.
So fun. Okay. So generated that in Remotion,
and then it added that as I was describing this. So this was about my Slack bot and how basically I created this assets folder. I think this is a really cool way of just being able to edit your screen recordings that you make. This was just a small example of things you can do in our MCP. It's still work in progress, but I'm gonna be playing around with it over the coming weeks, and I'd love some of you to play around with it as well. I'm gonna show you second thing that the MCP can do. So we're just gonna say, find frames in this
video of my full face
that I could use
as a
YouTube thumbnail.
Let's see. It can actually get frames as well from Tella directly.
So I'm just gonna see if it can find that from the camera source file,
and then it's gonna save that to our
it's selecting for wherever my eyes are pointing forward because I know I don't always do that when I'm filming,
and I expect it to return some frames that I can use. It says it found the winner killer shot, which I'm animated. My mouth is open, so let's see what it comes up with. Okay. In all fairness, I did interrupt Claude because it was taking too long, but look at these thumbnails that it found. Using Tella's MCP
now lets you edit your videos using Claude. And what this opens up is that you can integrate many more tools into your editing process, not just Tella, not just CapCut, not just one tool by having it all be in AI model. I hope you liked this introduction to how I edit my videos with Claude. There's a long way to go. As you saw, sometimes we run into some slowness issues, some understanding issues. As you start to edit your videos with Claude, you're gonna become much better at defining technically how it is you like to edit. So it removes all manual work, which we all hate, and it just becomes more of a conversation, which I've really liked. I'm gonna link all of the skills that I used below
so you can add them to your own Claude and play around with. And then if you like this video, please be sure to subscribe. A lot of time goes into these videos, and I'd really love to have you around. I'll see you for the next video.