WEBVTT 00:00:00.000 --> 00:01:38.065 Some people are predicting that the future of video editing is going to be agentic. What that means is that we, people, won't be editing our video, but AI tools like Claude will do everything from cutting out silences to adding transitions to adding cool zooms, b roll, etcetera. The thing is that future is already here. Just last week, I went viral on Twitter by sharing a clipping tool that turns long form content into short form content. I made that in an hour using Claude. My video on Remotion where you can use Claude to generate motion graphics and you no longer need motion graphic skills to add to your videos is now 20,000 views. And some of my favorite creators like Renee are already editing their YouTube videos using Claude. Renee is actually the one who put me on to using Claude for video editing. I've since personalized my workflow a little bit, but credits due where it's due. In this video, I'm sharing my end to end workflow using Claude to edit my videos. I'll go over how it does things like cutting silences, ums and ahs. It'll find places to add b roll as well as generate said b roll either using tools like c dance or in our case, Remotion. We're gonna create motion graphics. I'll show you how you can easily add photos, sounds, etcetera without going into your editor and actually finding the spots to add them. And I'll hint at how you can turn longer form content into social short form content. You'll also learn how in this age of agentic editing, you can avoid all of your videos looking the same as other people's videos by making sure that you use sounds that only you know or memes that are really niche or or really specific references. Let's get into the workflow. Okay. Step one of my video editing process is making a rough cut, a big cut to remove any silences, 00:01:38.145 --> 00:01:39.025 repetitions, 00:01:39.025 --> 00:01:39.745 mistakes, 00:01:39.985 --> 00:01:58.430 filler words, etcetera. I created a skill for this that you can give to Claude or Codex, whatever you're using. It removes all silences, etcetera, and makes a cut while preserving laughter for comedic effect. So I'm gonna show you how to use this skill in Claude. We're just gonna open Claude, and then we're gonna go cut video. 00:01:58.670 --> 00:02:09.325 So just to install this, if you haven't done so already, just grab the the link to the skill and give it to Claude and say install this skill, and then you're gonna probably have to restart your terminal. 00:02:09.485 --> 00:02:14.365 So here we have cut video, and then what we need is obviously a source file or raw recording. 00:02:14.525 --> 00:02:21.740 This is a recording with my dad. It's seven and a half minutes long, and as you can see, it hasn't been cut at all. 00:02:22.220 --> 00:02:29.180 So I'm gonna give it that, and then we're gonna wait for the output. If you don't like this aggressive 00:02:29.180 --> 00:02:40.875 cut, I tend to cut all of the silences out and leave very little space just because I want my videos to be engaging to watch, then you can just prompt it and do this differently to match your editing style. 00:02:41.035 --> 00:03:02.215 Or what I did to create this skill is I actually gave it a reference video of mine initially, so it knows how I manually edit my videos. So that might be an idea for you to customize it to your editing style. Just so you know what's going on in the background, it's easier to edit. And then it uses tools like Whisper to analyze the transcript, as well as FFmpeg to look at the frames in the video, 00:03:02.455 --> 00:03:15.510 and then it's gonna decide what to cut out. Just as a time estimate, there's lucky days and unlucky days with Claude, but it takes a few minutes to make these cuts, especially if you're asking for a lot of cuts. So this is a seven minute video, 00:03:15.830 --> 00:03:21.350 and it is already running for three minutes. But again, this means you won't have to manually 00:03:21.350 --> 00:03:23.590 touch a video editor ever again, 00:03:23.830 --> 00:03:55.985 which I think is great. Especially if you build agents around this, you can just give your raw cuts and give it instructions on how to cut this, and it'll do it in the background while you do other work. Alright. It has outed a video, and it reduced it by a minute and a half. Let's watch some of this to see how well it did. Number one, we're gonna guess if a photo is AI or real? Yes. Yes. Show me the picture. It's a fake. It's AI. Very good. This is a picture. Yeah. It's real? It's a go. Okay. It's AI. Okay. Remember what you talked about yesterday? Cool. So I think it did a good job of cutting things out. I can see that in the beginning, 00:03:56.225 --> 00:04:04.145 I mean, I was speaking as I was getting the camera set up. So you could also tell it to get rid of that point. Just gonna tell it to cut out 00:04:04.465 --> 00:04:28.755 the so again, it looks at transcript. So it assumes that when you're speaking, you might wanna that in there. To be honest, depending on the style of the video, I would wanna keep it in there. So you see here, it's saying check out the lights. That's good. So it's gonna drop that part where I say checking the lights, and I think it picks up on that well. Let's check if it cut it out. Okay. So we're gonna speak in this little mic. Yeah. Great. So it cut it out just based on a prompt, which is kinda crazy. 00:04:29.075 --> 00:04:38.050 Now that's step one of our editing process. So you can see this is an interview with my dad, and you may have noticed that we're showing something on screen. 00:04:38.290 --> 00:04:46.370 So I wanna overlay whatever I'm showing him on screen. He's doing an AI guessing game, basically. So I'll show you what this looks like in the video 00:04:46.785 --> 00:04:47.985 already edited here. 00:04:48.385 --> 00:05:04.880 So I'm just gonna play that, and you can see that he's looking at these photos and guessing whether or not they're AI. I kinda wanna give Claude the slide deck where I have all of these photos just because I'm a little bit lazy. So here is my quiz that I made for my dad. I'm just gonna share this and make it accessible 00:05:05.040 --> 00:05:05.920 for everyone. 00:05:06.240 --> 00:05:07.840 And so I'm gonna tell Claude, 00:05:07.920 --> 00:05:08.800 extract 00:05:09.440 --> 00:05:11.440 all of the our images 00:05:11.680 --> 00:05:19.705 in this slide. So I'm saying that it should put it in my assets folder. I have an assets folder where I save things like screenshots 00:05:19.865 --> 00:05:20.585 or, 00:05:20.745 --> 00:05:23.625 yeah, funny photos that I wanna use in 00:05:23.865 --> 00:05:47.155 videos, as well as videos or sounds that I can give Claude while I'm editing. Funnily enough, I just created a Slack bot where I just drop any screenshot into, and then it saves it to that assets folder. So this way, whenever I'm working on a project and I see a fun screenshot or a stat or anything that I need for a video project, I save it to my finder, 00:05:47.315 --> 00:05:56.640 and then Claude can easily access that. I forgot to give it my Google Slide link, so I'm gonna do that now. Right. So here we can see that it created a folder called projects. 00:05:56.880 --> 00:06:03.040 I'm gonna move that to projects soon, but we'll see when we open this, we have some PDFs, 00:06:03.120 --> 00:06:30.360 and it's probably gonna extract the photos from that PDF and cut them. And then we'll see that we can magically overlay all of these photos at the exact right time stamps. Now this process is a bit longer than it would have been in the beginning because as I was editing this video manually, I was saving all of these photos to my computer. I just wanted to show you that you can literally give it any format, a PDF or anything else, and it can extract photos for you to use as well. So you can do this with logos, 00:06:30.520 --> 00:06:33.480 with anything you want. So here we have the raw, 00:06:33.800 --> 00:06:46.455 and it's outputted that. I wanted to get rid of the the white padding, so I'm gonna just ask it to do that. So we can see it also recognizes what's on the slide. So it obviously took all of the slides out of the PDF, 00:06:46.455 --> 00:06:49.150 but it sees that not every slide contains a photo. 00:06:49.470 --> 00:07:12.705 So hopefully, it's just gonna grab the photo once. Alright. Live. We're seeing that it's cropping all of these images. So that saved me a lot of time finding these images again. Great. And now we're gonna tell it to overlay the image for maybe a second or three, two to three, right before my dad needs to guess what the image is. But I just wanna show you that step two of overlaying images is very much possible 00:07:12.865 --> 00:07:23.240 with Claude editing without doing any manual work. We can see here that it's mapping the 20 photo moments, slides one to 20, to when my dad is doing the guessing. 00:07:23.640 --> 00:07:27.400 So let's take a look at these overlays. That's where the game starts. 00:07:27.720 --> 00:07:34.435 Number one, we're gonna guess if a photo is AI or real. Right. Yes. I will. Yes. Show me the picture. It's 00:07:34.915 --> 00:07:36.515 fake. It's AI. 00:07:36.515 --> 00:07:49.970 Good. This is a picture. Yeah. It's real? It's real. Okay. It's AI. Okay. Remember what we talked about yesterday? Okay. So here, it looked at the transcript and mistakenly added an overlay, but that's an easy fix. We just need to tell it to move that one. 00:07:50.770 --> 00:07:51.730 This is 00:07:52.290 --> 00:07:55.650 I think I I too, but it could be real because it existed. 00:07:56.115 --> 00:08:20.680 You can see here that it actually overlaid that one at the right moment. So it did well for the majority of these. I looked at the the video. And for any ones that are not aligned well or like come at the wrong moment, you could just say it should move that. But that should show you that you can add any image to a specific time stamp. So so even if you are going through your video like this, no longer in an editor, you say, hey, at minute one fifty six, I wanna add this image. 00:08:21.000 --> 00:08:32.345 And then you just refer to your assets library, and it's gonna add that image. So my third step in this case would be to add sound effect. So I'm just gonna show you how I'm gonna use the Duolingo 00:08:32.345 --> 00:08:45.570 correct sound to add to my video whenever my dad gets something correct, and then I'll do the wrong sound if he gets it incorrect. And I'm gonna show you exactly how I save a sound effect from YouTube. I give it to my Slackbot, 00:08:45.570 --> 00:09:02.505 and then it saves it to my sounds folder. So I'll only have to save this once in my life. My Slackbot recognizes what it is, so it's gonna say it's the Duolingo sound, and I'm then always gonna be able to refer to it. Alright. So I'm gonna go to my Slack bot, and I'm gonna copy paste the Duolingo sound effect link. 00:09:02.745 --> 00:09:13.840 And then it's gonna pick up on what this is. In this case, it's a sound effect. It's gonna automatically save it as we can see here. It's gonna save it directly to my sound effects asset folder. 00:09:13.840 --> 00:09:16.240 So here we have it. It's gonna open 00:09:16.320 --> 00:09:23.280 here, but that's fine. Now we're gonna tell Claude to add the Duolingo sound effects to whenever my dad is correct in the video. 00:09:25.415 --> 00:09:27.655 And then find it in my 00:09:27.975 --> 00:09:30.855 assets folder under sounds. 00:09:31.175 --> 00:09:39.860 Let's see if it applied the Duolingo sound effects whenever he gets something right. So let's play this first one. It's a fake. It's AI. 00:09:39.860 --> 00:09:44.580 Good. Very good. It's AI. Nice. So it applies the whenever 00:09:44.900 --> 00:10:28.635 he's right. Just always make sure to do a double, triple check, especially if he's doing a lot of them. Like, is or he Claude is basing himself off the transcript, and sometimes it's kinda hard to tell where to add it. But he did a good job of adding those sound effects. So that was step three. I showed you how to add sound effects. I wanna show you in a similar technique using my Slack bot how I can save a meme and then use that in my videos. So I'm just gonna go to Slack, and I'm gonna drop this link in there, and it's gonna download it as a video. And then that way, I have the confused math ladies meme in my assets folder forever. Let's head over to my assets folder. Again, you'll you're seeing this is turning into the holy grail. 00:10:28.875 --> 00:10:32.715 And here we can see it described as confused 00:10:32.340 --> 00:10:33.460 math lady. 00:10:33.620 --> 00:10:35.140 We can actually play that. 00:10:36.820 --> 00:10:42.980 I kinda wanna use this meme after my dad's confused about something. And and as it's older. 00:10:43.300 --> 00:11:01.560 And and to make my life a little bit easier, I'm gonna have some manual intervention where I wanna add it to a specific moment in the video. So let me just rewatch this and find the specific time stamp that I wanna add it. Okay. I think it'd be funny to add it at around the 01:50 mark. 01:50 00:11:01.800 --> 00:11:35.890 mark. So let's see how it does, and it's gonna play that meme. Of course, you can also cut the meme. You can shorten it. Just tell it to shorten it or only include a small excerpt of a video. So here, it's gonna search for that meme in my assets folder, and it's gonna add it. The best way, in my opinion, to edit with Claude is to do a lot of the prep work where you source all of the screenshots or the memes that you wanna use, and then it can just go into one folder in your finder and add those where it thinks it's right. Let me just head over to the one fifty mark. Here we go. Was it? 00:11:41.245 --> 00:11:41.885 Yeah. 00:11:42.365 --> 00:12:06.440 So great job adding the meme at actually corrected one forty six instead of one fifty because it noticed that my dad was the most confused there. So you can see Claude's already doing good thinking here. Alright. Next part of editing might be to add fun transitions between clips, or I kinda wanna add zooms on my face or my dad's face whenever he says something really funny to 00:12:06.680 --> 00:12:08.760 one of the two speakers 00:12:09.240 --> 00:12:10.695 when ever something 00:12:11.015 --> 00:12:12.855 funny happens or 00:12:12.855 --> 00:12:13.975 awkwardness. 00:12:14.135 --> 00:12:39.015 So let's see how it does there. You could also give it cinematic terms like use a Ken Burns effect, which just zooms into something slowly. You could also say you wanna add a harsh zoom and just kind of play around with how you like to edit your videos. Again, if you have a lot of reference videos, maybe you found on YouTube, from other people's editing, or your own, then you can ask Claude to describe 00:12:39.175 --> 00:12:49.910 what those cuts are or what those effects are that are being used. Okay. Let's have a look at these zooms that it did or not. It did a few. Let's see towards the end here. 00:13:04.095 --> 00:13:06.175 Are you an Unc? No. I am. Okay. I 00:13:06.495 --> 00:13:20.790 think this did an okay job, but I think I I need to be a bit more specific with the the times I wanted to zoom in. He'd actually gave us a list here of when it zooms in. No. It's not the last one. Let's look at 03:15, and let's see if I agree with that. 00:13:21.590 --> 00:13:22.230 Very 00:13:23.750 --> 00:13:26.550 good. Do you know who it is? Don't worry. He 00:13:26.550 --> 00:13:27.830 was prepared. Yeah. 00:13:28.470 --> 00:13:43.375 So at this moment, that was actually a really good idea to zoom to my dad's face because he was arguing with me. So you can definitely look at your video and say, I would have added Zooms whenever my dad completes a sentence of mine. So I can say, add a Zoom to 00:13:44.255 --> 00:13:45.535 dad when 00:13:45.775 --> 00:13:46.495 rots. So 00:13:47.220 --> 00:14:00.180 that's my manual intervention there. You can actually see that it found the exact timestamp where it should add that zoom. So let's wait for the zoom. Okay. So he added that at 05:37. 00:14:00.585 --> 00:14:01.865 Let's watch that together. 00:14:02.265 --> 00:14:03.945 Because it's so addicting 00:14:04.185 --> 00:14:06.505 without learning anything. So your brain 00:14:06.985 --> 00:14:43.245 What? Very good. Important part here is to explain in as much detail as possible how you like your edits to be done and which transitions, etcetera, you'd like to use. Now before we move on to my demo of how I would edit screen recordings, specifically ones recorded in Intelli, I'm just gonna show you how we can use another skill that I've built to turn this long form video into a short form clip and actually add captions as well. So, yes, you can even add captions to this. So this completely gets rid of the need for a tool like Opus clip, which generates captions and turns something into a 00:14:43.805 --> 00:14:58.740 video. Here, it's pulling what he thinks are the funniest moments in terms of clips. I want the clip where he describes what I do, and we can select a few more if we want. But let's just do next. And then the format, I want it to be Reels format. 00:14:59.380 --> 00:15:06.515 And then and then we're gonna submit those answers. So as I said, you can get this specific Clipify clip that actually got 300 00:15:06.675 --> 00:15:23.130 stars on my GitHub. So you can get that repo there, and you can just set that up in Clon and use it for any long form to short form flow. So let's wait it to generate this, and I'll show you what the final result is. It's asking us if it wants the hard cut version, and let's do big 00:15:23.370 --> 00:15:26.970 you know what? I kinda want kinda want big bold 00:15:27.770 --> 00:15:49.700 captions. So it asks us about the format of the captions, and if you wanted our vertical video to have our faces in a split screen or if it should zoom in on me when I'm speaking, zoom in on my dad when he's speaking, and I prefer that version. Let's take a quick look at the vertical video portion of this video. Now I'd like you to describe as best you can what you think I do as a job. 00:15:50.020 --> 00:15:53.140 It's I can't describe it because I have no clue. 00:15:53.460 --> 00:16:12.735 Everybody asking me this. I don't know. He makes money to have a computer. That's accurate. That's all. You could see it clipped it here, and also you could tell it to do this on the raw recording instead of the already zoomed in version of this video. So, yeah. That was it for the non screen recording, 00:16:12.895 --> 00:16:19.590 editing your videos with Claude. There's so much you can do connecting it to tools like 11 labs as well, uh, to do narration, 00:16:19.590 --> 00:16:26.310 for example, or even connected to an AI generation video tool like Cdance to generate AI b roll. 00:16:26.550 --> 00:16:34.415 Alright. For this last portion, very quickly, I wanna show you how you can edit your screen recordings that you record in Tele using our MCP. 00:16:34.495 --> 00:16:47.820 So you can actually perform actions in Claude that are directly reflected in your Tele editor. So you're just gonna go to our docs page and find the MCP doc. And then if you haven't done so already, you're just gonna copy this and then through your terminal. 00:16:47.980 --> 00:16:50.460 Now I've already installed RMCP. 00:16:50.940 --> 00:16:52.540 So I'm just gonna open Claude, 00:16:52.780 --> 00:17:20.620 and I'm gonna show you where it is or the tools that exist. So you can obviously list your videos, etcetera. But we can also upload clips. So you can upload your own clips next to your screen recordings. You can sorry. You can cut clips. You can even get frames from your video that would be good for a thumbnail, for instance. So I just did that earlier today. You can remove filler words, etcetera. But I'm gonna show you how I'm gonna cut my video in Tala because it's super easy to do that there with AutoCut. 00:17:20.620 --> 00:17:31.775 And then I'm gonna add a b roll layout, which is super new, which is essentially layout where we add b roll. And the b roll I'm gonna add is gonna be generated in another tool called Remotion, 00:17:31.775 --> 00:17:41.930 and all of that's gonna happen in Claude. First thing we're gonna do is we're gonna grab a video. You can see here that it has no cuts applied to it. So I'm gonna remove all of these silences, 00:17:42.170 --> 00:17:44.010 remove the filler words, etcetera. 00:17:44.250 --> 00:17:51.370 I would maybe do a more clean-cut here. But here we can see that there are no gaps applied beside the base layout. 00:17:51.530 --> 00:18:02.965 So we're gonna ask Claude to go through and apply where it thinks it's would be right. We're just gonna grab the video link here, and we're gonna head over to Claude again. Layouts. Graphic 00:18:02.965 --> 00:18:03.845 generated 00:18:03.845 --> 00:18:05.365 in Remotion 00:18:05.845 --> 00:18:06.565 as b roll. 00:18:08.460 --> 00:18:27.545 I'm being I'm being purposely lazy and vague because I know what I talked about in this intro, and I always wanna add b roll in my intros to make them more exciting. So I'm gonna see if it can add b roll there to describe a process. This video was about how Bod is now editing video, 00:18:27.785 --> 00:18:38.025 and I just wanna show that with motion graphics. So let's see how well it does in our first go. I should add, if you haven't done so already, watch my video on how to generate motion graphics with 00:18:38.490 --> 00:18:43.610 Remotion because I go over the steps of installing Remotion into Claude, is super easy. 00:18:43.930 --> 00:19:00.965 But you do need to set that up before you can actually generate motion graphics in this way. So Claude will just remember Remotion as a skill, and then it can actually use it to do such things and generate b roll. So be sure to watch that first. Cool. We can see the steps here. So it's looking at the uncut transcript, 00:19:00.965 --> 00:19:10.110 and it's checking for b roll moments. It's gonna generate the motion graphic. It's gonna upload that motion graphic as m before in Totella, and then it's gonna add 00:19:10.510 --> 00:19:16.750 b roll layouts with said m p four. So it's asking me yeah. It's giving me three suggestions, 00:19:16.990 --> 00:19:31.225 and I like the idea of messy files flying in and then going into organized folders, and then I'm gonna go with fast and submit those answers. Getting the motion graphic, and then it's gonna upload it as an m before to the b roll segment, 00:19:31.465 --> 00:19:32.585 which is new, 00:19:32.745 --> 00:19:48.400 and you should try. Alright. Supposedly, it has generated these layouts, so let's have a look together. We're just gonna have to always refresh our page whenever we add changes. So here we can already see it applied our new b roll layout. So let's play this together. 00:19:48.480 --> 00:19:49.280 First impressions. 00:19:54.125 --> 00:19:57.485 So fun. Okay. So generated that in Remotion, 00:19:57.565 --> 00:20:26.845 and then it added that as I was describing this. So this was about my Slack bot and how basically I created this assets folder. I think this is a really cool way of just being able to edit your screen recordings that you make. This was just a small example of things you can do in our MCP. It's still work in progress, but I'm gonna be playing around with it over the coming weeks, and I'd love some of you to play around with it as well. I'm gonna show you second thing that the MCP can do. So we're just gonna say, find frames in this 00:20:27.085 --> 00:20:29.405 video of my full face 00:20:29.645 --> 00:20:30.925 that I could use 00:20:31.405 --> 00:20:32.445 as a 00:20:32.685 --> 00:20:33.725 YouTube thumbnail. 00:20:34.240 --> 00:20:38.560 Let's see. It can actually get frames as well from Tella directly. 00:20:38.640 --> 00:20:43.040 So I'm just gonna see if it can find that from the camera source file, 00:20:43.360 --> 00:20:45.440 and then it's gonna save that to our 00:20:45.840 --> 00:20:51.485 it's selecting for wherever my eyes are pointing forward because I know I don't always do that when I'm filming, 00:20:51.805 --> 00:21:08.050 and I expect it to return some frames that I can use. It says it found the winner killer shot, which I'm animated. My mouth is open, so let's see what it comes up with. Okay. In all fairness, I did interrupt Claude because it was taking too long, but look at these thumbnails that it found. Using Tella's MCP 00:21:08.130 --> 00:21:45.040 now lets you edit your videos using Claude. And what this opens up is that you can integrate many more tools into your editing process, not just Tella, not just CapCut, not just one tool by having it all be in AI model. I hope you liked this introduction to how I edit my videos with Claude. There's a long way to go. As you saw, sometimes we run into some slowness issues, some understanding issues. As you start to edit your videos with Claude, you're gonna become much better at defining technically how it is you like to edit. So it removes all manual work, which we all hate, and it just becomes more of a conversation, which I've really liked. I'm gonna link all of the skills that I used below 00:21:45.280 --> 00:21:56.825 so you can add them to your own Claude and play around with. And then if you like this video, please be sure to subscribe. A lot of time goes into these videos, and I'd really love to have you around. I'll see you for the next video.