Shotcut 24.10 Open-Source Video Editor Adds Initial AI Feature

[phoronix]

Phoronix: Shotcut 24.10 Open-Source Video Editor Adds Initial AI Feature

Shotcut 24.10 is now available as the latest feature release to this open-source, cross-platform video editor built atop the MLT framework, Qt6, FFmpeg, SDL, and other software components...

https://www.phoronix.com/news/Shotcut-24.10-Released

[RejectModernity]

Is this shotcut thingy good? Is it better than kdenlive?

[eszlari]

Is this shotcut thingy good? Is it better than kdenlive?

AFAIK it's much faster than kdenlive, since it supports GPU effects. The maintainer of shotcut is also the maintainer of MLT.

[sophisticles]

This is the best open source NLE and works equally well on Windows and Linux, in fact I would say it works a bit better on Windows due to better hardware encoding support.

While this new AI feature is nice, I would like to see AI upscaling or video enhancement that is NPU accelerated.

Still this is legally free and works well, so can't really complain.

[acobar]

I use it to edit audio. Could use some DAW app, but shotcut is simple and straight enough to do what I need, cuts and simple effects.

[Quackdoc]

While I'm not the biggest fan of shotcut, I do find it the second best free video editor. This is a really nice feature "By making use of OpenAI's Whisper and the Whisper.cpp open-source project, there is now AI-driven speech-to-text support integrated in this video editor." This is dope, I don't see myself using this as I already have a pipeline to generate subtitles by using whisper.

I use whisper all the time, It's phenomenal. easily the best speech to text I have ever used. Glad to see shotcut get this feature.

[TheDcoder]

While I'm not the biggest fan of shotcut, I do find it the second best free video editor.

What's the first one?

[stormcrow]

This is the best open source NLE and works equally well on Windows and Linux, in fact I would say it works a bit better on Windows due to better hardware encoding support.

While this new AI feature is nice, I would like to see AI upscaling or video enhancement that is NPU accelerated.

Still this is legally free and works well, so can't really complain.

Caution. While the Whisper code and "model weights" are lic. MIT, I don't see any way of auditing the source material those language models were trained on. This could still be a legal landmine given the state copyright is in today.

[ehansin]

What's the first one?

First thought I had as well Obviously an opinion - but I come here for opinions, investigate, then form my own opinions!

[Quackdoc]

What's the first one?

Olive video editor, The compositing is done completely in GPU with full OCIO colormanagement. It properly handles associated alpha, with custom OCIO configs you can do HDR, color manage from different cameras. The node based editing is basic but very powerful, It can be great for simple things but more complicated effects are not beginner friendly. I currently use a PR which allows me to use custom GLSL shaders for effects when I need something more complex.

But for me it's more or less perfect. It's simple to use in most cases, powerful when you need it to be, and unlike pretty much every other single foss video editor, it has proper color management support which is crucial for me. And perhaps most importantly working with it is bloody fast. I can edit 4k video on my ryzen 2600 + arc a380 without much issues at all as it has a powerful cache (uses EXR), render resolution and render depth can be changed (f32 f16 u16 u8) (u8 render changes the cache format from EXR to jpeg).

Development on 0.2 is stalled because the dev is working on porting it from QT to Godot for the UI. QT has proved too troublesome and godot work will make vulkan more viable.

EDIT: It has a lot of downsides, working with audio for instance kinda sucks, supplying your own ocio config is bugged if you do it via UI, and so you need to start olive using OCIO env var instead, it's missing a lot of effects (the GLSL PR has accompanying files that adds a lot of them back) etc. But even with the MANY downsides of olive, the benefits of olive make it just too good for me to use anything else.