Difference between revisions of "Mainline Hardware Encoding"
(fixes) |
Link Mauve (talk | contribs) (→SoC Support: JPEG encoding is supported on the rk3588 since Linux 6.12.) |
||
| (One intermediate revision by one other user not shown) | |||
| Line 16: | Line 16: | ||
| style="background:PaleGreen; text-align:center;"| Yes | | style="background:PaleGreen; text-align:center;"| Yes | ||
| style="background:PaleGreen; text-align:center;"| Yes | | style="background:PaleGreen; text-align:center;"| Yes | ||
| style="background: | | style="background:PaleGreen; text-align:center;"| Yes | ||
|- | |- | ||
! scope="row" | VP8 | ! scope="row" | VP8 | ||
| style="text-align:center;"| N/A | | style="text-align:center;"| N/A | ||
| style="background:LightYellow; text-align:center;"| | | style="background:LightYellow; text-align:center;"| RFC<sup>[https://lore.kernel.org/linux-rockchip/20230309125651.23911-1-andrzej.p@collabora.com/T/]</sup><sup style="font-style:italic;color:green">a</sup> | ||
| style="background: | | style="background:LightYellow; text-align:center;"| RFC<sup>[https://lore.kernel.org/linux-rockchip/20230309125651.23911-1-andrzej.p@collabora.com/T/]</sup><sup style="font-style:italic;color:green">a</sup> | ||
| style="background:#F99; text-align:center;"| No | | style="background:#F99; text-align:center;"| No | ||
|- | |- | ||
| Line 27: | Line 27: | ||
| style="background:#F99; text-align:center;"| No | | style="background:#F99; text-align:center;"| No | ||
| style="background:#F99; text-align:center;"| No | | style="background:#F99; text-align:center;"| No | ||
| style="background:#F99; text-align:center;"| No | | style="background:#F99; text-align:center;"| No<sup style="font-style:italic;color:green">a</sup> | ||
| style="background:#F99; text-align:center;"| No | | style="background:#F99; text-align:center;"| No | ||
|- | |- | ||
| Line 36: | Line 36: | ||
| style="background:#F99; text-align:center;"| No | | style="background:#F99; text-align:center;"| No | ||
|} | |} | ||
=== Notes === | |||
<ol style="list-style-type:lower-alpha"> | |||
<li>Userspace API [https://lore.kernel.org/linux-media/ZK2NiQd1KnraAr20@aptenodytes/ under discussion] as part of the V4L2 stateless encoder uAPI development, with experimental implementations being worked on.</li> | |||
</ol> | |||
== Encoding With GStreamer == | == Encoding With GStreamer == | ||
| Line 50: | Line 55: | ||
{{hint|'''Note:''' This requires a draft [https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3736 GStreamer merge request] and the RFC kernel patchset applied.}} | {{hint|'''Note:''' This requires a draft [https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3736 GStreamer merge request] and the RFC kernel patchset applied.}} | ||
{{note|'''Note:''' Patchset no longer applies cleanly, as AV1 decode controls were introduced and conflict.}} | |||
This example converts an input MP4 file to an output VP8-inside-MKV file with a quantiser between 12 and 28, without any audio. The quantiser value goes from 0 (best quality, biggest filesize) to 63 (worst quality, smallest filesize). | This example converts an input MP4 file to an output VP8-inside-MKV file with a quantiser between 12 and 28, without any audio. The quantiser value goes from 0 (best quality, biggest filesize) to 63 (worst quality, smallest filesize). | ||
Latest revision as of 15:27, 11 December 2024
Mainline Hardware Encoding of video can be achieved through the V4L2 user-space API, for which currently only GStreamer implements the required code.
SoC Support
The following table shows the current supported codecs for encoding for each SoC. Support for decoding is separate.
SoC Codec
|
RK3328 | RK3399 | RK3566 | RK3588 |
|---|---|---|---|---|
| JPEG | N/A | Yes | Yes | Yes |
| VP8 | N/A | RFC[1]a | RFC[2]a | No |
| H.264/AVC | No | No | Noa | No |
| H.265/HEVC | No | N/A | No | No |
Notes
- Userspace API under discussion as part of the V4L2 stateless encoder uAPI development, with experimental implementations being worked on.
Encoding With GStreamer
With GStreamer, in general, any V4L2 control can be set using the extra-controls=foo,name=value syntax after the encode pipeline stage identifier, where foo is any name you wish which GStreamer will promptly ignore, name is the name of the V4L2 control as shown by v4l2-ctl --list-ctrls (make sure to pick the right device with -d), and value is whatever value you want to set it to.
JPEG Encoding
This example converts an input MP4 file to an output MJPEG-inside-MKV file at JPEG quality 95, without any audio.
gst-launch-1.0 filesrc location=input.mp4 ! qtdemux name=demux demux.video_0 ! decodebin ! videoconvert ! v4l2jpegenc extra-controls=s,compression_quality=95 ! matroskamux ! filesink location=output.mkv
VP8 Encoding
This example converts an input MP4 file to an output VP8-inside-MKV file with a quantiser between 12 and 28, without any audio. The quantiser value goes from 0 (best quality, biggest filesize) to 63 (worst quality, smallest filesize).
gst-launch-1.0 filesrc location=input.mp4 ! qtdemux name=demux demux.video_0 ! decodebin ! videoconvert ! v4l2slvp8enc min-quality=12 max-quality=28 ! queue ! matroskamux ! filesink location=output.mkv
Alternatively, you can encode in variable bitrate mode with a target bitrate given in bits per second. Do note that Hantro doesn't seem to do target bitrates below 2 mbit/s. In this example, the file is transcoded at a target bitrate of 3 megabits per second.
gst-launch-1.0 filesrc location=input.mp4 ! qtdemux name=demux demux.video_0 ! decodebin ! videoconvert ! v4l2slvp8enc bitrate=3000000 ! queue ! matroskamux ! filesink location=output.mkv