Linux Questions

1070 readers

1 users here now

Linux questions Rules (in addition of the Lemmy.zip rules)

stay on topic
be nice (no name calling)
do not post long blocks of text such as logs
do not delete your posts
only post questions (no information posts)

Tips for giving and receiving help

be as clear and specific
say thank you if a solution works
verify your solutions before posting them as facts.

Any rule violations will result in disciplinary actions

founded 1 year ago

MODERATORS

[email protected]

[SOLVED] Ffmpeg makes choppy videos when recording audio (kbin.social)

submitted 8 months ago* (last edited 8 months ago) by [email protected] to c/[email protected]

8 comments fedilink hide all child comments

Well, my issue is simple to explain, but I tried everything to solve it without success.

I like recording gameplays, just for fun. The game I currently make recordings for is not resource heavy (it's Doom 2 through GZDoom). I'm using Lubuntu 22.04.

So, here is the command I've just used:

ffmpeg -f x11grab -draw_mouse 0 -framerate 30 -probesize 42M -video_size 1920x1080 -i :0 -f pulse -i default -c:v libvpx-vp9 -r 30 -g 90 -quality realtime -frame-parallel 1 -qmin 4 -qmax 48 -b:v 4500k -c:a libvorbis prueba.mkv

The issue is, if I record without including the audio, then the video plays smoothly after being recorded. But if I record including the audio, no matter what parameters, codecs, bitrate or anything I use, then the video is barely watchable, with lots of choppiness, and even with delay between audio and video, apparently.

SimpleScreenRecorder works fine, but sometimes there are few frames dropped and I don't like it much. OBS is very heavy for my hardware (Mac Mini 2016, Intel Core i5 1.4 GHz 4260U, Intel HD Graphics 4000, 4 GB RAM).

I also tried VAAPI, with same results as above.

And the thing is that I remember recording some years ago, with no issues at all.

I don't know what to do. Any tip or solution?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 8 months ago (1 children)

Does top/htop/whatever show a large difference between encoding with and without audio? Do e.g. the pulse processes hog resources for some reason?

Do you get smooth recording if you reduce the screen resolution and do something that uses minimal resources (e.g., play Tetris at 640x480)?

[–] [email protected] 2 points 8 months ago (1 children)

Depending exclusively on the codecs I use, htop shows a CPU usage of 90-100% or 10-20%. So, I use those that don't require a huge CPU usage. Memory and Swap are not affected, as far as I know. But despite those circumstances, the outcome is the same. Recording with no sound = smoothness, 60 fps, recording with sound = choppiness, 10 fp5s.

Something I also noticed is that it also happens before I open Doom 2, so it doesn't matter whether I'm playing or not. Even with just the terminal and the file manager open.

[–] [email protected] 1 points 8 months ago (1 children)

Crazy idea, but what happens if you record audio and video with different ffmpeg processes? Just for debugging this might be useful to try. Perhaps there's something funny about the timestamps you're receiving from Pulse that causes weird behavior (or something along those lines).

Also, you mentioned this works better with other software

any idea if those settings are drastically different than your ffmpeg settings?

I have no idea what I'm talking about though, just throwing out ideas :)

[–] [email protected] 2 points 8 months ago (1 children)

Crazy idea, but what happens if you record audio and video with different ffmpeg processes?

I also tried that with the -map parameter, if that's what you mean. Same outcome.

Also, you mentioned this works better with other software — any idea if those settings are drastically different than your ffmpeg settings?

SimpleScreenRecorder is very basic, but it works well, except for some random dropped frames here and there. No big deal, but sometimes it's noticeable enough for me to feel uneasy. 1920x1080, 60 fps, PulseAudio, H.264 video codec, ultrafast preset (skipping frames) and vorbis audio codec at 128 kbps. Just that.

[–] [email protected] 1 points 8 months ago (1 children)

No, what I meant was to try recording video with ffmpeg, then open another terminal and record audio with ffmpeg. Does the video look ok when recorded like this?

Also, you said you tried various codecs, what happens if you dump the raw audio (PCM?) stream without reencoding at all?

[–] [email protected] 2 points 8 months ago (1 children)

No, what I meant was to try recording video with ffmpeg, then open another terminal and record audio with ffmpeg. Does the video look ok when recorded like this?

Well, surprisingly, it works. Video runs smoothly, and I can merge the separate audio file to it witk Kdenlive. So, I guess the problem is solved. But I don't understand why it works this way and not with a single command in one terminal.

[–] [email protected] 1 points 8 months ago

Weird! Yeah I don't understand either, but this info may help in further debugging.

Have you tried playing with the container format? I know .mkv is generally preferred but maybe try .mp4 or something else. My thinking here is that both audio and video work, but somehow muxing them is failing. Using a different container could maybe help since the muxing is different (???).

Other thing to try is of course making sure ffmpeg is up to date but it sounds like you're on top of that.

Good luck!