Camera board • Camera v3, Pi5 and AV processing

Hi,
I am a new Pi5 user and electronics engineer (so not a SW guy) and I am developing a project for which I must:

1/capture a video with camera v3
2/capture sound with a USB microphone
3/have the two streams (video and sound) synchronous so that I can do signal processing on each of them. So I need to have time stamps for both streams.
4/ I must therefore have a video in RAW format and a compressed video (h264 for example) at the same time.
5/ be able to generate an output video in compressed format from video data in RAW mode after signal processing.

So far, I have managed to capture audio and video, and also become familiar with the video capture configuration. But separately.

I see that there are a lot of tools (picamera2, libcamera, rpi-cam, OpenCV, FFmpeg, etc... not to mention the sound part) to do a lot of things, some less than others, and I am struggling to find my way. Picamera2 that I used seems to be a tool to access the camera only, without generating time stamps for instance....

Any suggestion is more than welcome!

THANKS !

Statistics: Posted by Paul B65 — Mon Jul 22, 2024 3:08 pm

---