Developing those things: how to solve the problem of long-time encoding and decoding of RK chip video processing?

Streaming video live includes the following steps ： collection —> Handle —> Coding and encapsulation —> Push stream to server —> Server stream distribution —> Player streaming .

In the process of streaming media processing and coding , There will be two playback modes: hard decoding and soft decoding . The difference between the two is , Hard decoding is to use the special decoding chip on the hardware device to speed up decoding . Generally speaking , The decoding speed of hard decoding is relatively fast , But there is also another problem , That's compatibility . As hard decoding is implemented by various hardware manufacturers , Uneven quality , So it is easy to have compatibility problems .

Soft decoding uses CPU The computing power to decode , If CPU The ability is weak , Then the decoding speed will be slow , And the equipment will also produce heating and other phenomena , But because of the unified algorithm , So the compatibility is good . For the same platform , The same hardware environment , Hardware coding is faster than software coding ,CPU Lower occupancy , So under the condition of hardware coding , Try to use hardware coding .

When testing products, technicians found , stay RK Used in Ruixin micro mpp When hardware encoding and decoding , Will decode the yuv Data is copied through memory function memcpy, It takes a long time to copy , about 80-100ms , This will cause the decoded data speed to fall behind , It will affect the playback effect .

In this case , We also provide a solution . The process here is 264->yuv->jpeg, for fear of yuv Data copying takes time , The new interface input parameter is H.264 data , Frame frequency , A reference to jpeg data . because yuv Direct use of data mpp Of memory , This operation reduces memory movement , Therefore, the encoding and decoding time is greatly reduced , Meet business needs .

As a family, it originated from EasyDarwin Open source framework for technology-based enterprises , In the development process , We are also happy to communicate code technology with all technology development enthusiasts 、 Share development experience , To provide you with some small reference .

TSINGSEE Qingxi video focuses on the research and development of video streaming media technology , In terms of video capabilities and services , Continuous combination AI、 big data 、 Edge of computing 、 Internet of things and other emerging technologies , Enrich platform function modules , Reach the diversified needs of users . At present, we have launched diversified video platforms for the market , Such as EasyCVR、EasyGBS、EasyDSS、EasyNVR etc. , It can realize the access of multiple types of equipment 、 Multi protocol support 、 Multi format video stream output 、 Multi terminal platform compatibility . Interested users can go to the demonstration platform for experience or deployment testing .