RK3588 – Implementing a Vectorscope for processing video in real time

(jas-hacks.blogspot.com)

55 points | by zdw 6 days ago ago

10 comments

  • 3abiton 2 days ago ago

    The previous post about using the RK3588 as an hdmi analyzer is a nice read! I am looking into the Orange Pi 5 Plus as a stream media device, that would output videa and audio streams seperately on each of its 2 hdmi out port, but now give that it supports HDMI input, I wonder if it's possible to make it act as a "Audio Extractor" by taking my gaming console PC feed and splitting it into 2.

  • kamma4434 2 days ago ago

    I wonder why you should have a vectorscope in real time if the point is showing histograms to humans.

    As the image does not change much frame to frame, I presume that if you compute it and display it every fifth frame or so, nobody would ever notice.

    • dylan604 2 days ago ago

      wait, are you saying that someone that was trained on how to use a vectorscope would not notice the image not changing frame by frame in real time? that is absolutely ludicrous. i grew up using waveforms/vectorscopes/audio phase meters, and seeing 1/5 of the data would drive me crazy. that would be like watching streaming video with buffering problems. we no longer use RealMedia for a reason

    • dragontamer 2 days ago ago

      Well it's clearly some kind of strange requirement to require a relatively low power and specifically the RK3588 instead of any other chip or even Desktop chip.

      It's a lot of work for some processor likely using less than 5W of power. Impressive for sure but now I'm curious what application this is for in general.

      Who needs to do this but doesn't want to use a far more powerful cell phone or laptop processor?

      -------

      Not to hate on the work at all! It's clearly a lot of effort to get this to run on such a relatively small chip.

      Maybe it's just exercise to learn how to use OpenGL on such a small platform for GPGPU compute? Might be good reason enough to try to accomplish??

      • Aurornis 2 days ago ago

        > Well it's clearly some kind of strange requirement to require a relatively low power and specifically the RK3588 instead of any other chip or even Desktop chip.

        RK3588 has 4K @ 60Hz HDMI input built in to the chip. Install the Linux distribution, attach HDMI cable, and you can pipe HDMI input into v4l2 or any other destination. No messing with capture cards, powered USB hubs, or 3rd-party drivers.

        > Who needs to do this but doesn't want to use a far more powerful cell phone or laptop processor?

        It's a fast chip. Fast enough. Convenience of the small all-in-one solution is more important than using the fastest chip you can find.

        • bobmcnamara 10 hours ago ago

          Ooof, v4l2 adds an extra frame of latency right off the top.

      • reassembled 2 days ago ago

        The RK3588 is actually quite powerful. It is capable of running much heavier video workloads than this. OBS runs very well on it although it does not yet make use of the RockChip’s built-in media accelerator. It’s capable on paper of 16 streams of 1080p30 H264. Check out this blog post (not my own): https://jas-hacks.blogspot.com/2023/01/rk3588-decoding-rende...

      • shadowpho 2 days ago ago

        This is probably development for a tool to light up LED to match up with input video. So cost is a big concern and Rk3588 is already one of the beefier/expensiver options

      • NewJazz 2 days ago ago

        Rk3588 was originally designed with smart screens as one possible use case. That's why it has an HDMI input on board (and several video outputs).

      • luma 2 days ago ago

        If the chip is getting the job done and it's a fixed-function device, why would one want to spec a more expensive, more power hungry solution in its place?

        I don't think "minimum required hardware" is a "strange requirement", in fact it's essentially ALWAYS the requirement when developing embedded solutions.