Better Gaussian Splatting in Julia

(pxl-th.github.io)

86 points | by pxl-th 4 days ago ago

11 comments

  • Cieric a minute ago ago

    I'm still very fascinated by gaussian splatting, but the issue I always run into is the need to use colmap to generate the camera positions and get the initial point cloud. Which colmap effectively still needs Nvidia for dense point clouds last I checked. I'm curious though does anyone have anything else they've tried that worked well? I've tried a few different things (most of the time getting stuck on just compiling the thing) so I'm curious if anyone has any suggestions that I should focus more heavily on getting working. I have some poor quality videos I'd like to try and use and I'm willing to put in some manual work, but it feels like it's all automatic or nothing. Thanks for any suggestions that any of you have.

  • hdz 5 hours ago ago

    Having this work on Apple metal is huge for the accessibility around training splats. I remember two years ago I needed an RTX Nvidia GPU to run things like splatfacto on nerfstudio. Very neat optimizations as well like the depth map and sky dome, 3dgs has come a long way. Awesome!

  • mourner 4 hours ago ago

    Oh, a fellow Ukrainian! Was pleasantly surprised to see that fountain on HN — I was just walking around it a few days ago, very nice and peaceful spot this time of year.

  • miguelraz an hour ago ago

    Fantastic demos in Julia, what a treat.

  • fredley 4 hours ago ago

    I thought the picture on your home page was very cool, and then I moused over it. Absolutely incredible.

  • chrisjj 3 hours ago ago

    Better? A turn on the spot shows a wreck everywhere but forward.

    • yorwba an hour ago ago

      Those are the areas that are occluded in the input images. If you look at the bushes, you can see that the front is clean while the back is a mess. Probably the starting position could be chosen a bit better.

      • chrisjj 9 minutes ago ago

        [delayed]

    • pwf an hour ago ago

      do you know how gaussian splatting works?

  • thimotedupuch 4 hours ago ago

    Great work

  • aithena 5 hours ago ago

    this is amazing!