{"id":49787614,"title":"Show HN: Nanosamur.ai – Ollama for Voice Models (STT)","points":4,"user":"newcrobuzon","time":1790000242,"time_ago":"3 days ago","type":"link","content":"

nanosamur.ai is a speech-to-tech platform that supports different models for realtime, semi-realtime, and batch transcription and provides a unified stack for robust speech processing, agentic workflows, and webhooks.

You can run it locally on your computer via electron app + docker compose, but you can take the same stack and run it in cloud/k8s and/or on prem as it is built with scale in mind (it also has an observability stack built in). So in that sense it is more like Ollama + Ollama Cloud :)

Currently it supports whisper, qwen asr, nemotron asr and parakeet tdt and I am adding other models. I am also adding Kserve+Triton integration for the batch transcriptions so as the MLOps can be abstracted away.

Last couple of years I have been consulting for some organizations that work with sensitive data and have to keep them in air gapped environments and based on those experiences I built and open-sourced nanosamur.ai

The easiest place to start is the main repo: https://github.com/nanosamurai/nanosamurai

It is a docker compose starter setup, there are couple of services it uses, all are linked in the documentation; I used python for the voice ai services (see the xamurai monorepo) and java / clojure / clojurescript for the UI/BFF and some other services (yes, it is pg's fault i love lisps).

Appreciate any feedback! Esp. from people working with speech infrastructure, self hosted AI etc. Also it currently sits at 6 stars, so feel free to star the repos if you like them :)","url":"https://github.com/nanosamurai/nanosamurai","domain":"github.com","comments":[{"id":49791945,"level":0,"user":"iharnoor","time":1790018074,"time_ago":"3 days ago","content":"

wait did you mean speech to text? how do you standout?","comments":[]},{"id":49828544,"level":0,"user":"rason-yang","time":1790244885,"time_ago":"3 hours ago","content":"

[dead]","dead":true,"comments":[]}],"comments_count":2}