This looks awesome. Tangentially related, I'm trying to find a good lightweight handwriting & latex recognition model. Digital handwritten notes -> Straight markdown / latex. I'm at the point where I'm considering fine tuning / training a model on all of my math notes from University. That or shoving everything into Haiku 5.5. Since you seem to be a lot more familiar with this space than I am, any ideas?
It connects TeXbrain with braiNOTES over a local websocket. You give your agent tools such as "render page 3 of this notebook" or "insert this LaTeX at the end of this .tex file" and it reads the handwriting and compiles it.
The instructions for VS Code, Cursor, Codex, Claude Code or whatever you use are in the repository. Basically, everything runs on your machine, except of the model.
If you have any questions feel free to ask (or feedback/bugs!)
This looks awesome. Tangentially related, I'm trying to find a good lightweight handwriting & latex recognition model. Digital handwritten notes -> Straight markdown / latex. I'm at the point where I'm considering fine tuning / training a model on all of my math notes from University. That or shoving everything into Haiku 5.5. Since you seem to be a lot more familiar with this space than I am, any ideas?
I've made a small MCP server for this: https://github.com/swimmingbrain/brainbridge
It connects TeXbrain with braiNOTES over a local websocket. You give your agent tools such as "render page 3 of this notebook" or "insert this LaTeX at the end of this .tex file" and it reads the handwriting and compiles it.
The instructions for VS Code, Cursor, Codex, Claude Code or whatever you use are in the repository. Basically, everything runs on your machine, except of the model.
If you have any questions feel free to ask (or feedback/bugs!)
Keeping the original slide text selectable while layering handwritten ink on top is a solid design choice.