{"id":47350480,"title":"Show HN: I built proxy that keeps RAG working while hiding PII","points":4,"user":"rohansx","time":1773323180,"time_ago":"4 days ago","type":"link","content":"

Hey HN,

When you send real documents or customer data to LLMs, you face a painful tradeoff:

- Send raw text → privacy disaster \n- Redact with [REDACTED] → embeddings break, RAG retrieval fails, multi-turn chats become useless, and the model often refuses to answer questions about the redacted entities.

The practical solution is consistent pseudonymization: the same real entity always maps to the same token (e.g. “Tata Motors” → ORG_7 everywhere). This preserves semantic meaning for vector search and reasoning, then you rehydrate the response so the provider never sees actual names, numbers or addresses.

I got fed up fighting this with Presidio + custom glue (truncated RAG chunks, declension in Indian languages, fuzzy merging for typos/siblings, LLM confusion, percentages breaking math). So I built Cloakpipe as a tiny single-binary Rust proxy.

It does:\n• Multi-layer detection (regex + financial rules + optional GLiNER2 ONNX NER + custom TOML)\n• Consistent reversible mapping in an AES-256-GCM encrypted vault (memory zeroized)\n• Smart rehydration that survives truncated chunks like [[ADDRESS:A00\n• Built-in fuzzy resolution for typos and similar names\n• Numeric reasoning mode so percentages still work for calculations

Fully open source (MIT), zero Python dependencies, <5 ms overhead.

Repo: https://github.com/rohansx/cloakpipe \nDemo & quick start: https://app.cloakpipe.co/demo

Would love feedback from anyone who has audited their RAG data flow or is struggling with the redaction-vs-semantics problem — especially in legal, fintech, or non-English workflows.

What approaches have you landed on?","url":"item?id=47350480","comments":[{"id":47379921,"level":0,"user":"aminerj","time":1773514717,"time_ago":"2 days ago","content":"

[flagged]","dead":true,"comments":[]},{"id":47351543,"level":0,"user":"ozgurozkan","time":1773327429,"time_ago":"4 days ago","content":"

[flagged]","dead":true,"comments":[]}],"comments_count":2}