We built an open-source sub-microsecond Rust engine and gateway for LLM epistemic uncertainty quantification and hallucination gating: GitHub: https://github. com/Adarshent/Spnda Python SDK: pip install spnda Why we built this: Semantic Entropy (Nature 2024) is great at detecting hallucinations, ...
Source: [Hacker News](https://news.ycombinator.com/item?id=49663329)