Show HN: Flide: Make Jev-like decision models up to 9.5x faster
Decision models need their own inference engine. So we developed Flide, a high-performance and exact inference engine for Jev-like decision models. Flide achieves up to a 9.5x speedup over vLLM and SGLang. It now supports 30+ popular local
Read the original at Hacker News ↗