view post Post 13416 Reply I can't believe this... Phi-3.5-mini (3.8B) running in-browser at ~90 tokens/second on WebGPU w/ Transformers.js and ONNX Runtime Web! 🤯 Since everything runs 100% locally, no messages are sent to a server — a huge win for privacy!- 🤗 Demo: webml-community/phi-3.5-webgpu- 🧑💻 Source code: https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu 11 replies · 🔥 31 31 🚀 6 6 😔 2 2 ❤️ 2 2 👀 2 2 🤯 1 1 +