Project
Systems of Ashish
LLM Inference Engine in Rust
A Rust-based LLM inference engine focused on efficient model execution, token generation, and low-level systems performance.
rustllminferencesystems
Systems of Ashish
A Rust-based LLM inference engine focused on efficient model execution, token generation, and low-level systems performance.
More things from the same systems rabbit hole.
🚀 Introducing NamasteScreen: The Launcher That Fights Phone Addiction! 🇮🇳 🔥 Inspired by my conversation with Hon'ble Prime Minister of India Narendra Modi about Digital Well-Being
This was converted into research by University of Waterloo
A branching conversation application for LLMs that stores chat as a tree, letting you fork conversations, regenerate responses, and explore multiple dialogue paths with Ollama.