#quantization

Honey I shrunk the AI : Quantizing LLM's for Edge Hardware

One could argue that humanity’s rise to power on this planet came from its ability to walk on two legs, or the ability to throw sharp rocks at food, or even the ability to touch, hear and see at a deeper level than any other animal. However, one abil...