quantization

2 posts

cloudflare Apr 17, 2026

Unweight: how we compressed an LLM 22% without sacrificing quality (opens in new tab)

Unweight: how we compressed an LLM 22% without sacrificing quality 2026-04-17 Mari Galicer Ivan Nikulin Chris Branch Running inference within 50ms of 95% of the world's Internet-connected population means being ruthlessly efficient with GPU memory. Last year we improved memory u…

quantization database-design llm rust+4

dropbox Feb 12, 2026

How low-bit inference enables efficient AI (opens in new tab)

How low-bit inference enables efficient AI In just the past few years, large machine learning models have made incredible strides. Today’s models are not only remarkably capable but also achieve impressive results across a range of applications, from software engineering and sci…

quantization llm gpu-acceleration model-optimization+3