Make AI Fit
EN

Glossary term

Quantization

One of the main ways local models get smaller and more practical to run.

Quantization means storing or running a model in a lower-precision format to reduce memory use and make local inference more practical. Category: Runtime / formats Related topics: 0 Related resources: 0

Why this term matters

It often decides whether a model fits on your actual hardware and whether a small box can stay useful instead of feeling permanently underpowered.

Examples

  • The same model may fit comfortably on one machine only after a smaller quantized variant is used.
  • Desktop-first tools often make quantized models feel normal even when the user does not yet understand the trade-offs deeply.