dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-28 16:25:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

copy

Browse source
This commit is contained in:
Paul Gauthier 2024-11-23 20:27:43 -08:00
parent 1d09e96127
commit e56651e5c0
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
aider/website/_posts/2024-11-21-quantization.md
View file

@ -1,6 +1,6 @@
--- ---
title: Quantization matters title: Quantization matters
excerpt: Open source LLMs are becoming very powerful, but pay attention to how you (or your provider) is quantizing the model. It can strongly affect code editing skill. excerpt: Open source LLMs are becoming very powerful, but pay attention to how you (or your provider) is quantizing the model. It can affect code editing skill.
highlight_image: /assets/quantization.jpg highlight_image: /assets/quantization.jpg
draft: false draft: false
nav_exclude: true nav_exclude: true
@ -14,7 +14,7 @@ nav_exclude: true
Open source models like Qwen 2.5 32B Instruct are performing very well on Open source models like Qwen 2.5 32B Instruct are performing very well on
aider's code editing benchmark, rivaling closed source frontier models. aider's code editing benchmark, rivaling closed source frontier models.
But pay attention to how your model is being quantized, as it But pay attention to how your model is being quantized, as it
can strongly impact code editing skill. can impact code editing skill.
Heavily quantized models are often used by cloud API providers Heavily quantized models are often used by cloud API providers
and local model servers like Ollama or MLX. and local model servers like Ollama or MLX.