Edit Models filters

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,844

Full-text search

Active filters: 8-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 19 days ago • 348k • 38

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated about 7 hours ago • 300 • 5

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated about 7 hours ago • 420 • 5

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 4 days ago • 66.7k • 5

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 4 days ago • 23.5k • 4

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 45.3k • 30

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 27 days ago • 216k • 137

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated May 10 • 472 • 4

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated 9 days ago • 49.2k • 6

Zoyd/Nitral-AI_Poppy_Porpoise-1.4-L3-8B-8_0bpw_exl2

Text Generation • Updated 6 days ago • 13 • 2

atcsecure/dolphin-2.9.2-qwen72b-8.0bpw-h8-exl2

Text Generation • Updated about 22 hours ago • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 975 • 14

Abzu/mpt-7b-storywriter-q8

Text Generation • Updated Jul 7, 2023 • 8 • 2

mychen76/codellama-7b-ocr

Text Generation • Updated Sep 16, 2023 • 2 • 1

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4 • 27 • 14

Neurai/NeuraLlama7b

Text Generation • Updated Jan 1 • 22 • 2

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30 • 95 • 4

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-8bit-smashed

Text Generation • Updated Apr 11 • 1 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 7.38k • 73

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 7.89k • 69

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 5.07k • 107

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 5.36k • 18

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 3.73k • 52

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25 • 49.2k • 10

FallenMerick/Smart-Lemon-Cookie-7B-GGUF

Text Generation • Updated May 6 • 439 • 1

themanas021/phi-3-medical-instruct-themanas

Text Generation • Updated May 7 • 206 • 1

FuturisticVibes/L3-Arcania-4x8b-8.0bpw-h8-exl2

Text Generation • Updated 28 days ago • 1 • 1

LoneStriker/aya-23-35B-8.0bpw-h8-exl2

Text Generation • Updated 18 days ago • 17 • 2

cortecs/Smaug-Llama-3-70B-Instruct-GPTQ-8b

Text Generation • Updated 15 days ago • 59 • 1

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated 12 days ago • 716 • 2