Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

Models

2,420

Full-text search

Active filters: llama-cpp

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated 28 days ago • 1.46k • 29

Julia-Kovacs/SambaLingo-Hungarian-Base-70B-Q4_K_M-GGUF

Updated 11 days ago • 10 • 3

SteelQuants/L3-Aethora-15B-Q4_K_M-GGUF

Updated 5 days ago • 169 • 3

NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 169 • 3

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated 28 days ago • 1.44k • 18

AlirezaF138/Llama-3-Persian-8B-LoRA-Q6_K-GGUF

Updated 20 days ago • 160 • 3

NikolayKozloff/Qwen2-7B-Q8_0-GGUF

Text Generation • Updated 5 days ago • 128 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Apr 11 • 194 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q4_K_M-GGUF

Updated Apr 12 • 130 • 1

boxomcfoxo/YiffyEstopianMaid-13B-GGUF

Updated Apr 19 • 415 • 2

Clevyby/Silicon-Masha-7B-Q5_K_S-GGUF

Text Generation • Updated May 2 • 38 • 1

MoMonir/Llama-3-8B-Web-GGUF

Updated Apr 27 • 75 • 1

YorkieOH10/granite-8b-code-instruct-Q8_0-GGUF

Text Generation • Updated May 6 • 313 • 7

tinybiggames/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 329 • 3

VlSav/saiga_phi3_medium_sft_m1_d2-Q4_K_M-GGUF

Updated 11 days ago • 14 • 1

waltervix/Llama-3-8B-Dolphin-Portuguese-v0.3-Q4_K_M-GGUF

Updated 10 days ago • 31 • 1

NikolayKozloff/DiscoLM_German_7b_v1-Q8_0-GGUF

Updated 6 days ago • 60 • 1

newsletter/Mixtral-8x7B-Instruct-v0.1-Q6_K-GGUF

Updated 6 days ago • 103 • 1

newsletter/dolphin-2.7-mixtral-8x7b-Q6_K-GGUF

Updated 6 days ago • 68 • 1

v000000/SyntheticMoist-11B-Q6_K-GGUF

Updated 6 days ago • 12 • 1

NikolayKozloff/Llama-2-7b-Ukrainian-Q8_0-GGUF

Text Generation • Updated 6 days ago • 6 • 1

v8karlo/UNCENSORED-TinyDolphin-2.8.1-1.1b-Q4_K_M-GGUF

Updated 5 days ago • 50 • 1

v8karlo/UNCENSORED-TinyDolphin-2.8-1.1b-Q5_K_M-GGUF

Updated 5 days ago • 8 • 1

Ransss/MysticGem-v1.3-L2-13B-Q6_K-GGUF

Updated 5 days ago • 10 • 1

NikolayKozloff/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 5 days ago • 17 • 1

NikolayKozloff/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated 4 days ago • 74 • 1

NikolayKozloff/Qwen2-7B-Q6_K-GGUF

Text Generation • Updated 4 days ago • 24 • 1

NikolayKozloff/Qwen2-7B-Q5_K_M-GGUF

Text Generation • Updated 4 days ago • 21 • 1

NikolayKozloff/Qwen2-7B-Q5_K_S-GGUF

Text Generation • Updated 4 days ago • 10 • 1

NikolayKozloff/Qwen2-7B-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 19 • 1