Edit Models filters

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,729

Full-text search

Active filters: 8-bit

RichardErkhov/cognitivecomputations_-_dolphin-2.8-mistral-7b-v02-8bits

Text Generation • Updated May 11 • 1

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated 14 days ago • 762 • 2

MaziyarPanahi/Llama-3-8B-Instruct-v0.9-GGUF

Text Generation • Updated 13 days ago • 12.3k • 2

Zoyd/xxx777xxxASD_L3-SnowStorm-v1.15-4x8B-B-8_0bpw_exl2

Text Generation • Updated 12 days ago • 2 • 1

tarekfer8/llama_djezzy

Text Generation • Updated 9 days ago • 82 • 1

Zoyd/DavidAU_Psyonic-Cetacean-V1-20B-Ultra-Quality-Float32-8_0bpw_exl2

Text Generation • Updated 8 days ago • 2 • 1

Moses25/Mistral-7B-Instruct-32K-GPTQ-INT8

Text Generation • Updated 8 days ago • 17 • 1

FuturisticVibes/Codestral-22B-v0.1-abliterated-v3-8.0bpw-h8-exl2

Text Generation • Updated 7 days ago • 1 • 1

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 259 • 1

bullerwins/Qwen2-72B-Instruct_exl2_8.0bpw

Text Generation • Updated 6 days ago • 5 • 1

gbueno86/Qwen2-72B-Instruct-exl2-8.0bpw

Text Generation • Updated 6 days ago • 1 • 1

FuturisticVibes/L3-Arcania-4x8b-8.0bpw-h8-exl2

Text Generation • Updated about 1 month ago • 1 • 1

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 2.81k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21 • 36 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29 • 2.72k • 2

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • Updated Nov 27, 2022 • 10 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • Updated Nov 27, 2022 • 9 • 4

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 9

ybelkada/bloom-560m-8bit

Text Generation • Updated Apr 12, 2023 • 7

ybelkada/bloom-1b7-8bit

Text Generation • Updated Apr 17, 2023 • 267 • 6

thes41d/fr-boris-8bit

Text Generation • Updated May 20, 2023 • 6

RajuKandasamy/dolly-v2-3b-8bit

Text Generation • Updated Apr 15, 2023 • 11

RajuKandasamy/dolly-v2-7b-8bit

Text Generation • Updated Apr 15, 2023 • 12

seongcho/GenerAd-AI

Text Generation • Updated Apr 21, 2023 • 1

Linus4Lyf/Llama-1epoch-Plato

Text Generation • Updated Apr 21, 2023 • 28

Linus4Lyf/Llama-5epoch-Plato

Text Generation • Updated Apr 22, 2023 • 12

Linus4Lyf/Llama-10epoch-Plato

Text Generation • Updated Apr 22, 2023 • 12

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 13 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 13 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Beauvoir_The_Second_Sex

Text Generation • Updated Apr 25, 2023 • 13