Edit Models filters

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,763

Full-text search

Active filters: 8-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 10 days ago • 179k • 32

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 18 days ago • 277k • 133

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF

Text Generation • Updated 9 days ago • 2.66k • 5

Zoyd/Sao10K_L3-8B-Stheno-v3.1-8_0bpw_exl2

Text Generation • Updated 8 days ago • 101 • 3

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 10k • 106

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 20 days ago • 18.8k • 10

Zoyd/openchat_openchat-3.6-8b-20240522-8_0bpw_exl2

Text Generation • Updated 6 days ago • 2 • 2

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated about 14 hours ago • 361 • 2

bullerwins/Codestral-22B-v0.1-exl2_8.0bpw

Text Generation • Updated 3 days ago • 7 • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 328 • 13

dwdcth/chatglm3-6b-int4

Feature Extraction • Updated Nov 2, 2023 • 86 • 6

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 34 • 7

01-ai/Yi-6B-Chat-8bits

Text Generation • Updated 2 days ago • 956 • 9

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 36 • 9

maitreyaz/OpenHathi-quantised-8bit-Base

Text Generation • Updated Feb 2 • 4 • 1

MaziyarPanahi/MixTAO-7Bx2-MoE-Instruct-v7.0-GGUF

Text Generation • Updated Feb 4 • 247 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 1.24k • 37

nuvocare/NuvoChat

Text Generation • Updated Apr 30 • 24 • 1

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 4.84k • 74

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 2.97k • 17

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 5.29k • 51

OpenGVLab/InternVL-Chat-V1-5-Int8

Visual Question Answering • Updated 3 days ago • 19.3k • 56

MaziyarPanahi/Llama-3-8B-Instruct-v0.7-GGUF

Text Generation • Updated 15 days ago • 1.51k • 2

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 15 days ago • 1.65k • 4

catinthebag/Kancil-V0-llama3

Text Generation • Updated 1 day ago • 103 • 3

LoneStriker/bagel-8b-v1.0-8.0bpw-h8-exl2

Text Generation • Updated 22 days ago • 3 • 2

DeusImperator/L3-8B-Stheno-v3.1_exl2_8bpw_rpcal_mk2

Text Generation • Updated 11 days ago • 38 • 1

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2-GGUF

Text Generation • Updated 9 days ago • 2.82k • 2

BigHuggyD/failspy_Llama-3-70B-Instruct-abliterated-v3-8.0bpw-h8-exl2

Text Generation • Updated 8 days ago • 1 • 1

Zoyd/CohereForAI_aya-23-8B-8_0bpw_exl2

Text Generation • Updated 8 days ago • 6 • 1