Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
24
28
55
Marc Sun
marcsun13
Follow
tonywu71's profile picture
linoyts's profile picture
giadap's profile picture
75 followers
·
127 following
_marcsun
SunMarc
AI & ML interests
LLM, Quantization, Training, Inference
Articles
quanto: a pytorch quantization toolkit
Mar 18
•
15
Overview of natively supported quantization schemes in 🤗 Transformers
Sep 12, 2023
•
7
Making LLMs lighter with AutoGPTQ and transformers
Aug 23, 2023
•
13
Organizations
models
9
Sort:Â Recently updated
marcsun13/Mixtral-8x7B-v0.1-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
2
marcsun13/Mixtral-tiny-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
17
marcsun13/Llama-2-13B-AWQ
Text Generation
•
Updated
Nov 6, 2023
•
1
marcsun13/opt-125m-awq
Text Generation
•
Updated
Oct 30, 2023
•
1
marcsun13/opt-350m-gptq-4bit
Text Generation
•
Updated
Jul 31, 2023
•
333
marcsun13/gpt2-xl-linear-sharded
Updated
Jun 30, 2023
marcsun13/gpt2-xl-linear
Updated
Jun 28, 2023
marcsun13/bloom-1b7_with_lm_head
Text Generation
•
Updated
Jun 21, 2023
•
3.36k
marcsun13/dummy-model
Fill-Mask
•
Updated
May 23, 2023
•
1
datasets
None public yet