Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/IST-DASLab below:

IST Austria Distributed Algorithms and Systems Lab · GitHub

1. Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

   Python 2.2k 179

2. FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

   Python 880 72

3. Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

   Python 825 111

5. Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".

   Python 277 22

6. Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024

   C++ 181 13

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4