Add experimental support for GPTQ models (#50)
Signed-off-by:
Hung-Han (Henry) Chen <chenhungh@gmail.com>
Showing
- .github/workflows/gptq_image.yaml 46 additions, 0 deletions.github/workflows/gptq_image.yaml
- Dockerfile.gptq 11 additions, 0 deletionsDockerfile.gptq
- README.md 18 additions, 0 deletionsREADME.md
- charts/ialacol/Chart.yaml 2 additions, 2 deletionscharts/ialacol/Chart.yaml
- examples/values/llama2-7b-chat-gptq.yaml 30 additions, 0 deletionsexamples/values/llama2-7b-chat-gptq.yaml
Loading
Please register or sign in to comment