Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

I

Ialacol-build
- Activity
- Members
- Wiki
- Terraform modules

Snippets Groups Projects

28fb99a1

Unverified Commit 28fb99a1 authored 1 year ago by Henry Chen Committed by GitHub 1 year ago

Downloads
- Patches
- Plain Diff

Add experimental support for CUDA (#38)


Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com>

parent f81a5d25

No related branches found

Tags ialacol-0.7.0

No related merge requests found

Changes 11

Hide whitespace changes

Inline Side-by-side

Showing

.github/workflows/cuda_image.yaml 76 additions, 0 deletions

.github/workflows/cuda_image.yaml
Dockerfile.cuda11 13 additions, 0 deletions

Dockerfile.cuda11
Dockerfile.cuda12 12 additions, 0 deletions

Dockerfile.cuda12
README.md 26 additions, 4 deletions

README.md
charts/ialacol/Chart.yaml 2 additions, 2 deletions

charts/ialacol/Chart.yaml
charts/ialacol/values.yaml 1 addition, 0 deletions

charts/ialacol/values.yaml
examples/values/llama2-7b-chat-cuda11.yaml 30 additions, 0 deletions

examples/values/llama2-7b-chat-cuda11.yaml
get_config.py 4 additions, 0 deletions

get_config.py
get_llm.py 7 additions, 5 deletions

get_llm.py
model_generate.py 4 additions, 0 deletions

model_generate.py
requirements.txt 1 addition, 1 deletion

requirements.txt

with 176 additions and 12 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment