Skip to content
Snippets Groups Projects
Unverified Commit efa48154 authored by Henry Chen's avatar Henry Chen Committed by GitHub
Browse files

Update README.md

parent a5b572bc
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 5 additions and 6 deletions
README.md
+ 5
− 6
View file @ efa48154
...@@ -85,12 +85,11 @@ There is a [image](https://github.com/chenhunghan/ialacol/pkgs/container/ialacol ...@@ -85,12 +85,11 @@ There is a [image](https://github.com/chenhunghan/ialacol/pkgs/container/ialacol
```sh ```sh
export DEFAULT_MODEL_HG_REPO_ID="TheBloke/Llama-2-7B-Chat-GGML" export DEFAULT_MODEL_HG_REPO_ID="TheBloke/Llama-2-7B-Chat-GGML"
export DEFAULT_MODEL_FILE="llama-2-7b-chat.ggmlv3.q4_0.bin" export DEFAULT_MODEL_FILE="llama-2-7b-chat.ggmlv3.q4_0.bin"
# Metal ghcr.io/chenhunghan/ialacol-metal:latest export IMAGE="ghcr.io/chenhunghan/ialacol:latest"
# CUDA11 ghcr.io/chenhunghan/ialacol-cuda11:latest docker run --rm -it -p 8000:8000 \
# CUDA12 ghcr.io/chenhunghan/ialacol-cuda12:latest -e DEFAULT_MODEL_HG_REPO_ID=$DEFAULT_MODEL_HG_REPO_ID \
# Metal ghcr.io/chenhunghan/ialacol-metal:latest -e DEFAULT_MODEL_FILE=$DEFAULT_MODEL_FILE \
export IMAGE="ghcr.io/chenhunghan/ialacol:latest", $IMAGE
docker run --rm -it -p 8000:8000 -e DEFAULT_MODEL_HG_REPO_ID=$DEFAULT_MODEL_HG_REPO_ID -e DEFAULT_MODEL_FILE=$DEFAULT_MODEL_FILE
``` ```
#### From Source #### From Source
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment