Skip to content
Snippets Groups Projects
Unverified Commit efa48154 authored by Henry Chen's avatar Henry Chen Committed by GitHub
Browse files

Update README.md

parent a5b572bc
No related branches found
No related tags found
No related merge requests found
......@@ -85,12 +85,11 @@ There is a [image](https://github.com/chenhunghan/ialacol/pkgs/container/ialacol
```sh
export DEFAULT_MODEL_HG_REPO_ID="TheBloke/Llama-2-7B-Chat-GGML"
export DEFAULT_MODEL_FILE="llama-2-7b-chat.ggmlv3.q4_0.bin"
# Metal ghcr.io/chenhunghan/ialacol-metal:latest
# CUDA11 ghcr.io/chenhunghan/ialacol-cuda11:latest
# CUDA12 ghcr.io/chenhunghan/ialacol-cuda12:latest
# Metal ghcr.io/chenhunghan/ialacol-metal:latest
export IMAGE="ghcr.io/chenhunghan/ialacol:latest",
docker run --rm -it -p 8000:8000 -e DEFAULT_MODEL_HG_REPO_ID=$DEFAULT_MODEL_HG_REPO_ID -e DEFAULT_MODEL_FILE=$DEFAULT_MODEL_FILE
export IMAGE="ghcr.io/chenhunghan/ialacol:latest"
docker run --rm -it -p 8000:8000 \
-e DEFAULT_MODEL_HG_REPO_ID=$DEFAULT_MODEL_HG_REPO_ID \
-e DEFAULT_MODEL_FILE=$DEFAULT_MODEL_FILE \
$IMAGE
```
#### From Source
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment