Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

I

Ialacol-build
- Activity
- Members
- Wiki
- Terraform modules

Snippets Groups Projects

a0ee699e

Unverified Commit a0ee699e authored 1 year ago by Henry Chen Committed by GitHub 1 year ago

Downloads
- Patches
- Plain Diff

Reduce memory usage for large models (#61)


Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com>

parent 75b4edb5

No related branches found

No related tags found

No related merge requests found

Changes 9

Hide whitespace changes

Inline Side-by-side

Showing

charts/ialacol/Chart.yaml 2 additions, 2 deletions

charts/ialacol/Chart.yaml
charts/ialacol/templates/deployment.yaml 0 additions, 2 deletions

charts/ialacol/templates/deployment.yaml
get_config.py 8 additions, 45 deletions

get_config.py
get_llm.py 0 additions, 28 deletions

get_llm.py
get_model_type.py 13 additions, 13 deletions

get_model_type.py
log.py 12 additions, 0 deletions

log.py
main.py 71 additions, 62 deletions

main.py
model_generate.py 70 additions, 4 deletions

model_generate.py
streamers.py 66 additions, 4 deletions

streamers.py

with 242 additions and 160 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment