Add example `codellama.yaml`, ctransformer to 0.2.24, refactor `get_config` (#59)
Signed-off-by:
Hung-Han (Henry) Chen <chenhungh@gmail.com>
Showing
- charts/ialacol/Chart.yaml 2 additions, 2 deletionscharts/ialacol/Chart.yaml
- examples/values/codellama-13b-cuda12.yaml 29 additions, 0 deletionsexamples/values/codellama-13b-cuda12.yaml
- get_auto_config.py 107 additions, 0 deletionsget_auto_config.py
- get_llm.py 11 additions, 41 deletionsget_llm.py
- get_model_type.py 41 additions, 0 deletionsget_model_type.py
- main.py 1 addition, 8 deletionsmain.py
- model_generate.py 1 addition, 58 deletionsmodel_generate.py
- requirements.txt 1 addition, 1 deletionrequirements.txt
- streamers.py 1 addition, 62 deletionsstreamers.py
Loading
Please register or sign in to comment