Skip to content
Snippets Groups Projects
Unverified Commit dd87579c authored by Henry Chen's avatar Henry Chen Committed by GitHub
Browse files

Fixes for starcoder models (#29)

parent bb2ff873
No related branches found
No related tags found
No related merge requests found
apiVersion: v2
appVersion: 0.6.0
appVersion: 0.6.1
description: A Helm chart for ialacol
name: ialacol
type: application
version: 0.6.1
version: 0.6.2
......@@ -15,6 +15,7 @@ async def get_llm(
_type_: _description_
"""
ctransformer_model_type = "llama"
# These are also in "starcoder" format
# https://huggingface.co/TheBloke/WizardCoder-15B-1.0-GGML
# https://huggingface.co/TheBloke/minotaur-15B-GGML
......@@ -25,8 +26,6 @@ async def get_llm(
or "minotaur-15" in body.model
):
ctransformer_model_type = "starcoder"
ctransformer_model_type = "llama"
if "llama" in body.model:
ctransformer_model_type = "llama"
if "mpt" in body.model:
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment