Module redlite.model.llamacpp_model

Classes

LlamaCppModel

class LlamaCppModel(
    model_path: str,
    **params
)

Chat model using Llama CPP engine.

• model_path (str): path to model file in GGUF format
• params (dict[str,Any]): Other keyword params, will be passed as-is to the llama_cpp.

Ancestors (in MRO)

• redlite._core.NamedModel