Skip to content

Module redlite.model.aws_bedrock_model

Classes

AwsBedrockModel

class AwsBedrockModel(
    model_id: str,
    aws_access_key_id: str | None = None,
    aws_secret_access_key: str | None = None,
    region_name: str | None = None,
    endpoint_url: str | None = None,
    text_generation_config: dict[str, typing.Any] | None = None,
    auto_throttle: bool = False
)

Text generation models from AWS Bedrock.

  • model_id (str): identifier of the AWS Bedrock model, e.g. "amazon.titan-text-agile-v1".
  • aws_access_key_id (str | None): AWS access key id
  • aws_secret_access_key (str | None): AWS secret access key
  • region_name (str | None): AWS region (optional).
  • endpoint_uri (str | None): AWS endpoint (optional).
  • text_generation_config (dict | None): optional configuration, see AWS docs.
  • auto_throttle (bool): turns on auto-throttle feature. Default False. Auto-throttle will intercept AWS throttling error, and retry after some delay, with exponential back-off.

Ancestors (in MRO)

  • redlite._core.NamedModel