Documentation Index
Fetch the complete documentation index at: https://docs.together.ai/llms.txt
Use this file to discover all available pages before exploring further.
clusters create
Parameters
| Flag | Description |
|---|---|
--name [string] | Name for the cluster. |
--num-gpus [integer] | Number of GPUs to allocate in the cluster |
--region [string] | Region to create the cluster in. Valid regions can be found with clusters list-regions |
--billing-type [ON_DEMAND|RESERVED] | Specify the cluster reservation approach.
|
--nvidia-driver-version [string] | Driver version to use for the cluster. Valid driver versions can be found with clusters list-regions |
--cuda-version [string] | CUDA version to use for the cluster. Valid CUDA versions can be found with clusters list-regions |
--duration-days [number] | Only used with RESERVED billing to specify how many days the clusters will be available to you. |
--gpu-type [string] | GPU type to use for the cluster. Find available gpu types for each region with the clusters list-regions command. |
--cluster-type [KUBERNETES|SLURM] | Cluster workload managers / orchestrators |
--volume [string] | Storage volume ID to use for the cluster. You can reference cluster volumes from clusters storage list. |
clusters update
| Flag | Description |
|---|---|
--num-gpus [integer] | Number of GPUs to allocate in the cluster |
--cluster-type [KUBERNETES|SLURM] | Cluster workload managers / orchestrators |
clusters retrieve
clusters delete
Usage
clusters list
Usage
clusters list-regions
Get configuration information per region to use in creating a GPU cluster.
clusters get-credentials
Download the cluster’s configuration and credentials to your local .kube/config file to manage Kubernetes resources.
Parameters
| Name | Description |
|---|---|
--file [Path|-] | Override the path to write the kubeconfig to. If you pass - it will print the config to stdout instead of writing to a file.default: ~/.kube/config |
--context-name [string] | Name of the context to add to the kubeconfig. By default, the context name will be the cluster name. |
--overwrite-existing | If there is a conflict with the existing kubeconfig, overwrite the existing kubeconfig instead of raising an error. |
--set-default-context | Change the current context for kubectl to the new context. |
clusters storage create
Parameters
| Name | Description |
|---|---|
--region [string] | Region to create the storage volume in. required |
--size-tib [intger] | Size of the storage volume you need. required |
--volume-name [string] | Name for the storage volume. required |
clusters storage retrieve
clusters storage list
Usage
clusters storage delete
Usage