Machine

H200 machines support one, two, four, and eight GPUs via Machine.H200, Machine.H200_X_2, Machine.H200_X_4, and Machine.H200_X_8; B200 machines support one and eight via Machine.B200 and Machine.B200_X_8. Use the same names on every cloud, or --gpus H200:2 in the CLI. Availability depends on the selected cloud and account.

class lightning_sdk.Machine(name, slug, instance_type=None, family=None, accelerator_count=None, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

Bases: object

Hardware configuration for running Studios and Jobs on the Lightning AI platform.

Use the pre-defined class attributes (e.g. Machine.A10G, Machine.H100) rather than constructing instances directly. Pass a Machine to start(), run(), or run() to select the hardware.

Parameters:

name (str)
slug (str)
instance_type (str | None)
family (str | None)
accelerator_count (int | None)
cost (float | None)
interruptible_cost (float | None)
provider (str | None)
wait_time (float | None)
interruptible_wait_time (float | None)
_include_in_cli (bool)

classmethod from_str(machine, *additional_machine_ids)

Resolve a machine from one or more string identifiers.

Tries to match against known machine names, slugs, and instance types in order. Falls back to constructing an ad-hoc Machine if no match is found.

Parameters:

machine (str) – Primary machine identifier (name, slug, or instance type).
*additional_machine_ids (Any) – Extra identifiers to try when the primary does not match.
machine (str)
additional_machine_ids (Any)

Returns:

The resolved or constructed machine instance.

Return type:

Machine

is_cpu()

Whether the machine is a CPU.

Return type:: bool

A100: ClassVar[Machine] = Machine(name='A100', slug='lit-a100-1', instance_type=None, family='A100', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

A100_40GB: ClassVar[Machine] = Machine(name='A100_40GB', slug='lit-a100-40gb-1', instance_type=None, family='A100', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_40GB_X_2: ClassVar[Machine] = Machine(name='A100_40GB_X_2', slug='lit-a100-40gb-2', instance_type=None, family='A100', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_40GB_X_4: ClassVar[Machine] = Machine(name='A100_40GB_X_4', slug='lit-a100-40gb-4', instance_type=None, family='A100', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_40GB_X_8: ClassVar[Machine] = Machine(name='A100_40GB_X_8', slug='lit-a100-40gb-8', instance_type=None, family='A100', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_80GB: ClassVar[Machine] = Machine(name='A100_80GB', slug='lit-a100-80gb-1', instance_type=None, family='A100', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_80GB_X_2: ClassVar[Machine] = Machine(name='A100_80GB_X_2', slug='lit-a100-80gb-2', instance_type=None, family='A100', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_80GB_X_4: ClassVar[Machine] = Machine(name='A100_80GB_X_4', slug='lit-a100-80gb-4', instance_type=None, family='A100', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_80GB_X_8: ClassVar[Machine] = Machine(name='A100_80GB_X_8', slug='lit-a100-80gb-8', instance_type=None, family='A100', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=False)

A100_X_2: ClassVar[Machine] = Machine(name='A100_X_2', slug='lit-a100-2', instance_type=None, family='A100', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

A100_X_4: ClassVar[Machine] = Machine(name='A100_X_4', slug='lit-a100-4', instance_type=None, family='A100', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

A100_X_8: ClassVar[Machine] = Machine(name='A100_X_8', slug='lit-a100-8', instance_type=None, family='A100', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

B200: ClassVar[Machine] = Machine(name='B200', slug='lit-b200-1', instance_type=None, family='B200', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

B200_X_8: ClassVar[Machine] = Machine(name='B200_X_8', slug='lit-b200-8', instance_type=None, family='B200', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

CPU: ClassVar[Machine] = Machine(name='CPU', slug='cpu-4', instance_type=None, family='CPU', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

CPU_SMALL: ClassVar[Machine] = Machine(name='CPU_SMALL', slug='cpu-2', instance_type=None, family='CPU', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

CPU_X_16: ClassVar[Machine] = Machine(name='CPU_X_16', slug='cpu-16', instance_type=None, family='CPU', accelerator_count=16, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

CPU_X_2: ClassVar[Machine] = Machine(name='CPU_X_2', slug='cpu-2', instance_type=None, family='CPU', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

CPU_X_4: ClassVar[Machine] = Machine(name='CPU_X_4', slug='cpu-4', instance_type=None, family='CPU', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

CPU_X_8: ClassVar[Machine] = Machine(name='CPU_X_8', slug='cpu-8', instance_type=None, family='CPU', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

DATA_PREP: ClassVar[Machine] = Machine(name='DATA_PREP', slug='data-prep-mid', instance_type=None, family='DATA-PREP', accelerator_count=32, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

DATA_PREP_MAX: ClassVar[Machine] = Machine(name='DATA_PREP_MAX', slug='data-prep-max-large', instance_type=None, family='DATA-PREP', accelerator_count=64, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

DATA_PREP_ULTRA: ClassVar[Machine] = Machine(name='DATA_PREP_ULTRA', slug='data-prep-ultra-extra-large', instance_type=None, family='DATA-PREP', accelerator_count=96, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H100: ClassVar[Machine] = Machine(name='H100', slug='lit-h100-1', instance_type=None, family='H100', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H100_X_2: ClassVar[Machine] = Machine(name='H100_X_2', slug='lit-h100-2', instance_type=None, family='H100', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H100_X_4: ClassVar[Machine] = Machine(name='H100_X_4', slug='lit-h100-4', instance_type=None, family='H100', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H100_X_8: ClassVar[Machine] = Machine(name='H100_X_8', slug='lit-h100-8', instance_type=None, family='H100', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H200: ClassVar[Machine] = Machine(name='H200', slug='lit-h200-1', instance_type=None, family='H200', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H200_X_2: ClassVar[Machine] = Machine(name='H200_X_2', slug='lit-h200-2', instance_type=None, family='H200', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H200_X_4: ClassVar[Machine] = Machine(name='H200_X_4', slug='lit-h200-4', instance_type=None, family='H200', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

H200_X_8: ClassVar[Machine] = Machine(name='H200_X_8', slug='lit-h200-8', instance_type=None, family='H200', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L4: ClassVar[Machine] = Machine(name='L4', slug='lit-l4-1', instance_type=None, family='L4', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L40S: ClassVar[Machine] = Machine(name='L40S', slug='lit-l40s-1', instance_type=None, family='L40S', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L40S_X_2: ClassVar[Machine] = Machine(name='L40S_X_2', slug='lit-l40s-2', instance_type=None, family='L40S', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L40S_X_4: ClassVar[Machine] = Machine(name='L40S_X_4', slug='lit-l40s-4', instance_type=None, family='L40S', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L40S_X_8: ClassVar[Machine] = Machine(name='L40S_X_8', slug='lit-l40s-8', instance_type=None, family='L40S', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L4_X_2: ClassVar[Machine] = Machine(name='L4_X_2', slug='lit-l4-2', instance_type=None, family='L4', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L4_X_4: ClassVar[Machine] = Machine(name='L4_X_4', slug='lit-l4-4', instance_type=None, family='L4', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

L4_X_8: ClassVar[Machine] = Machine(name='L4_X_8', slug='lit-l4-8', instance_type=None, family='L4', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

RTXP_6000: ClassVar[Machine] = Machine(name='RTXP_6000', slug='lit-rtx-6000-pro-1', instance_type=None, family='RTX PRO', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

RTXP_6000_X_2: ClassVar[Machine] = Machine(name='RTXP_6000_X_2', slug='lit-rtx-6000-pro-2', instance_type=None, family='RTX PRO', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

RTXP_6000_X_4: ClassVar[Machine] = Machine(name='RTXP_6000_X_4', slug='lit-rtx-6000-pro-4', instance_type=None, family='RTX PRO', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

RTXP_6000_X_8: ClassVar[Machine] = Machine(name='RTXP_6000_X_8', slug='lit-rtx-6000-pro-8', instance_type=None, family='RTX PRO', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

T4: ClassVar[Machine] = Machine(name='T4', slug='lit-t4-1', instance_type=None, family='T4', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

T4_SMALL: ClassVar[Machine] = Machine(name='T4_SMALL', slug='lit-t4-1-small', instance_type=None, family='T4', accelerator_count=1, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

T4_X_2: ClassVar[Machine] = Machine(name='T4_X_2', slug='lit-t4-2', instance_type=None, family='T4', accelerator_count=2, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

T4_X_4: ClassVar[Machine] = Machine(name='T4_X_4', slug='lit-t4-4', instance_type=None, family='T4', accelerator_count=4, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

T4_X_8: ClassVar[Machine] = Machine(name='T4_X_8', slug='lit-t4-8', instance_type=None, family='T4', accelerator_count=8, cost=None, interruptible_cost=None, provider=None, wait_time=None, interruptible_wait_time=None, _include_in_cli=True)

accelerator_count: Optional[int] = None

cost: Optional[float] = None

family: Optional[str] = None

instance_type: Optional[str] = None

interruptible_cost: Optional[float] = None

interruptible_wait_time: Optional[float] = None

name: str

provider: Optional[str] = None

slug: str

wait_time: Optional[float] = None

class lightning_sdk.CloudProvider(*values)

Bases: Enum

Cloud provider for running Studios and Jobs on the Lightning AI platform.

classmethod from_str(provider)

Convert a string to a CloudProvider enum member.

Parameters:

provider (str) – The string name of the cloud provider (case-insensitive).
provider (str)

Returns:

The matching enum member.

Return type:

CloudProvider

Raises:

ValueError – If the string does not match any known provider.

AWS = 'AWS'

GCP = 'GCP'

LAMBDA_LABS = 'LAMBDA_LABS'

LIGHTNING = 'LIGHTNING'

NEBIUS = 'NEBIUS'

Was this page helpful?