Share datasets

Lightning AI provides various options for sharing datasets whether you're aiming to collaborate within your team, across your organization, or beyond.

Share within a teamspace

Explore methods to share datasets within a teamspace, ensuring smooth intra-team data access and collaboration.

Share a Studio as dataset

Create a shared dataset by either uploading to or downloading data from a Studio. After transferring data to the Studio, deactivate it and name it as the dataset.

Now access this dataset easily from any Studio within the same teamspace.

Please note: for training models with large datasets, optimize the dataset to speed up data loading by at least 20x.

Connect an S3 bucket

Another way to share a dataset in a teamspace is to connect an S3 bucket in the teamspace.

This setup allows dataset access from any Studio in the teamspace.

Please note: for training models with large datasets, optimize the dataset to speed up data loading by at least 20x.

Share data in an organization

This section shows how to seamlessly share datasets across various teamspaces within your organization.

Export to S3 and connect

Share datasets by exporting to an S3 bucket and importing them into any required teamspace.

1. Create an AWS S3 bucket. In this example we name it s3-bucket-dataset-docs.

2. Add the new S3 bucket as a data connection to your teamspace.

3. Transfer data from the Studio to the S3 bucket using AWS CLI.

After the transfer, access the data through the Studio terminal. The data is now within your private S3 bucket.

Publish a dataset Studio to an organization

Publish a Studio as a dataset to share across your organization.

Export data outside Lightning AI

This section describes how to export datasets from Lightning AI to external platforms.

Export to a public S3 bucket

Let's say you created a dataset on a Studio and want to export it outside of Lightning AI. To do this, first create an S3 bucket on your AWS account

1. Let's set up an example S3 bucket named s3-bucket-dataset-docs.

2. Make the bucket public.

3. Add the public bucket as an S3 connection.

4. Transfer the dataset from the Studio to the S3 bucket using AWS CLI.

Access and use your dataset freely outside Lightning AI.

Publish a public Studio

To share datasets with anyone in the world, create a Studio as dataset and publish to the Lightning AI public Studio gallery.