{"cells": [{"cell_type": "markdown", "id": "b4257d74", "metadata": {"papermill": {"duration": 0.006769, "end_time": "2023-01-05T11:17:00.355472", "exception": false, "start_time": "2023-01-05T11:17:00.348703", "status": "completed"}, "tags": []}, "source": ["\n", "# Introduction to Pytorch Lightning\n", "\n", "* **Author:** PL team\n", "* **License:** CC BY-SA\n", "* **Generated:** 2023-01-05T12:09:29.379466\n", "\n", "In this notebook, we'll go over the basics of lightning by preparing models to train on the [MNIST Handwritten Digits dataset](https://en.wikipedia.org/wiki/MNIST_database).\n", "\n", "---\n", "Open in [![Open In Colab](data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAHUAAAAUCAYAAACzrHJDAAAIuUlEQVRoQ+1ZaVRURxb+qhdolmbTUVSURpZgmLhHbQVFZIlGQBEXcMvJhKiTEzfigjQg7oNEJ9GMGidnjnNMBs2czIzajksEFRE1xklCTKJiQLRFsUGkoUWw+82pamn79etGYoKek1B/4NW99/tu3e/dquJBAGD27NkHALxKf39WY39gyrOi+i3xqGtUoePJrFmznrmgtModorbTu8YRNZk5cybXTvCtwh7o6NR2KzuZMWNGh6jtVt7nA0ymT5/eJlF9POrh7PAQl6s8bGYa3PUum//htmebVtLRqW0q01M5keTk5FZFzU0oRle3+zxwg5Hgtb+PZiL/ZVohxCI+hL5JgjmfjPxZ26+33BG3dA+ealHPM4gQAo5rU59gsI8bRvl54t3Ca62mvHyUAhtOlLd5WSQpKcluBjumnoCLs1EARkVd9E8l3p9y2i7RbQ1B6pFwu/YDgW8KbHJHMTQrwnjz2oZm9M4pavOCfo5jWrgCaaMVcMs6/pNhDr0+AMN93XlxV7R6DNpyzi7W/OE+yIrsjU6rTrbKV5cd/pNyItOmTbMp6sbBB+EqaYJY4cWE3VUciNt1TpgfcRFv71Fi54xT5kSoyLvOBEJMOMxWXkFlBeBSX4u6Zkcs+3KszYRtiapbNRqF31UgetVuc8z9vBXIv1qD+F1f83B6uDlCUyfsZGepGPpmg01OB7EITQbhS9ribKy+DmP1DUiClLz4bnIHVOqa7BY+Z1wg5g3zgUvyehiNpnJKxSLc/ts76LKm0BzX3c0RNy1yXjDcB5lWoro4iNHQxM+f1kWeWQARAWQS++trISJTp061Kep25X/MycwtjuctSC5rxo7ppi7VNUox5+PhPHtrsS2O1qJ6yx1QujQUzm9sh6hbkBlvvGcN8hYnwjUjH6kjfZEd5c/jitz5Jc5U3ENnFynKl4eB7nyEgP2UZ+Yz3/rVEbyYr27qELrtC4FIC0J7sc7xWnmccdHfRRTs0VB+cA4lt+oFcRR/wUeH8FG5w2Mbx8FQ8TXEvv1xYf4wBP3O2WyL3/UVjpXWgIqaFeUPr+wTmDvUB7njH6/bOv+HRg4SqioAg5GDe1aB3ZeMTJkyRSBqkLsWqSEm0fZVBEN94zEZnYvrdx1JL5cxe+a+AbhSJecRRHW/ikTFRTa38dtQlNZ5CRKwFvUtZU/kvBoEF9Uxni/XqIM+dwKbTw3rhcxIf7gmr2M+H6SMwx8iBzJbw5oxeG3Lv5FX9B3AGaHPS8e8z77H7v9VMpvPG5ug1enh7eGK8h0LBTwUb+GInqzInlRUK65DmTPQu4c3+uQKjwKK77zwUxBX4Tq7yR1RuiwUsqlrABCM6esHdXoy47fk4+prYKy8ZF574x4V5BnHQBuf4g9Z9ld8U36L2aktZNNplNfw7zotwWTy5MkCUft4aLEopJj5/OPHl1BQqeAVOnHgNSQOqmBzq9V9cfEm/yx5ubMGKS9cYPZ3vx2OS/c6PVHUuUO7Y1Pci3BO/1zgq18byebfGemLtNF+6JRtOvMk926ibussZqM+1mNz4TWkH7rCbM5phwGRGDAaoF8fY5OHFnlldAA8sgoEXKnDukA1NgSeNjqkJT9brbN4pC9WRweYXyLugR73c+MYvyWfu0yC6+mjzN1Isfw3FKJS98CU/zI1IHFkFPR52cHL2FJk0sB6kMTERIGo9GzcPkLNfA0cwdwi/hfEYO86ZMd9w+y1egfM2T2Eh/vesMNwljSzuZRT420SW3eqy8N6aHMmwmnFUZ7/PGVPbIoNZvNU1BURdHs0bT2+HjL8sDSM2e6vi4Lj5NW8WOLVA6RTT2azxLV+bglaFNqLieqemS/gWkw7NyoAHo+2dEsiivengjKsPFoqWOvbSh/kxPaxyW/JRzH2Fl3EzD9/xjAefJqB3usKUFn/0Gb+S/d/jy3FN2yLOmnSJJtn6oehByEiHPSeXnDxFGPRnoFoaBJjcdQlbDwcjL1zTNuQpoxD7R0OG0uUTMi0fkVwdzBdYIwcwZunxrVJVLplNm54BZp7jfDfYLoNyqQi1K6KxIdHzmN+QQ2WjFIwUT2zTGdlRXo4NFXVUO4sgX5dFC7f0aP/ZlNeUjFBuL8Xjl6uRuP6aMjSjpjzsH62FDU7JhBuGccEXIvDfJFFBc/gHw80dklfCVYnRaDfpiJcutPA4F7qJsfJeUPQI+1fqMlNhFx1FM0GDqkjFVg7NojlQ0Vt4aM5ReSqcbpaCg8nCW5lRsBvbT4T1TLfFptsfh7gItzuKTdJSEiwKSrt1vcmnEXXrsLbYnWDA1bu+z2WKy9Arq+1KRqdfKsoBo0GcdtEpS/B1bO4v0cFiUhkjskvKcMrWwtAPHuwQq8Z+4LZ1vTQANfXt4J0DwZX9gWa9qh4XDM/voC9JXfwYEMMHJcfNtusn82ihvliVUwg5KrPGVf6GH94ZJpEZBen6EC4qYTHA1dXhW0JIex8txzv//c8lhzXIi/BFxOH9jGbQhZsRalTIBZZ8KkGyZAxeRQvXkFF1TWz/Hm46jNYUnjPbt3JxIkT7f6dSj8qfJJyVvBxgaIlblOyjtysNHWN9fjjqWi7glJfW3/S0Hlj2XnA8PhKT9w6g3Qx3XiXhvuxQsuT1proxBKI/AaZqY1Xz5muvY8G8XkRRCaHsfQsRAFDH/tZPbcYuHotOG0FRIqB4HR3wNVoIPLtz8ycTguu+jpEigE218vd1YCr5m+HpHMvEI9u4LTXwNWaLjl0iPwGAmIpeHx1VeCqTJdPs1/vweweQPO3HC24NhOhnTphwoQnfv6QSY2ICbkNmdSA4h87oaLaiYfn5diIEd4att2erOwJXbPUHp953p6orQVSUVWRAXBT8c/dJ5L9xhzaJGp71GR/wFP8P5V2z10NSC9T93QM2xUg8fHxT+zU9ijeU4naHon8CjFJXFzc8/kn+dN06q9QgF98SYSo2Xen2NjYZy5sR6f+4nLSK5Iam2PH/x87a1YN/t5sBgAAAABJRU5ErkJggg==){height=\"20px\" width=\"117px\"}](https://colab.research.google.com/github/PytorchLightning/lightning-tutorials/blob/publication/.notebooks/lightning_examples/mnist-hello-world.ipynb)\n", "\n", "Give us a \u2b50 [on Github](https://www.github.com/Lightning-AI/lightning/)\n", "| Check out [the documentation](https://pytorch-lightning.readthedocs.io/en/stable/)\n", "| Join us [on Slack](https://www.pytorchlightning.ai/community)"]}, {"cell_type": "markdown", "id": "2bf27b63", "metadata": {"papermill": {"duration": 0.002315, "end_time": "2023-01-05T11:17:00.362659", "exception": false, "start_time": "2023-01-05T11:17:00.360344", "status": "completed"}, "tags": []}, "source": ["## Setup\n", "This notebook requires some packages besides pytorch-lightning."]}, {"cell_type": "code", "execution_count": 1, "id": "372258bd", "metadata": {"colab": {}, "colab_type": "code", "execution": {"iopub.execute_input": "2023-01-05T11:17:00.369360Z", "iopub.status.busy": "2023-01-05T11:17:00.368896Z", "iopub.status.idle": "2023-01-05T11:17:03.134157Z", "shell.execute_reply": "2023-01-05T11:17:03.132833Z"}, "id": "LfrJLKPFyhsK", "lines_to_next_cell": 0, "papermill": {"duration": 2.772465, "end_time": "2023-01-05T11:17:03.137713", "exception": false, "start_time": "2023-01-05T11:17:00.365248", "status": "completed"}, "tags": []}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["\u001b[33mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv\u001b[0m\u001b[33m\r\n", "\u001b[0m"]}], "source": ["! pip install --quiet \"torchmetrics>=0.7, <0.12\" \"seaborn\" \"ipython[notebook]>=8.0.0, <8.9.0\" \"pytorch-lightning>=1.4, <1.9\" \"torchmetrics >=0.11.0\" \"setuptools==65.6.3\" \"pandas\" \"torchvision\" \"torch>=1.8.1, <1.14.0\""]}, {"cell_type": "code", "execution_count": 2, "id": "d495d12a", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:03.148080Z", "iopub.status.busy": "2023-01-05T11:17:03.147841Z", "iopub.status.idle": "2023-01-05T11:17:06.489921Z", "shell.execute_reply": "2023-01-05T11:17:06.488590Z"}, "papermill": {"duration": 3.348533, "end_time": "2023-01-05T11:17:06.492608", "exception": false, "start_time": "2023-01-05T11:17:03.144075", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["/tmp/ipykernel_3064/1920170836.py:6: DeprecationWarning: Importing display from IPython.core.display is deprecated since IPython 7.14, please import from IPython display\n", "  from IPython.core.display import display\n"]}], "source": ["import os\n", "\n", "import pandas as pd\n", "import seaborn as sn\n", "import torch\n", "from IPython.core.display import display\n", "from pytorch_lightning import LightningModule, Trainer\n", "from pytorch_lightning.callbacks.progress import TQDMProgressBar\n", "from pytorch_lightning.loggers import CSVLogger\n", "from torch import nn\n", "from torch.nn import functional as F\n", "from torch.utils.data import DataLoader, random_split\n", "from torchmetrics import Accuracy\n", "from torchvision import transforms\n", "from torchvision.datasets import MNIST\n", "\n", "PATH_DATASETS = os.environ.get(\"PATH_DATASETS\", \".\")\n", "BATCH_SIZE = 256 if torch.cuda.is_available() else 64"]}, {"cell_type": "markdown", "id": "2444aa0a", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.002899, "end_time": "2023-01-05T11:17:06.501651", "exception": false, "start_time": "2023-01-05T11:17:06.498752", "status": "completed"}, "tags": []}, "source": ["## Simplest example\n", "\n", "Here's the simplest most minimal example with just a training loop (no validation, no testing).\n", "\n", "**Keep in Mind** - A `LightningModule` *is* a PyTorch `nn.Module` - it just has a few more helpful features."]}, {"cell_type": "code", "execution_count": 3, "id": "0ea17820", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:06.509112Z", "iopub.status.busy": "2023-01-05T11:17:06.508220Z", "iopub.status.idle": "2023-01-05T11:17:06.518338Z", "shell.execute_reply": "2023-01-05T11:17:06.517544Z"}, "papermill": {"duration": 0.016148, "end_time": "2023-01-05T11:17:06.520310", "exception": false, "start_time": "2023-01-05T11:17:06.504162", "status": "completed"}, "tags": []}, "outputs": [], "source": ["class MNISTModel(LightningModule):\n", "    def __init__(self):\n", "        super().__init__()\n", "        self.l1 = torch.nn.Linear(28 * 28, 10)\n", "\n", "    def forward(self, x):\n", "        return torch.relu(self.l1(x.view(x.size(0), -1)))\n", "\n", "    def training_step(self, batch, batch_nb):\n", "        x, y = batch\n", "        loss = F.cross_entropy(self(x), y)\n", "        return loss\n", "\n", "    def configure_optimizers(self):\n", "        return torch.optim.Adam(self.parameters(), lr=0.02)"]}, {"cell_type": "markdown", "id": "33edeb48", "metadata": {"papermill": {"duration": 0.005641, "end_time": "2023-01-05T11:17:06.531624", "exception": false, "start_time": "2023-01-05T11:17:06.525983", "status": "completed"}, "tags": []}, "source": ["By using the `Trainer` you automatically get:\n", "1. Tensorboard logging\n", "2. Model checkpointing\n", "3. Training and validation loop\n", "4. early-stopping"]}, {"cell_type": "code", "execution_count": 4, "id": "6319bb60", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:06.537593Z", "iopub.status.busy": "2023-01-05T11:17:06.537425Z", "iopub.status.idle": "2023-01-05T11:17:23.735631Z", "shell.execute_reply": "2023-01-05T11:17:23.734970Z"}, "papermill": {"duration": 17.203177, "end_time": "2023-01-05T11:17:23.737335", "exception": false, "start_time": "2023-01-05T11:17:06.534158", "status": "completed"}, "tags": []}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["Downloading http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz\n", "Downloading http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz to /__w/6/s/.datasets/MNIST/raw/train-images-idx3-ubyte.gz\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "bf9ae660143b48ecb89e7080715b9a18", "version_major": 2, "version_minor": 0}, "text/plain": ["  0%|          | 0/9912422 [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["Extracting /__w/6/s/.datasets/MNIST/raw/train-images-idx3-ubyte.gz to /__w/6/s/.datasets/MNIST/raw\n"]}, {"name": "stdout", "output_type": "stream", "text": ["\n", "Downloading http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz\n", "Downloading http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz to /__w/6/s/.datasets/MNIST/raw/train-labels-idx1-ubyte.gz\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "02fd1a140eeb4c59a858d5e24c096de6", "version_major": 2, "version_minor": 0}, "text/plain": ["  0%|          | 0/28881 [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["Extracting /__w/6/s/.datasets/MNIST/raw/train-labels-idx1-ubyte.gz to /__w/6/s/.datasets/MNIST/raw\n", "\n", "Downloading http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz\n", "Downloading http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz to /__w/6/s/.datasets/MNIST/raw/t10k-images-idx3-ubyte.gz\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "9081419f28a44f2b94de23669c5b6bb2", "version_major": 2, "version_minor": 0}, "text/plain": ["  0%|          | 0/1648877 [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["Extracting /__w/6/s/.datasets/MNIST/raw/t10k-images-idx3-ubyte.gz to /__w/6/s/.datasets/MNIST/raw\n", "\n", "Downloading http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz\n", "Downloading http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz to /__w/6/s/.datasets/MNIST/raw/t10k-labels-idx1-ubyte.gz\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "ecfb0c477d7c451a93c6bab38ec300af", "version_major": 2, "version_minor": 0}, "text/plain": ["  0%|          | 0/4542 [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["Extracting /__w/6/s/.datasets/MNIST/raw/t10k-labels-idx1-ubyte.gz to /__w/6/s/.datasets/MNIST/raw\n", "\n"]}, {"name": "stderr", "output_type": "stream", "text": ["GPU available: True (cuda), used: True\n"]}, {"name": "stderr", "output_type": "stream", "text": ["TPU available: False, using: 0 TPU cores\n"]}, {"name": "stderr", "output_type": "stream", "text": ["IPU available: False, using: 0 IPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["HPU available: False, using: 0 HPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["Missing logger folder: /__w/6/s/lightning_logs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\n", "  | Name | Type   | Params\n", "--------------------------------\n", "0 | l1   | Linear | 7.9 K \n", "--------------------------------\n", "7.9 K     Trainable params\n", "0         Non-trainable params\n", "7.9 K     Total params\n", "0.031     Total estimated model params size (MB)\n"]}, {"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.9/dist-packages/pytorch_lightning/trainer/connectors/data_connector.py:224: PossibleUserWarning: The dataloader, train_dataloader, does not have many workers which may be a bottleneck. Consider increasing the value of the `num_workers` argument` (try 64 which is the number of cpus on this machine) in the `DataLoader` init to improve performance.\n", "  rank_zero_warn(\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "ccc427227c1b45b98a5851a745e9527e", "version_major": 2, "version_minor": 0}, "text/plain": ["Training: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["`Trainer.fit` stopped: `max_epochs=3` reached.\n"]}], "source": ["# Init our model\n", "mnist_model = MNISTModel()\n", "\n", "# Init DataLoader from MNIST Dataset\n", "train_ds = MNIST(PATH_DATASETS, train=True, download=True, transform=transforms.ToTensor())\n", "train_loader = DataLoader(train_ds, batch_size=BATCH_SIZE)\n", "\n", "# Initialize a trainer\n", "trainer = Trainer(\n", "    accelerator=\"auto\",\n", "    devices=1 if torch.cuda.is_available() else None,  # limiting got iPython runs\n", "    max_epochs=3,\n", "    callbacks=[TQDMProgressBar(refresh_rate=20)],\n", ")\n", "\n", "# Train the model \u26a1\n", "trainer.fit(mnist_model, train_loader)"]}, {"cell_type": "markdown", "id": "b974bd59", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.003859, "end_time": "2023-01-05T11:17:23.752001", "exception": false, "start_time": "2023-01-05T11:17:23.748142", "status": "completed"}, "tags": []}, "source": ["## A more complete MNIST Lightning Module Example\n", "\n", "That wasn't so hard was it?\n", "\n", "Now that we've got our feet wet, let's dive in a bit deeper and write a more complete `LightningModule` for MNIST...\n", "\n", "This time, we'll bake in all the dataset specific pieces directly in the `LightningModule`.\n", "This way, we can avoid writing extra code at the beginning of our script every time we want to run it.\n", "\n", "---\n", "\n", "### Note what the following built-in functions are doing:\n", "\n", "1. [prepare_data()](https://pytorch-lightning.readthedocs.io/en/stable/common/lightning_module.html#prepare-data) \ud83d\udcbe\n", "    - This is where we can download the dataset. We point to our desired dataset and ask torchvision's `MNIST` dataset class to download if the dataset isn't found there.\n", "    - **Note we do not make any state assignments in this function** (i.e. `self.something = ...`)\n", "\n", "2. [setup(stage)](https://pytorch-lightning.readthedocs.io/en/stable/common/lightning_module.html#setup) \u2699\ufe0f\n", "    - Loads in data from file and prepares PyTorch tensor datasets for each split (train, val, test).\n", "    - Setup expects a 'stage' arg which is used to separate logic for 'fit' and 'test'.\n", "    - If you don't mind loading all your datasets at once, you can set up a condition to allow for both 'fit' related setup and 'test' related setup to run whenever `None` is passed to `stage` (or ignore it altogether and exclude any conditionals).\n", "    - **Note this runs across all GPUs and it *is* safe to make state assignments here**\n", "\n", "3. [x_dataloader()](https://pytorch-lightning.readthedocs.io/en/stable/api/pytorch_lightning.core.hooks.DataHooks.html#pytorch_lightning.core.hooks.DataHooks.train_dataloader) \u267b\ufe0f\n", "    - `train_dataloader()`, `val_dataloader()`, and `test_dataloader()` all return PyTorch `DataLoader` instances that are created by wrapping their respective datasets that we prepared in `setup()`"]}, {"cell_type": "code", "execution_count": 5, "id": "4ba977ca", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:23.761973Z", "iopub.status.busy": "2023-01-05T11:17:23.761379Z", "iopub.status.idle": "2023-01-05T11:17:23.784018Z", "shell.execute_reply": "2023-01-05T11:17:23.783186Z"}, "papermill": {"duration": 0.030516, "end_time": "2023-01-05T11:17:23.786267", "exception": false, "start_time": "2023-01-05T11:17:23.755751", "status": "completed"}, "tags": []}, "outputs": [], "source": ["class LitMNIST(LightningModule):\n", "    def __init__(self, data_dir=PATH_DATASETS, hidden_size=64, learning_rate=2e-4):\n", "        super().__init__()\n", "\n", "        # Set our init args as class attributes\n", "        self.data_dir = data_dir\n", "        self.hidden_size = hidden_size\n", "        self.learning_rate = learning_rate\n", "\n", "        # Hardcode some dataset specific attributes\n", "        self.num_classes = 10\n", "        self.dims = (1, 28, 28)\n", "        channels, width, height = self.dims\n", "        self.transform = transforms.Compose(\n", "            [\n", "                transforms.ToTensor(),\n", "                transforms.Normalize((0.1307,), (0.3081,)),\n", "            ]\n", "        )\n", "\n", "        # Define PyTorch model\n", "        self.model = nn.Sequential(\n", "            nn.Flatten(),\n", "            nn.Linear(channels * width * height, hidden_size),\n", "            nn.ReLU(),\n", "            nn.Dropout(0.1),\n", "            nn.Linear(hidden_size, hidden_size),\n", "            nn.ReLU(),\n", "            nn.Dropout(0.1),\n", "            nn.Linear(hidden_size, self.num_classes),\n", "        )\n", "\n", "        self.val_accuracy = Accuracy(task=\"multiclass\", num_classes=10)\n", "        self.test_accuracy = Accuracy(task=\"multiclass\", num_classes=10)\n", "\n", "    def forward(self, x):\n", "        x = self.model(x)\n", "        return F.log_softmax(x, dim=1)\n", "\n", "    def training_step(self, batch, batch_idx):\n", "        x, y = batch\n", "        logits = self(x)\n", "        loss = F.nll_loss(logits, y)\n", "        return loss\n", "\n", "    def validation_step(self, batch, batch_idx):\n", "        x, y = batch\n", "        logits = self(x)\n", "        loss = F.nll_loss(logits, y)\n", "        preds = torch.argmax(logits, dim=1)\n", "        self.val_accuracy.update(preds, y)\n", "\n", "        # Calling self.log will surface up scalars for you in TensorBoard\n", "        self.log(\"val_loss\", loss, prog_bar=True)\n", "        self.log(\"val_acc\", self.val_accuracy, prog_bar=True)\n", "\n", "    def test_step(self, batch, batch_idx):\n", "        x, y = batch\n", "        logits = self(x)\n", "        loss = F.nll_loss(logits, y)\n", "        preds = torch.argmax(logits, dim=1)\n", "        self.test_accuracy.update(preds, y)\n", "\n", "        # Calling self.log will surface up scalars for you in TensorBoard\n", "        self.log(\"test_loss\", loss, prog_bar=True)\n", "        self.log(\"test_acc\", self.test_accuracy, prog_bar=True)\n", "\n", "    def configure_optimizers(self):\n", "        optimizer = torch.optim.Adam(self.parameters(), lr=self.learning_rate)\n", "        return optimizer\n", "\n", "    ####################\n", "    # DATA RELATED HOOKS\n", "    ####################\n", "\n", "    def prepare_data(self):\n", "        # download\n", "        MNIST(self.data_dir, train=True, download=True)\n", "        MNIST(self.data_dir, train=False, download=True)\n", "\n", "    def setup(self, stage=None):\n", "        # Assign train/val datasets for use in dataloaders\n", "        if stage == \"fit\" or stage is None:\n", "            mnist_full = MNIST(self.data_dir, train=True, transform=self.transform)\n", "            self.mnist_train, self.mnist_val = random_split(mnist_full, [55000, 5000])\n", "\n", "        # Assign test dataset for use in dataloader(s)\n", "        if stage == \"test\" or stage is None:\n", "            self.mnist_test = MNIST(self.data_dir, train=False, transform=self.transform)\n", "\n", "    def train_dataloader(self):\n", "        return DataLoader(self.mnist_train, batch_size=BATCH_SIZE)\n", "\n", "    def val_dataloader(self):\n", "        return DataLoader(self.mnist_val, batch_size=BATCH_SIZE)\n", "\n", "    def test_dataloader(self):\n", "        return DataLoader(self.mnist_test, batch_size=BATCH_SIZE)"]}, {"cell_type": "code", "execution_count": 6, "id": "f55efaa6", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:23.799831Z", "iopub.status.busy": "2023-01-05T11:17:23.799660Z", "iopub.status.idle": "2023-01-05T11:17:48.541415Z", "shell.execute_reply": "2023-01-05T11:17:48.540535Z"}, "papermill": {"duration": 24.749407, "end_time": "2023-01-05T11:17:48.543854", "exception": false, "start_time": "2023-01-05T11:17:23.794447", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["GPU available: True (cuda), used: True\n"]}, {"name": "stderr", "output_type": "stream", "text": ["TPU available: False, using: 0 TPU cores\n"]}, {"name": "stderr", "output_type": "stream", "text": ["IPU available: False, using: 0 IPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["HPU available: False, using: 0 HPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["Missing logger folder: logs/lightning_logs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\n", "  | Name          | Type               | Params\n", "-----------------------------------------------------\n", "0 | model         | Sequential         | 55.1 K\n", "1 | val_accuracy  | MulticlassAccuracy | 0     \n", "2 | test_accuracy | MulticlassAccuracy | 0     \n", "-----------------------------------------------------\n", "55.1 K    Trainable params\n", "0         Non-trainable params\n", "55.1 K    Total params\n", "0.220     Total estimated model params size (MB)\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "39d287fa391b46d7b79dd570141b4e86", "version_major": 2, "version_minor": 0}, "text/plain": ["Sanity Checking: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.9/dist-packages/pytorch_lightning/trainer/connectors/data_connector.py:224: PossibleUserWarning: The dataloader, val_dataloader 0, does not have many workers which may be a bottleneck. Consider increasing the value of the `num_workers` argument` (try 64 which is the number of cpus on this machine) in the `DataLoader` init to improve performance.\n", "  rank_zero_warn(\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "01baac8cb1944700be1cc8e22e1db1cb", "version_major": 2, "version_minor": 0}, "text/plain": ["Training: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "e8fdc1872be740b0aeba4a9f602f91c4", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "3b6b4bc1dc0a4418ac5c7c3029577cbb", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "61e0d0d7dc72431ea2735586bf18ae7b", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["`Trainer.fit` stopped: `max_epochs=3` reached.\n"]}], "source": ["model = LitMNIST()\n", "trainer = Trainer(\n", "    accelerator=\"auto\",\n", "    devices=1 if torch.cuda.is_available() else None,  # limiting got iPython runs\n", "    max_epochs=3,\n", "    callbacks=[TQDMProgressBar(refresh_rate=20)],\n", "    logger=CSVLogger(save_dir=\"logs/\"),\n", ")\n", "trainer.fit(model)"]}, {"cell_type": "markdown", "id": "6563a3ae", "metadata": {"papermill": {"duration": 0.005077, "end_time": "2023-01-05T11:17:48.558415", "exception": false, "start_time": "2023-01-05T11:17:48.553338", "status": "completed"}, "tags": []}, "source": ["### Testing\n", "\n", "To test a model, call `trainer.test(model)`.\n", "\n", "Or, if you've just trained a model, you can just call `trainer.test()` and Lightning will automatically\n", "test using the best saved checkpoint (conditioned on val_loss)."]}, {"cell_type": "code", "execution_count": 7, "id": "343253ba", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:48.569703Z", "iopub.status.busy": "2023-01-05T11:17:48.569336Z", "iopub.status.idle": "2023-01-05T11:17:49.842116Z", "shell.execute_reply": "2023-01-05T11:17:49.841115Z"}, "papermill": {"duration": 1.280816, "end_time": "2023-01-05T11:17:49.843930", "exception": false, "start_time": "2023-01-05T11:17:48.563114", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.9/dist-packages/pytorch_lightning/trainer/connectors/checkpoint_connector.py:134: UserWarning: `.test(ckpt_path=None)` was called without a model. The best model of the previous `fit` call will be used. You can pass `.test(ckpt_path='best')` to use the best model or `.test(ckpt_path='last')` to use the last model. If you pass a value, this warning will be silenced.\n", "  rank_zero_warn(\n", "Restoring states from the checkpoint path at logs/lightning_logs/version_0/checkpoints/epoch=2-step=645.ckpt\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["Loaded model weights from checkpoint at logs/lightning_logs/version_0/checkpoints/epoch=2-step=645.ckpt\n"]}, {"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.9/dist-packages/pytorch_lightning/trainer/connectors/data_connector.py:224: PossibleUserWarning: The dataloader, test_dataloader 0, does not have many workers which may be a bottleneck. Consider increasing the value of the `num_workers` argument` (try 64 which is the number of cpus on this machine) in the `DataLoader` init to improve performance.\n", "  rank_zero_warn(\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "43b93132772c4cea88ae0d507362ec05", "version_major": 2, "version_minor": 0}, "text/plain": ["Testing: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"text/html": ["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\">\u250f\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2533\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2513\n", "\u2503<span style=\"font-weight: bold\">        Test metric        </span>\u2503<span style=\"font-weight: bold\">       DataLoader 0        </span>\u2503\n", "\u2521\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2547\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2529\n", "\u2502<span style=\"color: #008080; text-decoration-color: #008080\">         test_acc          </span>\u2502<span style=\"color: #800080; text-decoration-color: #800080\">    0.9228000044822693     </span>\u2502\n", "\u2502<span style=\"color: #008080; text-decoration-color: #008080\">         test_loss         </span>\u2502<span style=\"color: #800080; text-decoration-color: #800080\">    0.2596317529678345     </span>\u2502\n", "\u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2534\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518\n", "</pre>\n"], "text/plain": ["\u250f\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2533\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2513\n", "\u2503\u001b[1m \u001b[0m\u001b[1m       Test metric       \u001b[0m\u001b[1m \u001b[0m\u2503\u001b[1m \u001b[0m\u001b[1m      DataLoader 0       \u001b[0m\u001b[1m \u001b[0m\u2503\n", "\u2521\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2547\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2501\u2529\n", "\u2502\u001b[36m \u001b[0m\u001b[36m        test_acc         \u001b[0m\u001b[36m \u001b[0m\u2502\u001b[35m \u001b[0m\u001b[35m   0.9228000044822693    \u001b[0m\u001b[35m \u001b[0m\u2502\n", "\u2502\u001b[36m \u001b[0m\u001b[36m        test_loss        \u001b[0m\u001b[36m \u001b[0m\u2502\u001b[35m \u001b[0m\u001b[35m   0.2596317529678345    \u001b[0m\u001b[35m \u001b[0m\u2502\n", "\u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2534\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518\n"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"text/plain": ["[{'test_loss': 0.2596317529678345, 'test_acc': 0.9228000044822693}]"]}, "execution_count": 7, "metadata": {}, "output_type": "execute_result"}], "source": ["trainer.test()"]}, {"cell_type": "markdown", "id": "145bc32e", "metadata": {"papermill": {"duration": 0.007028, "end_time": "2023-01-05T11:17:49.858372", "exception": false, "start_time": "2023-01-05T11:17:49.851344", "status": "completed"}, "tags": []}, "source": ["### Bonus Tip\n", "\n", "You can keep calling `trainer.fit(model)` as many times as you'd like to continue training"]}, {"cell_type": "code", "execution_count": 8, "id": "42796164", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:49.870643Z", "iopub.status.busy": "2023-01-05T11:17:49.870288Z", "iopub.status.idle": "2023-01-05T11:17:50.057166Z", "shell.execute_reply": "2023-01-05T11:17:50.056281Z"}, "papermill": {"duration": 0.195226, "end_time": "2023-01-05T11:17:50.059108", "exception": false, "start_time": "2023-01-05T11:17:49.863882", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.9/dist-packages/pytorch_lightning/callbacks/model_checkpoint.py:604: UserWarning: Checkpoint directory logs/lightning_logs/version_0/checkpoints exists and is not empty.\n", "  rank_zero_warn(f\"Checkpoint directory {dirpath} exists and is not empty.\")\n", "LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\n", "  | Name          | Type               | Params\n", "-----------------------------------------------------\n", "0 | model         | Sequential         | 55.1 K\n", "1 | val_accuracy  | MulticlassAccuracy | 0     \n", "2 | test_accuracy | MulticlassAccuracy | 0     \n", "-----------------------------------------------------\n", "55.1 K    Trainable params\n", "0         Non-trainable params\n", "55.1 K    Total params\n", "0.220     Total estimated model params size (MB)\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "e3ae3881c87e4d2d874b0ff385de8837", "version_major": 2, "version_minor": 0}, "text/plain": ["Sanity Checking: 0it [00:00, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["`Trainer.fit` stopped: `max_epochs=3` reached.\n"]}], "source": ["trainer.fit(model)"]}, {"cell_type": "markdown", "id": "5c6c52f2", "metadata": {"papermill": {"duration": 0.005622, "end_time": "2023-01-05T11:17:50.072391", "exception": false, "start_time": "2023-01-05T11:17:50.066769", "status": "completed"}, "tags": []}, "source": ["In Colab, you can use the TensorBoard magic function to view the logs that Lightning has created for you!"]}, {"cell_type": "code", "execution_count": 9, "id": "5371c3d1", "metadata": {"execution": {"iopub.execute_input": "2023-01-05T11:17:50.085310Z", "iopub.status.busy": "2023-01-05T11:17:50.084474Z", "iopub.status.idle": "2023-01-05T11:17:50.416356Z", "shell.execute_reply": "2023-01-05T11:17:50.415351Z"}, "papermill": {"duration": 0.340885, "end_time": "2023-01-05T11:17:50.418703", "exception": false, "start_time": "2023-01-05T11:17:50.077818", "status": "completed"}, "tags": []}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>val_loss</th>\n", "      <th>val_acc</th>\n", "      <th>test_loss</th>\n", "      <th>test_acc</th>\n", "    </tr>\n", "    <tr>\n", "      <th>epoch</th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>0.432111</td>\n", "      <td>0.8884</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>0.310814</td>\n", "      <td>0.9124</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>0.264833</td>\n", "      <td>0.9224</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>0.259632</td>\n", "      <td>0.9228</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["       val_loss  val_acc  test_loss  test_acc\n", "epoch                                        \n", "0      0.432111   0.8884        NaN       NaN\n", "1      0.310814   0.9124        NaN       NaN\n", "2      0.264833   0.9224        NaN       NaN\n", "2           NaN      NaN   0.259632    0.9228"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"text/plain": ["<seaborn.axisgrid.FacetGrid at 0x7ff9b037ee20>"]}, "execution_count": 9, "metadata": {}, "output_type": "execute_result"}, {"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAj4AAAHpCAYAAACC4TamAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjYuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8o6BhiAAAACXBIWXMAAA9hAAAPYQGoP6dpAABSa0lEQVR4nO3deVxUZf8//tcwMMOwgyjrCO5bCIpCaqUmRmrcordbmVtpn7vUX0WLUrllSXua2vrVrO5cwiXvO81MEu8y0kQxNURFlEUWEWVngJnr98fAwMgig8iA5/V8PObBcJ3rnPOe00SvzrnOuWRCCAEiIiIiCbAwdwFERERErYXBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJKNdBB8hBAoKCsBHDhEREdHtaBfBp7CwEI6OjigsLDR3KURERNSOtYvgQ0RERNQSGHyIiIhIMhh8iIiISDIYfIiIiEgyGHyIiIhIMhh8iIiISDIYfIiIiEgyGHyIiIhIMhh8iIiISDIYfIiIiEgyGHyIiIhIMhh8iIiISDIYfIiIiEgyGHyIiIhIMhh8iIiISDIYfIiIiEgyGHyIiIhIMizNXQAREZERIfQvi6r/Ny+9ARTnApVlN700+p9yBdAnzKwlU/vB4ENERPUrK6gbMgw/ywAnX8C1u77v1SQg+ZcG+mr0fcI/rtn2NxOB4pz6+1ZqgHHvAYPn6vvGfwkcWN5wnY6dGXyoyRh8iIjaGiEaCARVP93vAaxU+r4XDwH56Q339QoE+k/W971yAohZWbefVlPz/vm/AaWdvv/GUCDn74brfOAl4MHXqradAOxb3HBfCyvj4JN9BijKarh/dVgCAIUdYO0IWFoDlkpArqx5b2kN2Ls1vB2imzD4EBHdTKerCgO1zkDIZIBTZ/3ySg2Q8mvDl14qNUDAdMDZR9//z/8HXPqt1vJy4/4+Q4F/fKTvm3UK+PS+xutbcAxw7aF/f3i1/kxLQwIerwk+ZQVAckzj267U1AQfS2XVz1oho/ZP24416zn7Avf8s+G+ltb6QCeT6ftP+AQQuqrl9fRV2tdsO2ie/kXUAhh8iKjtqR085EpAYaNvL8wGblyu/+xGRan+P5oDZ+r7CgH8uMj4bMbNPx98Dej2oL7/wSjgj4+rzoCU163JcwDwVKz+vaYQ+PafjX8Gn2E1wSfjBHBmV8N9qwMVoP+8RmR1g4EQteoaCMjktZbf1NdzQE3fjr2B8E/rCSa13ls71vR/8mfAwrImrDSmc7D+1VTVx52olTH4EFFdOi0gs6j5D15+OqApavhyimsPwDNA3zf7DPD3bn0Qqa+v0ALTo2v2teEhID/DuJ+uomb5w28D9/5L//70duCnVxqu296jJvjIZMCxDYCusuH+RVdrfeZKQFNQTyeZ/rJS7UBiaQ14+Dd+dsPevaa/3z8Bj/4N97XpUNPXpSvw4oWaZXKrxoPHqCUNL7uZvRsQ8GjT+8utmt6XqJ1g8CG6W+QkAjfSgNI8oCRP/7P24FR1MDD4SX3fjOPAnoiGL73oKoCXUwAbF33/LY8CWX81vO9hz9YEn6tngUNvN15r7UseBZlAQXrDfSvLat6rXADnLg0HjtoBAgDufxGwkDccONz71/QN/hcQ8FjdPvWd8VDaAf/3v8Y/Y23dHmz6GQ65JWDX8db9iKhZGHyI2orKcqCytOZSQ+kN/ZmT2kGm5Kb3c34EOvbU99+/BLjwc8PbF6Im+FRq9ANdG62n1uBSlbM+dDQUOJx9a/p26AEMntfwpZebx3pM/Vr/e0OXXuS1/kwFPGraGYuRkU3va9eRgYNIAhh8iFqaEEB5cU04cepcc+bk7F7gYmzVsmu1Qsx1oLwQ8L0fmP2Dvm/ZDeC//1/j+yq5VvPetSdQlK0/62Hjog8q1o6AVVWQ6Ninpm/HXsBj3zV8JsTSGrB2quk/6z9N//we/fW3IjdV7TEoRER3GIMPUWN0On0AqX2WRVcJ9HmkarkWiJ4NlF43DjK1B8dO+RroO17/PvV34OhnDe+v9EbNextXoEdorSDjrP9p00Efamxc9ONBqj28qumfy8YF6Bna9P5ERHcJBh+SjkqNcYCp/dNnGND5Xn2/U9uB2Ch9kCm9AUAYb8e2Y03wsZADFw4AFSV19ydX6AOKTlvT1nWE/nkmtc/K1P5Z+44apR0w/bsWPABERNSs4LN+/Xq8++67yMrKgr+/P9auXYugoKB6+1ZUVCAqKgpfffUVMjIy0KtXL7z99tt4+OGHb6twkrhKDVBwpeYyUX1hZsLnNeNDPh4K5JxpeHsjImuCj7YcuHbBeLnCHrCpGudid9PD0sa+W3Vnzk1BRmFbd1Bs9xD9i4iIzMLk4LNt2zZERETg008/RXBwMFavXo3Q0FAkJSWhU6dOdfq/9tpr+Pe//40vvvgCvXv3xk8//YQJEybg999/x4ABvLZPtWSd1j+jpb6zMiV5QLeRwPCX9X0v/Qr8+xbPURnzDmDrqn9f/SA2mUXVJaMOxiHF3a9mvW4PArP31ixTOQOWiob3M+Dx5n9mIiJqVTIhhLh1txrBwcEYPHgw1q1bBwDQ6XRQq9VYuHAhFi+u+7hyT09PvPrqq5g/f76h7Z///CdUKhX+/e9/N2mfBQUFcHR0RH5+PhwcHEwpl1pTRan+VT2QtywfOBVd/xmZkmv693P2AW599f03TwPO/djw9vuO14+XAfS3Y385ttZZFueaIFMdagY8DlhXfV8KMvWDfJWONRMfEhGR5Jh0xqe8vBzx8fGIjKy5RdTCwgIhISGIi4urdx2NRgNra2ujNpVKhd9++63B/Wg0Gmg0NbfSFhTU91AxumN0OkCTXxVUruufm2Jb9XyUs3v1Y1qMgkzVwN7KUqDzUOCJqvCiKQL2vND4vmrfldSpt37SwpvHvVS/rz2Q13MA8Foj8/zczMGj6X2JiOiuZVLwyc3NhVarhZub8RgHNzc3nD17tt51QkND8cEHH+CBBx5At27dEBMTg507d0Kr1dbbHwCioqKwYsUKU0qjhmgr6l460lYA90zULxcC2Dq95gxMddgRtf75/HMD4DdJ/z79qP5puA0py695b9MB6P1Izd1IN5+RsXExflR/yPKmf66mPEKfiIjoJnf8rq41a9Zg3rx56N27N2QyGbp164Y5c+Zg48aNDa4TGRmJiIgIw+8FBQVQq9V3utS2TQj9nUO1LxNVh5SSPP0kh13u1/c9tR2IeV2/rL5H8Kuca4KPTKYfL1NfPytbfTipHTLqvSup1piZ2hMLWlkD075tsUNARER0u0wKPq6urpDL5cjOzjZqz87Ohru7e73rdOzYEd9//z3Kyspw7do1eHp6YvHixejatWu9/QFAqVRCqbx5or67TEUZUJBRT5Cp9XPi/6sZVPvJsMbvSnrgpZrgo9PqBwkbyACVU60zLq7GT84d94F+Tp7aZ2NUzvrgcrOuI/QvIiKidsik4KNQKBAYGIiYmBiEh4cD0A9ujomJwYIFCxpd19raGl5eXqioqMCOHTswZcqUZhfdZmX+BVxPqfUgu+vGYabrcP1s0ACQGgd8E9749sa8UzPRocJW/7P62TA3D+r1CKhZr9uDwBP7a4KMtaP+eTMN6T+5uZ+YiIioXTH5UldERARmzZqFQYMGISgoCKtXr0ZxcTHmzJkDAJg5cya8vLwQFRUFADhy5AgyMjIQEBCAjIwMLF++HDqdDi+//HLLfpLbJQRQXqQ/E1M9X09ZAXByy01TC+QZPztmzl79LM2AfmLGsz80vA+7Wrf723QwfjbMzWNfVC76GaGrTdus/72+Z8PU2Q/nHCIiIqqPycFn6tSpuHr1KpYuXYqsrCwEBARg3759hgHPqampsKh1u3BZWRlee+01XLx4EXZ2dhg7diy++eYbODk5tdiHMMnZPcC5ffWfkdFVAN5BwNyqiR4rSoEfbxHQSvJq3rv1A4pz67/FWuViPJGjR3/glUZmpL4ZgwwREdFtM/k5PubQos/x+eVN4H/vNLy8U1/gmapb87UVwI659U8tUP3Twav+sTBERETU5khvrq6uw/UDeRu6xVphU9NXbgVM+cp8tRIREVGLkt4ZHyIiIpIsPrufiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJKNZwWf9+vXw9fWFtbU1goODcfTo0Ub7r169Gr169YJKpYJarcbzzz+PsrKyZhVMRERE1FwmB59t27YhIiICy5Ytw/Hjx+Hv74/Q0FDk5OTU23/z5s1YvHgxli1bhsTERGzYsAHbtm3DK6+8ctvFExEREZlCJoQQpqwQHByMwYMHY926dQAAnU4HtVqNhQsXYvHixXX6L1iwAImJiYiJiTG0vfDCCzhy5Ah+++23eveh0Wig0WgMvxcUFECtViM/Px8ODg6mlEtERERkYNIZn/LycsTHxyMkJKRmAxYWCAkJQVxcXL3rDB06FPHx8YbLYRcvXsTevXsxduzYBvcTFRUFR0dHw0utVptSJhEREVG9LE3pnJubC61WCzc3N6N2Nzc3nD17tt51HnvsMeTm5uK+++6DEAKVlZX417/+1eilrsjISERERBh+rz7jQ0RERHQ77vhdXbGxsVi1ahU+/vhjHD9+HDt37sSePXuwcuXKBtdRKpVwcHAwehERERHdLpPO+Li6ukIulyM7O9uoPTs7G+7u7vWus2TJEsyYMQNz584FAPj5+aG4uBhPPfUUXn31VVhY8I56IiIiah0mpQ6FQoHAwECjgco6nQ4xMTEYMmRIveuUlJTUCTdyuRwAYOK4aiIiIqLbYtIZHwCIiIjArFmzMGjQIAQFBWH16tUoLi7GnDlzAAAzZ86El5cXoqKiAABhYWH44IMPMGDAAAQHB+PChQtYsmQJwsLCDAGIiIiIqDWYHHymTp2Kq1evYunSpcjKykJAQAD27dtnGPCcmppqdIbntddeg0wmw2uvvYaMjAx07NgRYWFhePPNN1vuUxARERE1gcnP8TGHgoICODo68jk+REREdFs4spiIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJKNZwWf9+vXw9fWFtbU1goODcfTo0Qb7jhgxAjKZrM5r3LhxzS6aiIiIqDlMDj7btm1DREQEli1bhuPHj8Pf3x+hoaHIycmpt//OnTuRmZlpeJ0+fRpyuRyTJ0++7eKJiIiITCETQghTVggODsbgwYOxbt06AIBOp4NarcbChQuxePHiW66/evVqLF26FJmZmbC1tW3SPgsKCuDo6Ij8/Hw4ODiYUi4RERGRgUlnfMrLyxEfH4+QkJCaDVhYICQkBHFxcU3axoYNGzBt2rRGQ49Go0FBQYHRi4iIiOh2mRR8cnNzodVq4ebmZtTu5uaGrKysW65/9OhRnD59GnPnzm20X1RUFBwdHQ0vtVptSplERERE9WrVu7o2bNgAPz8/BAUFNdovMjIS+fn5hldaWlorVUhERER3M0tTOru6ukIulyM7O9uoPTs7G+7u7o2uW1xcjK1bt+L111+/5X6USiWUSqUppRERERHdkklnfBQKBQIDAxETE2No0+l0iImJwZAhQxpdNzo6GhqNBo8//njzKiUiIiK6TSad8QGAiIgIzJo1C4MGDUJQUBBWr16N4uJizJkzBwAwc+ZMeHl5ISoqymi9DRs2IDw8HB06dGiZyomIiIhMZHLwmTp1Kq5evYqlS5ciKysLAQEB2Ldvn2HAc2pqKiwsjE8kJSUl4bfffsP+/ftbpmoiIiKiZjD5OT7mwOf4EBERUUvgXF1EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREJBkMPkRERCQZDD5EREQkGQw+REREZMTX1xerV69uUl+ZTIbvv//+jtbTkhh8iIiISDIYfIiIiEgyGHyIiIiaQAiBkvJKs7yEEE2u8/PPP4enpyd0Op1R+/jx4/HEE08gOTkZ48ePh5ubG+zs7DB48GAcOHCgxY7TqVOn8OCDD0KlUqFDhw546qmnUFRUZFgeGxuLoKAg2NrawsnJCcOGDcPly5cBACdPnsTIkSNhb28PBwcHBAYG4tixYy1WGwBYtujWiIiI7lKlFVr0XfqTWfb99+uhsFE07T/ZkydPxsKFC3Hw4EGMGjUKAJCXl4d9+/Zh7969KCoqwtixY/Hmm29CqVTi66+/RlhYGJKSktC5c+fbqrO4uBihoaEYMmQI/vzzT+Tk5GDu3LlYsGABNm3ahMrKSoSHh2PevHnYsmULysvLcfToUchkMgDA9OnTMWDAAHzyySeQy+VISEiAlZXVbdV0MwYfIiKiu4izszPGjBmDzZs3G4LP9u3b4erqipEjR8LCwgL+/v6G/itXrsSuXbvwn//8BwsWLLitfW/evBllZWX4+uuvYWtrCwBYt24dwsLC8Pbbb8PKygr5+fl45JFH0K1bNwBAnz59DOunpqbipZdeQu/evQEAPXr0uK166sPgQ0RE1AQqKzn+fj3UbPs2xfTp0zFv3jx8/PHHUCqV+PbbbzFt2jRYWFigqKgIy5cvx549e5CZmYnKykqUlpYiNTX1tutMTEyEv7+/IfQAwLBhw6DT6ZCUlIQHHngAs2fPRmhoKEaPHo2QkBBMmTIFHh4eAICIiAjMnTsX33zzDUJCQjB58mRDQGopHONDRETUBDKZDDYKS7O8qi8FNVVYWBiEENizZw/S0tLw66+/Yvr06QCAF198Ebt27cKqVavw66+/IiEhAX5+figvL78Th62OL7/8EnFxcRg6dCi2bduGnj174o8//gAALF++HGfOnMG4cePwyy+/oG/fvti1a1eL7r9ZwWf9+vXw9fWFtbU1goODcfTo0Ub737hxA/Pnz4eHhweUSiV69uyJvXv3NqtgIiIiapy1tTUmTpyIb7/9Flu2bEGvXr0wcOBAAMDhw4cxe/ZsTJgwAX5+fnB3d8elS5daZL99+vTByZMnUVxcbGg7fPgwLCws0KtXL0PbgAEDEBkZid9//x333HMPNm/ebFjWs2dPPP/889i/fz8mTpyIL7/8skVqq2Zy8Nm2bRsiIiKwbNkyHD9+HP7+/ggNDUVOTk69/cvLyzF69GhcunQJ27dvR1JSEr744gt4eXnddvFERERUv+nTp2PPnj3YuHGj4WwPoB83s3PnTiQkJODkyZN47LHH6twBdjv7tLa2xqxZs3D69GkcPHgQCxcuxIwZM+Dm5oaUlBRERkYiLi4Oly9fxv79+3H+/Hn06dMHpaWlWLBgAWJjY3H58mUcPnwYf/75p9EYoBYhTBQUFCTmz59v+F2r1QpPT08RFRVVb/9PPvlEdO3aVZSXlzd5H2VlZSI/P9/wSktLEwBEfn6+qeUSERFJklarFR4eHgKASE5ONrSnpKSIkSNHCpVKJdRqtVi3bp0YPny4ePbZZw19fHx8xIcfftik/QAQu3btMvz+119/iZEjRwpra2vh4uIi5s2bJwoLC4UQQmRlZYnw8HDh4eEhFAqF8PHxEUuXLhVarVZoNBoxbdo0oVarhUKhEJ6enmLBggWitLS0JQ6Hgayq6CYpLy+HjY0Ntm/fjvDwcEP7rFmzcOPGDezevbvOOmPHjoWLiwtsbGywe/dudOzYEY899hgWLVoEubz+wVrLly/HihUr6rTn5+fDwcGhqeUSERERGTHpUldubi60Wi3c3NyM2t3c3JCVlVXvOhcvXsT27duh1Wqxd+9eLFmyBO+//z7eeOONBvcTGRmJ/Px8wystLc2UMomIiIjqdcdvZ9fpdOjUqRM+//xzyOVyBAYGIiMjA++++y6WLVtW7zpKpRJKpfJOl0ZERESN+Pbbb/F///d/9S7z8fHBmTNnWrmi22dS8HF1dYVcLkd2drZRe3Z2Ntzd3etdx8PDA1ZWVkaXtfr06YOsrCyUl5dDoVA0o2wiIiK60/7xj38gODi43mUt/UTl1mJS8FEoFAgMDERMTIxhjI9Op0NMTEyDT3scNmwYNm/eDJ1OBwsL/ZW1c+fOwcPDg6GHiIioDbO3t4e9vb25y2hRJt/OHhERgS+++AJfffUVEhMT8fTTT6O4uBhz5swBAMycORORkZGG/k8//TTy8vLw7LPP4ty5c9izZw9WrVqF+fPnt9ynICIiImoCk8f4TJ06FVevXsXSpUuRlZWFgIAA7Nu3zzDgOTU11XBmBwDUajV++uknPP/88+jfvz+8vLzw7LPPYtGiRS33KYiIiIiawKTb2c2loKAAjo6OvJ2diIiIbgvn6iIiIiLJYPAhIiIiyWDwISIiIslg8CEiIiIjvr6+WL16tbnLuCMYfIiIiEgyGHyIiIhIMhh8iIiITFFe3PhLW1nTt7K88b4VpTV9hai/j4k+//xzeHp6QqfTGbWPHz8eTzzxBJKTkzF+/Hi4ubnBzs4OgwcPxoEDB5p7NPDBBx/Az88Ptra2UKvVeOaZZ1BUVGTU5/DhwxgxYgRsbGzg7OyM0NBQXL9+HYB+Boh33nkH3bt3h1KpROfOnfHmm282u55bueOTlBIREd1VVnk2vnzyJqDfBP37X14Hfl/bcF/PAcBTsfr3JdeAd7vV7bM836TyJk+ejIULF+LgwYMYNWoUACAvLw/79u3D3r17UVRUhLFjx+LNN9+EUqnE119/jbCwMCQlJaFz584m7QsALCws8NFHH6FLly64ePEinnnmGbz88sv4+OOPAQAJCQkYNWoUnnjiCaxZswaWlpY4ePAgtFotACAyMhJffPEFPvzwQ9x3333IzMzE2bNnTa6jqRh8iIiI7iLOzs4YM2YMNm/ebAg+27dvh6urK0aOHAkLCwv4+/sb+q9cuRK7du3Cf/7znwbn3WzMc889Z3jv6+uLN954A//6178Mweedd97BoEGDDL8DQL9+/QAAhYWFWLNmDdatW4dZs2YBALp164b77rvP5DqaisGHiIjIFK9caXy5XFnz/sGlwIjIhvvKao04selw62030fTp0zFv3jx8/PHHUCqV+PbbbzFt2jRYWFigqKgIy5cvx549e5CZmYnKykqUlpYiNTW1Wfs6cOAAoqKicPbsWRQUFKCyshJlZWUoKSmBjY0NEhISMHny5HrXTUxMhEajMQS01sAxPkRERKZQ2Db+ktc6p2CpaLyvlaqmr0xWf59mCAsLgxACe/bsQVpaGn799VdMnz4dAPDiiy9i165dWLVqFX799VckJCTAz88P5eXlJu/n0qVLeOSRR9C/f3/s2LED8fHxWL9+PQAYtqdSqRpcv7FldwqDDxER0V3G2toaEydOxLfffostW7agV69eGDhwIAD9QOPZs2djwoQJ8PPzg7u7Oy5dutSs/cTHx0On0+H999/Hvffei549e+LKFeOzVv3790dMTEy96/fo0QMqlarB5XcCL3URERHdhaZPn45HHnkEZ86cweOPP25o79GjB3bu3ImwsDDIZDIsWbKkzh1gTdW9e3dUVFRg7dq1CAsLw+HDh/Hpp58a9YmMjISfnx+eeeYZ/Otf/4JCocDBgwcxefJkuLq6YtGiRXj55ZehUCgwbNgwXL16FWfOnMGTTz55W5+/ITzjQ0REdBd68MEH4eLigqSkJDz22GOG9g8++ADOzs4YOnQowsLCEBoaajgbZCp/f3988MEHePvtt3HPPffg22+/RVRUlFGfnj17Yv/+/Th58iSCgoIwZMgQ7N69G5aW+nMvS5YswQsvvIClS5eiT58+mDp1KnJycpr/wW9BJoQQd2zrLaSgoACOjo7Iz8+Hg4ODucshIiKidopnfIiIiEgyGHyIiIioXt9++y3s7OzqfVU/i6e94aUuIiIiqldhYSGys7PrXWZlZQUfH59Wruj28a4uIiIiqpe9vT3s7e3NXUaL4qUuIiIikgwGHyIiIpIMBh8iIiKSDAYfIiIikgwGHyIiIpIMBh8iIiJqUZcuXYJMJkNCQoK5S6mDwYeIiOguM2LECDz33HMttr3Zs2cjPDy8xbZnTgw+REREJBkMPkRERCYoqShBSUUJqic+KK0sRUlFCbQ6LQBAo9WgpKIEFboKAECFtgIlFSUo15YDACp1lSipKEFZZRkAQCd0hm02tA9TzJ49G4cOHcKaNWsgk8kgk8lw6dIlnD59GmPGjIGdnR3c3NwwY8YM5ObmGtbbvn07/Pz8oFKp0KFDB4SEhKC4uBjLly/HV199hd27dxu2Fxsba3Jdhw4dQlBQEJRKJTw8PLB48WJUVlbecv8AEBsbi6CgINja2sLJyQnDhg3D5cuXTa4BYPAhIiIySfDmYARvDsZ1zXUAwKM/PIrgzcE4nnMcABD5aySCNwdj+7ntAIAvTn2B4M3BeOfPdwAAMakxCN4cjKcPPA0AuHjjIoI3B+PhHQ83uA9TrFmzBkOGDMG8efOQmZmJzMxM2Nvb48EHH8SAAQNw7Ngx7Nu3D9nZ2ZgyZQoAIDMzE48++iieeOIJJCYmIjY2FhMnToQQAi+++CKmTJmChx9+2LC9oUOHmlRTRkYGxo4di8GDB+PkyZP45JNPsGHDBrzxxhu33H9lZSXCw8MxfPhw/PXXX4iLi8NTTz0FmUxm8rEBOGUFERHRXcXR0REKhQI2NjZwd3cHALzxxhsYMGAAVq1aZei3ceNGqNVqnDt3DkVFRaisrMTEiRMN82/5+fkZ+qpUKmg0GsP2TPXxxx9DrVZj3bp1kMlk6N27N65cuYJFixZh6dKlyMzMbHD/eXl5yM/PxyOPPIJu3boBAPr06dOsOgAGHyIiIpMceewIAEBlqQIAbHlkC4QQUMqVAICo+6PwxrA3YCW3AgDM85uH2f1mw9JC/5/cUZ1H4chjR2Ah01906erU1bDNhvZxu06ePImDBw/Czs6uzrLk5GQ89NBDGDVqFPz8/BAaGoqHHnoIkyZNgrOzc4vsPzExEUOGDDE6SzNs2DAUFRUhPT0d/v7+De7fxcUFs2fPRmhoKEaPHo2QkBBMmTIFHh4ezaqFl7qIiIhMYGNlAxsrG8N/xFWWKthY2UBuIQcAKOVK2FjZwMpCH3ys5FawsbKBQq4AAFhaWMLGygbWltYAAAuZhWGbDe3jdhUVFSEsLAwJCQlGr/Pnz+OBBx6AXC7Hzz//jB9//BF9+/bF2rVr0atXL6SkpLTI/m/lVvv/8ssvERcXh6FDh2Lbtm3o2bMn/vjjj2bti8GHiIjoLqNQKKDVag2/Dxw4EGfOnIGvry+6d+9u9LK1tQUAyGQyDBs2DCtWrMCJEyegUCiwa9euerdnqj59+iAuLs5osPbhw4dhb28Pb2/vW+4fAAYMGIDIyEj8/vvvuOeee7B58+Zm1cLgQ0REdJfx9fXFkSNHcOnSJeTm5mL+/PnIy8vDo48+ij///BPJycn46aefMGfOHGi1Whw5cgSrVq3CsWPHkJqaip07d+Lq1auGsTS+vr7466+/kJSUhNzcXFRUVJhUzzPPPIO0tDQsXLgQZ8+exe7du7Fs2TJERETAwsKi0f2npKQgMjIScXFxuHz5Mvbv34/z5883f5yPaAfy8/MFAJGfn2/uUoiIiNq8pKQkce+99wqVSiUAiJSUFHHu3DkxYcIE4eTkJFQqlejdu7d47rnnhE6nE3///bcIDQ0VHTt2FEqlUvTs2VOsXbvWsL2cnBwxevRoYWdnJwCIgwcPNrr/lJQUAUCcOHHC0BYbGysGDx4sFAqFcHd3F4sWLRIVFRVCCNHo/rOyskR4eLjw8PAQCoVC+Pj4iKVLlwqtVtusYyMTohkPCWhlBQUFcHR0RH5+PhwcHMxdDhEREbVTvNRFREREksHgQ0RERCZZtWoV7Ozs6n2NGTPG3OU1ipe6iIiIyCR5eXnIy8urd5lKpYKXl1crV9R0fIAhERERmcTFxQUuLi7mLqNZeKmLiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIjoLjNixAg899xzLba92bNnIzw8vMW2Z07NCj7r16+Hr68vrK2tERwcjKNHjzbYd9OmTZDJZEYva2vrZhdMRERE1FwmB59t27YhIiICy5Ytw/Hjx+Hv74/Q0FDk5OQ0uI6DgwMyMzMNr8uXL99W0UREROaiKymp9yW0WgCA0OmM2quJior61y0trdl2eXlNe3l5s+qbPXs2Dh06hDVr1hhOOFy6dAmnT5/GmDFjYGdnBzc3N8yYMQO5ubmG9bZv3w4/Pz+oVCp06NABISEhKC4uxvLly/HVV19h9+7dhu3Fxsbeso5FixahZ8+esLGxQdeuXbFkyRJUVFQY9fnvf/+LwYMHw9raGq6urpgwYYJhmUajwaJFi6BWq6FUKtG9e3ds2LChWcekNpOf3PzBBx9g3rx5mDNnDgDg008/xZ49e7Bx40YsXry43nVkMhnc3d1vr1IiIqI2IGlgYL3tnb/6CrbBQahITUXyw1XzVVlaos/pUwCA6999h+yVb9RZT9G9G7r98AMAIOe993D9628AAM4zZ8D9lVdMrm/NmjU4d+4c7rnnHrz++usAACsrKwQFBWHu3Ln48MMPUVpaikWLFmHKlCn45ZdfkJmZiUcffRTvvPMOJkyYgMLCQvz6668QQuDFF19EYmIiCgoK8OWXXwJAk57abG9vj02bNsHT0xOnTp3CvHnzYG9vj5dffhkAsGfPHkyYMAGvvvoqvv76a5SXl2Pv3r2G9WfOnIm4uDh89NFH8Pf3R0pKilFQay6Tgk95eTni4+MRGRlpaLOwsEBISAji4uIaXK+oqAg+Pj7Q6XQYOHAgVq1ahX79+jXYX6PRQKPRGH4vKCgwpUwiIiLJcnR0hEKhgI2NjeGkwxtvvIEBAwZg1apVhn4bN26EWq3GuXPnUFRUhMrKSkycOBE+Pj4AAD8/P0NflUoFjUZj0kmM1157zfDe19cXL774IrZu3WoIPm+++SamTZuGFStWGPr5+/sDAM6dO4fvvvsOP//8M0JCQgAAXbt2NfVQ1Muk4JObmwutVgs3Nzejdjc3N5w9e7bedXr16oWNGzeif//+yM/Px3vvvYehQ4fizJkz8Pb2rnedqKgoowNBRETUVvQ6Hl9vu0ypBABYde5cbx/nKVPgVOtSTs2KMsPbTi++iE7Vg5ItW246zZMnT+LgwYOws7Orsyw5ORkPPfQQRo0aBT8/P4SGhuKhhx7CpEmT4Ozs3Ox9btu2DR999BGSk5MNwar2ROMJCQmYN29evesmJCRALpdj+PDhzd5/Q+74XV1DhgzBzJkzERAQgOHDh2Pnzp3o2LEjPvvsswbXiYyMRH5+vuGVlpZ2p8skIiJqEgsbm3pfMrkcACCzsDBqryazsqp/XZWqZtsKRU27QtFiNRcVFSEsLAwJCQlGr/Pnz+OBBx6AXC7Hzz//jB9//BF9+/bF2rVr0atXL6SkpDRrf3FxcZg+fTrGjh2LH374ASdOnMCrr76K8lrjllS1PvfNGlt2u0wKPq6urpDL5cjOzjZqz87ObvLpLysrKwwYMAAXLlxosI9SqYSDg4PRi4iIiJpGoVBAWzXYGgAGDhyIM2fOwNfXF927dzd62draAtCPxx02bBhWrFiBEydOQKFQYNeuXfVu71Z+//13+Pj44NVXX8WgQYPQo0ePOjc29e/fHzExMfWu7+fnB51Oh0OHDpn60W/JpOCjUCgQGBhoVKhOp0NMTAyGDBnSpG1otVqcOnUKHh4eplVKRERETeLr64sjR47g0qVLyM3Nxfz585GXl4dHH30Uf/75J5KTk/HTTz9hzpw50Gq1OHLkCFatWoVjx44hNTUVO3fuxNWrV9GnTx/D9v766y8kJSUhNze3zt1ZN+vRowdSU1OxdetWJCcn46OPPjKEqGrLli3Dli1bsGzZMiQmJuLUqVN4++23DfubNWsWnnjiCXz//fdISUlBbGwsvvvuu9s/OMJEW7duFUqlUmzatEn8/fff4qmnnhJOTk4iKytLCCHEjBkzxOLFiw39V6xYIX766SeRnJws4uPjxbRp04S1tbU4c+ZMk/eZn58vAIj8/HxTyyUiIpKcpKQkce+99wqVSiUAiJSUFHHu3DkxYcIE4eTkJFQqlejdu7d47rnnhE6nE3///bcIDQ0VHTt2FEqlUvTs2VOsXbvWsL2cnBwxevRoYWdnJwCIgwcP3rKGl156SXTo0EHY2dmJqVOnig8//FA4Ojoa9dmxY4cICAgQCoVCuLq6iokTJxqWlZaWiueff154eHgIhUIhunfvLjZu3Hjbx0YmhBCmhqV169bh3XffRVZWFgICAvDRRx8hODgYgP5pkb6+vti0aRMA4Pnnn8fOnTuRlZUFZ2dnBAYGGkaXN1VBQQEcHR2Rn5/Py15ERETUbM0KPq2NwYeIiIhaAufqIiIiIpOsWrUKdnZ29b7GjBlj7vIaxTM+REREZJK8vDzk5eXVu0ylUsHLy6uVK2q6lns6EhEREUmCi4tLk6ataIt4qYuIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkQ1LB5/cLuXjq62P4+e9sVGh15i6HiIiIWpmluQtoTVv/TMP+v7Ox/+9suNopMGGAFyYFqtHL3d7cpREREVErkAkhhLmLuJWCggI4OjoiPz8fDg4Ozd5OUlYhoo+l4fuEDOQWlRva+3s7YnKgN8L8PeFko2iJkomIiKgNklTwqVah1SE26Sqij6Xhl7M5qNTpD4FCboHR/dwwOdAb9/foCLmF7Lb3RURERG2HJINPbdeKNPg+4Qqij6XhbFahod3dwRoTB3phUqA3una0a9F9EhERkXlIPvhUE0LgzJUCRB9Lw+6TV3CjpMKwLNDHGZMDvTGuvwfsra3uyP6JiIjozmPwqYemUouYxBxEH0vDoXNXUXUlDNZWFhhzjwcmB3rj3q4dYMFLYURERO0Kg88t5BSUYeeJDEQfS0Py1WJDu7ezCv8c6I1Jgd5Qu9i0ak1ERETUPAw+TSSEwIm0G4g+lo4fTl5BoabSsOzeri6YHKjGGD932Cgk9YQAIiKidoXBpxnKKrT46UwWoo+l43ByLqqPoK1CjnH9PTB5kBqDfJwhk/FSGBERUVvC4HObMm6UYmd8OrYfT8flayWG9i6utpgU6I2JA73g4agyY4VERERUjcGnhQghcDQlD9Hx6dh7KhMl5VoAgEwG3NfdFZMHqfFQXzdYW8nNXCkREZF0MfjcAcWaSuw9lYno+HQcTckztDtYW+IfAZ6YFKiGv7cjL4URERG1MgafO+zytWLsiE/HjuMZyLhRamjv0ckOkwd5I3yAFzrZW5uxQiIiIulg8GklOp3A78nXEB2fhn2ns6Cp1M8OL7eQYUTPjpg8yBsP9naDwtLCzJUSERHdvRh8zKCgrAI/nMxEdHwaTqTeMLS72CowPsATkwK90c/T0XwFEhER3aUYfMzsQk4htsdnYOfxdOQUagztfT0cMHmQN8YHeMHFljPGExERtYRmXVdZv349fH19YW1tjeDgYBw9erRJ623duhUymQzh4eHN2e1dqXsneywe0xu/L34QX84ejLF+7lDILfB3ZgFW/PdvBK86gH99E4+YxGxUanXmLpeIiKhdM/mMz7Zt2zBz5kx8+umnCA4OxurVqxEdHY2kpCR06tSpwfUuXbqE++67D127doWLiwu+//77Ju/zbj7jU5/rxeX4z8kriI5Pw+mMAkN7R3slJg7Qzxjfw83ejBUSERG1TyYHn+DgYAwePBjr1q0DAOh0OqjVaixcuBCLFy+udx2tVosHHngATzzxBH799VfcuHGj0eCj0Wig0dRc9ikoKIBarZZM8KktMbMA2+PT8f2JDFwrLje0+6udMDnQG2H+nnBUccZ4IiKipjDpUld5eTni4+MREhJSswELC4SEhCAuLq7B9V5//XV06tQJTz75ZJP2ExUVBUdHR8NLrVabUuZdpY+HA5Y80hdxkaPw2YxAhPRxg9xChpNpN/Da96cx+M0DWLjlBP537iq0ujY/XIuIiMisTJpRMzc3F1qtFm5ubkbtbm5uOHv2bL3r/Pbbb9iwYQMSEhKavJ/IyEhEREQYfq8+4yNlCksLhPZzR2g/d1wt1GB3Qgaij6UjKbsQ/z15Bf89eQUejtb450Bv/DPQG11cbc1dMhERUZtzR6cSLywsxIwZM/DFF1/A1dW1yesplUoolco7WFn71tFeibn3d8WT93XBqYx8RB9Lx+6EDGTml2HdwQtYd/ACBvs6Y3KgGmP7e8BOyRnjiYiIABODj6urK+RyObKzs43as7Oz4e7uXqd/cnIyLl26hLCwMEObTqe/M8nS0hJJSUno1q1bc+omADKZDP29ndDf2wmvjuuDA4nZiD6Wjl/PX8Wfl67jz0vXsew/ZzDWzwOTAr0R3MUFFhacJoOIiKSrWYObg4KCsHbtWgD6INO5c2csWLCgzuDmsrIyXLhwwajttddeQ2FhIdasWYOePXtCobj1M2qkdlfX7crKL8POE+nYfiwdF3OLDe1qFxUmDVRj4kAvqF1szFghERGReTTrdvZZs2bhs88+Q1BQEFavXo3vvvsOZ8+ehZubG2bOnAkvLy9ERUXVu/7s2bNveVfXzRh8mkcIgeOp1xF9LB0//JWJIk2lYdnQbh0weZA3Hu7nAZWCM8YTEZE0mDz4Y+rUqbh69SqWLl2KrKwsBAQEYN++fYYBz6mpqbCw4HxTbYFMJkOgjwsCfVywLKwf9p3JRPSxdPyefM3wWqo8g0f89ZfCBnZ25ozxRER0V+OUFRKUfr0EO+IzsP14GtLyamaM79rRFpMCvTFxgDfcHTljPBER3X0YfCRMpxM4kpKH6Pg0/HgqC6UVWgCAhQy4v4d+xviQPm6wtuKlMCIiujsw+BAAoEhTib1/6WeM//PSdUO7o8rKMGO8n5cjL4UREVG7xuBDdVzKLcb2+HTsOJ6OzPwyQ3svN3tMHuSN8AFecLXjc5aIiKj9YfChBml1Aocv5CI6Ph0/nclCeWXVM5gsZBjZuxMmBXrjwd6dYCXnYHYiImofGHyoSfJLK/Dfk1cQHZ+Ok2k3DO0dbBUIr5oxvo8H/9kQEVHbxuBDJjufXYjt8enYeSIDVws1hvZ7vBwwOVCN8QGecLK59YMpiYiIWhuDDzVbpVaHQ+euIvpYOmLOZqNCq/8qKeQWGN3XDZMCvXF/D1dY8lIYERG1EQw+1CLyissNM8b/nVlgaO9kr8TEgd6YFOiN7p3szFghERERgw/dAWeu5GN7fDq+P5GB6yUVhvYBnZ0wOVCNR/w94GBtZcYKiYhIqhh86I4pr9Thl7P6GeNjz12FVqf/qllbWeDhfu6YFKjG0G4dOGM8ERG1GgYfahU5hWX4/oT+Utj5nCJDu5eTCv8c6IVJgWp07sAZ44mI6M5i8KFWJYTAyfR8bI9Pw38SrqCgrGbG+KAuLpgc6I2xfh6wVZo8fy4REdEtMfiQ2ZRVaLH/72xEH0vDbxdyUf1NtFHIMc5PP2N8UBcXTpNBREQthsGH2oQrN0qx60QGoo+l4dK1EkO7TwcbTBrojYmB3vByUpmxQiIiuhsw+FCbIoTAscvXsf1YOn746wqKy/UzxstkwLBurpg8yBuh/dw5YzwRETULgw+1WSXllfjxVBai49Pwx8U8Q7u9tSXC/PUzxg9QO/FSGBERNRmDD7ULqddKsON4OrbHpyPjRqmhvXsnO0wK9MbEAV7o5GBtxgqJiKg9YPChdkWnE/jj4jVEx6fjx9OZKKvQzxhvIQOG9+yIyYPUGNWnE5SWvBRGRER1MfhQu1VYVoE9f2UiOj4d8ZevG9qdbKwQHqCfMb6fpwMvhRERkQGDD90Vkq8WYUd8OnYez0BWQZmhvbe7PSYPUiM8wBMd7JRmrJCIiNoCBh+6q2h1Ar+ev4ro+HT8fCYb5Vr9pTBLCxlG9emESYFqjOjVEVacMZ6ISJIYfOiudaOkHP89eQXR8en4Kz3f0O5qp8SEAZ6YPEiNnm72ZqyQiIhaG4MPSUJSViG2x6dh14kM5BaVG9r9vR0xKdAb//D3gqMNZ4wnIrrbMfiQpFRodYhNuoroY2n45WwOKqtmjFdYWuChvm6YFOiN+3t0hJwzxhMR3ZUYfEiyrhVp8H3CFUQfS8PZrEJDu7uDNSYO1N8V1rWjnRkrJCKilsbgQ5InhMCZKwXYHp+O7xMycKOkwrBskI8zJgV6Y1x/D9hb81IYEVF7x+BDVIumUouYxBxEH0vDoXNXUXUlDNZWFhh7j37G+Hu7doAFL4UREbVLDD5EDcgpKMPOqhnjk68WG9q9nVX450BvTAr0htrFxowVEhGRqRh8iG5BCIETaTewPT4d/024gkJNpWHZkK4dMCnQG2P83GGjsDRjlURE1BQMPkQmKKvQ4qczWYg+lo7Dybmo/rfHTmmJcX4emDTIG4N8nDlNBhFRG8XgQ9RMGTdKsTM+HduPp+PytRJDexdXW/2M8QO94OGoMmOFRER0MwYfotskhMDRlDxsj0/HnlOZKCnXAtDPGH9fj46YFOiNh/q6wdqKM8YTEZkbgw9RCyrWVGLvKf2M8UdT8gztDtaW+EeAJyYHqtHf25GXwoiIzITBh+gOuXytGDvi07HjeAYybpQa2nu62WFSoDfCB3ihk721GSskIpIeBh+iO0ynE/g9+Rq2x6fhx9NZ0FTqZ4yXW8gwspf+UtiDvd2gsOSM8UREdxqDD1ErKiirwA8nMxEdn4YTqTcM7S62CoyvuhTW15PfcSKiO4XBh8hMLuQUYnt8BnYeT0dOocbQ3tfDAZMHeWN8gBdcbBVmrJCI6O7D4ENkZpVaHX49n4vt8en4+e9slGv1l8Ks5DKE9NHPGD+8Z0dYynkpjIjodjH4ELUh14vL8Z+TVxAdn4bTGQWG9o72Skwc4IXJg7zRvZO9GSskImrfGHyI2qjEzKoZ409k4FpxuaHdX+2EyYHeCPP3hKOKM8YTEZmCwYeojSuv1OFgUg6ij6XjYFIOtFVTxistLRDazx2TAr0xrLsr5Jwxnojolhh8iNqRq4Ua7E7IQPSxdCRlFxraPRytDTPG+7ramrFCIqK2jcGHqB0SQuBURj6ij6Vjd0IGCspqZowf7OuMyYFqjO3vATslZ4wnIqqNwYeonSur0OJAYjaij6Xj1/NXUXUlDDYKOR7s3Qk93ezh62qLLh1s4etqA3trjgsiIuli8CG6i2Tll2HniXRsP5aOi7nF9fbpYKuAr6stfDvYwreDjT4UudrCpwNDERHd/Rh8iO5CQggcT72OPy7mISW3GJdyi3HpWglyizSNrudqp4BvB1v4dLBFF1ebmoDkasvLZkR0V2DwIZKQwrIKXL5WgkvX9GEoJVf//vK1YuQWlTe6rqudss4ZIoYiImpvmhV81q9fj3fffRdZWVnw9/fH2rVrERQUVG/fnTt3YtWqVbhw4QIqKirQo0cPvPDCC5gxY0aT98fgQ3TnFZRV4HJurVB0rVgfknKLjZ4jVB9XO6X+DFFVEPKtGk/k28EWtgxFRNSGmBx8tm3bhpkzZ+LTTz9FcHAwVq9ejejoaCQlJaFTp051+sfGxuL69evo3bs3FAoFfvjhB7zwwgvYs2cPQkNDm7RPBh8i86oORSnXqi+b1Vw+y7tFKOpor0SXDlVniG46W8RQREStzeTgExwcjMGDB2PdunUAAJ1OB7VajYULF2Lx4sVN2sbAgQMxbtw4rFy5skn9GXyI2q780gpcvlaMlNyaM0TVZ4tuFYo62SurzhDZGO4886k6W2SjYCgiopZn0l+W8vJyxMfHIzIy0tBmYWGBkJAQxMXF3XJ9IQR++eUXJCUl4e23326wn0ajgUZTMwizoKCgwb5EZF6OKiv093ZCf2+nOsvySyr0Z4euFeNS9WW0qrNF10sqkFOoQU6hBkdT8uqs6+ag1A+yNlw+qxlsrVLIW+GTEdHdyKTgk5ubC61WCzc3N6N2Nzc3nD17tsH18vPz4eXlBY1GA7lcjo8//hijR49usH9UVBRWrFhhSmlE1AY52ljB38YJ/mqnOstqh6Lqs0UpVZfRbpRUILtAg+yChkORb4fqy2Y1d6D5uDAUEVHjWuVcsr29PRISElBUVISYmBhERESga9euGDFiRL39IyMjERERYfi9oKAAarW6NUololbSWCi6UVKOS1WXzWoGW+t/zy+tCUVH6glF7g7WhoHVNw+0trZiKCKSOpOCj6urK+RyObKzs43as7Oz4e7u3uB6FhYW6N69OwAgICAAiYmJiIqKajD4KJVKKJVKU0ojoruIk40CATYKBDQQilJyb7p8lqs/a1RQVomsgjJkFZThj4t1Q5GHozV8OtigS63nE/lWDbxmKCKSBpOCj0KhQGBgIGJiYhAeHg5AP7g5JiYGCxYsaPJ2dDqd0RgeIqKmcrJRYEBnBQZ0dq6z7HpxedXA6qpnFOUWGwZeF5RVIjO/DJn59YciT0frqoHV+ktnPlWX0jq7MBQR3U1MvtQVERGBWbNmYdCgQQgKCsLq1atRXFyMOXPmAABmzpwJLy8vREVFAdCP1xk0aBC6desGjUaDvXv34ptvvsEnn3zSsp+EiCTP2VYBZ1sFBt4UioQQuF49pqjWk6yrxxcVllXiSn4ZruSXIe7iNaN1ZTLAw8Faf3aoepB1VShSMxQRtTsmB5+pU6fi6tWrWLp0KbKyshAQEIB9+/YZBjynpqbCwsLC0L+4uBjPPPMM0tPToVKp0Lt3b/z73//G1KlTW+5TEBE1QiaTwcVWAZdGQlH11B6Xr9WMJ7qUW4xCTU0o+j25bijydFTBt/oMUa070BiKiNomTllBRNQAIQTyisurzgyVGC6bVY8vKtJUNrhu7VBUfYaoeqC12sUGSkuGIiJzYPAhImoGIQSuFZfXXDYzPLjx1qHIQgZ4OqmM7jirHmzd2cUGCkuLBtclotvD4ENE1MKEEMgtKjc+Q1Tr8llxubbBdatDUZdad5x1qRpfpHZmKCK6XQw+REStqDoU1Ty4UX+GqPr9rUKRl7PK6AxR9R1oDEVETcPgQ0TURgghcLVIY/R8otrPKyq5RSjydra56TlF+stoahcbWMkZiogABh8ionZBCIGrhZo644mqB103ForkFjJ4OamqJoKteUaRr6stvJ1VDEUkKQw+RETtXHUoqh5PVPsOtMvXSlBa0Xgo8q66fKaf+8ymKiDZwouhiO5CDD5ERHcxIQRyqkNRrTvQqieILavQNbiuZXUoqr50VhWKfDvozxRZMhRRO8TgQ0QkUUIIZBdoDAOrU65VP8SxpEmhSO2iH1NU+2xRF1dbeDkxFFHbxeBDRER16HQC2YVlDQ601lTeOhTVPkNUffnM08maoYjMisGHiIhMUh2K9JfPjIPR5WsljYYiK7kMamd9IKp9B1oXV1t4Oqkgt5C14ichKWLwISKiFqPTCWQVlNW686ykZh60vBKU3yoUudigSwfbqjvPas4YMRRRS2HwISKiVqHTCWRWhaLqs0TVd6DdKhQp5BZQu6gMl82qJ4NlKCJTMfgQEZHZaXUCmfmlRmeILlUNsk69VoJy7a1DURdXW3wwNQAO1latWDm1N5bmLoCIiEj/PCEbeDvbYFh3V6Nl1aHoUm6J/vKZ4XlFxUjLK0W5Vofkq8VIu14KOwX/s0aN4zeEiIjatNqh6L4edUPRlRuluHStGHnF5bDgJS+6BQYfIiJqt+RVt86rXWzMXQq1E3yYAhEREUkGgw8RERFJBoMPERERSQaDDxEREUkGgw8RERFJBoMPERERSQaDDxEREUkGgw8RERFJBoMPERERSQaDDxEREUkGgw8RERFJBoMPERERSQaDDxEREUkGgw8RERFJBoMPERERSQaDDxEREUkGgw8RERFJBoMPERERSQaDDxEREUmGpbkLaAohBACgoKDAzJUQEZFU2NvbQyaTmbsMamHtIvgUFhYCANRqtZkrISIiqcjPz4eDg4O5y6AWJhPVp1PaMJ1OhytXrtx2+i4oKIBarUZaWlq7+zKzdvNg7ebB2s2DtRvjGZ+7U7s442NhYQFvb+8W256Dg0O7+5e6Gms3D9ZuHqzdPFg73c04uJmIiIgkg8GHiIiIJENSwUepVGLZsmVQKpXmLsVkrN08WLt5sHbzYO0kBe1icDMRERFRS5DUGR8iIiKSNgYfIiIikgwGHyIiIpIMBh8iIiKSjHYffNavXw9fX19YW1sjODgYR48ebbR/dHQ0evfuDWtra/j5+WHv3r1Gy4UQWLp0KTw8PKBSqRASEoLz58+bvfYvvvgC999/P5ydneHs7IyQkJA6/WfPng2ZTGb0evjhh81e+6ZNm+rUZW1tbdSnrR73ESNG1KldJpNh3Lhxhj6tcdz/97//ISwsDJ6enpDJZPj+++9vuU5sbCwGDhwIpVKJ7t27Y9OmTXX6mPrvT2vUvnPnTowePRodO3aEg4MDhgwZgp9++smoz/Lly+sc8969e5u99tjY2Hq/L1lZWUb92uJxr+97LJPJ0K9fP0Of1jruUVFRGDx4MOzt7dGpUyeEh4cjKSnpluu1pb/v1Ha16+Czbds2REREYNmyZTh+/Dj8/f0RGhqKnJycevv//vvvePTRR/Hkk0/ixIkTCA8PR3h4OE6fPm3o88477+Cjjz7Cp59+iiNHjsDW1hahoaEoKysza+2xsbF49NFHcfDgQcTFxUGtVuOhhx5CRkaGUb+HH34YmZmZhteWLVtatO7m1A7on6Zau67Lly8bLW+rx33nzp1GdZ8+fRpyuRyTJ0826nenj3txcTH8/f2xfv36JvVPSUnBuHHjMHLkSCQkJOC5557D3LlzjQJEc/45tkbt//vf/zB69Gjs3bsX8fHxGDlyJMLCwnDixAmjfv369TM65r/99luL1t2c2qslJSUZ1dapUyfDsrZ63NesWWNUc1paGlxcXOp811vjuB86dAjz58/HH3/8gZ9//hkVFRV46KGHUFxc3OA6benvO7Vxoh0LCgoS8+fPN/yu1WqFp6eniIqKqrf/lClTxLhx44zagoODxf/93/8JIYTQ6XTC3d1dvPvuu4blN27cEEqlUmzZssWstd+ssrJS2Nvbi6+++srQNmvWLDF+/PgWrbM+ptb+5ZdfCkdHxwa3156O+4cffijs7e1FUVGRoa21jns1AGLXrl2N9nn55ZdFv379jNqmTp0qQkNDDb/f7rFojqbUXp++ffuKFStWGH5ftmyZ8Pf3b7nCmqAptR88eFAAENevX2+wT3s57rt27RIymUxcunTJ0GaO4y6EEDk5OQKAOHToUIN92tLfd2rb2u0Zn/LycsTHxyMkJMTQZmFhgZCQEMTFxdW7TlxcnFF/AAgNDTX0T0lJQVZWllEfR0dHBAcHN7jN1qr9ZiUlJaioqICLi4tRe2xsLDp16oRevXrh6aefxrVr11qs7tupvaioCD4+PlCr1Rg/fjzOnDljWNaejvuGDRswbdo02NraGrXf6eNuqlt911viWLQWnU6HwsLCOt/18+fPw9PTE127dsX06dORmppqpgrrCggIgIeHB0aPHo3Dhw8b2tvTcd+wYQNCQkLg4+Nj1G6O456fnw8Adb4DtbWVv+/U9rXb4JObmwutVgs3Nzejdjc3tzrX06tlZWU12r/6pynbbI7m1H6zRYsWwdPT0+hf4ocffhhff/01YmJi8Pbbb+PQoUMYM2YMtFqtWWvv1asXNm7ciN27d+Pf//43dDodhg4divT0dADt57gfPXoUp0+fxty5c43aW+O4m6qh73pBQQFKS0tb5DvYWt577z0UFRVhypQphrbg4GBs2rQJ+/btwyeffIKUlBTcf//9KCwsNGOlgIeHBz799FPs2LEDO3bsgFqtxogRI3D8+HEALfPvfmu4cuUKfvzxxzrfdXMcd51Oh+eeew7Dhg3DPffc02C/tvL3ndq+djE7Oxl76623sHXrVsTGxhoNEp42bZrhvZ+fH/r3749u3bohNjYWo0aNMkepAIAhQ4ZgyJAhht+HDh2KPn364LPPPsPKlSvNVpepNmzYAD8/PwQFBRm1t9XjfjfYvHkzVqxYgd27dxuNkxkzZozhff/+/REcHAwfHx989913ePLJJ81RKgB9yO/Vq5fh96FDhyI5ORkffvghvvnmG7PVZaqvvvoKTk5OCA8PN2o3x3GfP38+Tp8+fUfGEpE0tdszPq6urpDL5cjOzjZqz87Ohru7e73ruLu7N9q/+qcp22yO5tRe7b333sNbb72F/fv3o3///o327dq1K1xdXXHhwoXbrrna7dRezcrKCgMGDDDU1R6Oe3FxMbZu3dqkP+534ribqqHvuoODA1QqVYv8c7zTtm7dirlz5+K7776rcwnjZk5OTujZs6dZj3lDgoKCDHW1h+MuhMDGjRsxY8YMKBSKRvve6eO+YMEC/PDDDzh48CC8vb0b7dtW/r5T29dug49CoUBgYCBiYmIMbTqdDjExMUZnF2obMmSIUX8A+Pnnnw39u3TpAnd3d6M+BQUFOHLkSIPbbK3aAf0dCStXrsS+ffswaNCgW+4nPT0d165dg4eHR4vUDTS/9tq0Wi1OnTplqKutH3dAf5usRqPB448/fsv93Injbqpbfddb4p/jnbRlyxbMmTMHW7ZsMXp0QEOKioqQnJxs1mPekISEBENdbf24A/o7qi5cuNCkkH+njrsQAgsWLMCuXbvwyy+/oEuXLrdcp638fad2wNyjq2/H1q1bhVKpFJs2bRJ///23eOqpp4STk5PIysoSQggxY8YMsXjxYkP/w4cPC0tLS/Hee++JxMREsWzZMmFlZSVOnTpl6PPWW28JJycnsXv3bvHXX3+J8ePHiy5duojS0lKz1v7WW28JhUIhtm/fLjIzMw2vwsJCIYQQhYWF4sUXXxRxcXEiJSVFHDhwQAwcOFD06NFDlJWVmbX2FStWiJ9++kkkJyeL+Ph4MW3aNGFtbS3OnDlj9Pna4nGvdt9994mpU6fWaW+t415YWChOnDghTpw4IQCIDz74QJw4cUJcvnxZCCHE4sWLxYwZMwz9L168KGxsbMRLL70kEhMTxfr164VcLhf79u1r8rEwV+3ffvutsLS0FOvXrzf6rt+4ccPQ54UXXhCxsbEiJSVFHD58WISEhAhXV1eRk5Nj1to//PBD8f3334vz58+LU6dOiWeffVZYWFiIAwcOGPq01eNe7fHHHxfBwcH1brO1jvvTTz8tHB0dRWxsrNF3oKSkxNCnLf99p7atXQcfIYRYu3at6Ny5s1AoFCIoKEj88ccfhmXDhw8Xs2bNMur/3XffiZ49ewqFQiH69esn9uzZY7Rcp9OJJUuWCDc3N6FUKsWoUaNEUlKS2Wv38fERAOq8li1bJoQQoqSkRDz00EOiY8eOwsrKSvj4+Ih58+a1+B/T5tT+3HPPGfq6ubmJsWPHiuPHjxttr60edyGEOHv2rAAg9u/fX2dbrXXcq2+TvvlVXeusWbPE8OHD66wTEBAgFAqF6Nq1q/jyyy/rbLexY2Gu2ocPH95ofyH0t+Z7eHgIhUIhvLy8xNSpU8WFCxfMXvvbb78tunXrJqytrYWLi4sYMWKE+OWXX+psty0edyH0t3erVCrx+eef17vN1jru9dUNwOg73Nb/vlPbJRNCiDt2OomIiIioDWm3Y3yIiIiITMXgQ0RERJLB4ENERESSweBDREREksHgQ0RERJLB4ENERESSweBDREREksHgQ0RERJLB4ENERmJjYyGTyXDjxg1zl0JE1OIYfIiIiEgyGHyIiIhIMhh8iNoYnU6HqKgodOnSBSqVCv7+/ti+fTuAmstQe/bsQf/+/WFtbY17770Xp0+fNtrGjh070K9fPyiVSvj6+uL99983Wq7RaLBo0SKo1WoolUp0794dGzZsMOoTHx+PQYMGwcbGBkOHDkVSUtKd/eBERK2AwYeojYmKisLXX3+NTz/9FGfOnMHzzz+Pxx9/HIcOHTL0eemll/D+++/jzz//RMeOHREWFoaKigoA+sAyZcoUTJs2DadOncLy5cuxZMkSbNq0ybD+zJkzsWXLFnz00UdITEzEZ599Bjs7O6M6Xn31Vbz//vs4duwYLC0t8cQTT7TK5yciupM4OztRG6LRaODi4oIDBw5gyJAhhva5c+eipKQETz31FEaOHImtW7di6tSpAIC8vDx4e3tj06ZNmDJlCqZPn46rV69i//79hvVffvll7NmzB2fOnMG5c+fQq1cv/PzzzwgJCalTQ2xsLEaOHIkDBw5g1KhRAIC9e/di3LhxKC0thbW19R0+CkREdw7P+BC1IRcuXEBJSQlGjx4NOzs7w+vrr79GcnKyoV/tUOTi4oJevXohMTERAJCYmIhhw4YZbXfYsGE4f/48tFotEhISIJfLMXz48EZr6d+/v+G9h4cHACAnJ+e2PyMRkTlZmrsAIqpRVFQEANizZw+8vLyMlimVSqPw01wqlapJ/aysrAzvZTIZAP34IyKi9oxnfIjakL59+0KpVCI1NRXdu3c3eqnVakO/P/74w/D++vXrOHfuHPr06QMA6NOnDw4fPmy03cOHD6Nnz56Qy+Xw8/ODTqczGjNERCQVPOND1IbY29vjxRdfxPPPPw+dTof77rsP+fn5OHz4MBwcHODj4wMAeP3119GhQwe4ubnh1VdfhaurK8LDwwEAL7zwAgYPHoyVK1di6tSpiIuLw7p16/Dxxx8DAHx9fTFr1iw88cQT+Oijj+Dv74/Lly8jJycHU6ZMMddHJyJqFQw+RG3MypUr0bFjR0RFReHixYtwcnLCwIED8corrxguNb311lt49tlncf78eQQEBOC///0vFAoFAGDgwIH47rvvsHTpUqxcuRIeHh54/fXXMXv2bMM+PvnkE7zyyit45plncO3aNXTu3BmvvPKKOT4uEVGr4l1dRO1I9R1X169fh5OTk7nLISJqdzjGh4iIiCSDwYeIiIgkg5e6iIiISDJ4xoeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJIPBh4iIiCSDwYeIiIgkg8GHiIiIJOP/B7I7euY2bT5gAAAAAElFTkSuQmCC\n", "text/plain": ["<Figure size 610.25x500 with 1 Axes>"]}, "metadata": {}, "output_type": "display_data"}], "source": ["\n", "metrics = pd.read_csv(f\"{trainer.logger.log_dir}/metrics.csv\")\n", "del metrics[\"step\"]\n", "metrics.set_index(\"epoch\", inplace=True)\n", "display(metrics.dropna(axis=1, how=\"all\").head())\n", "sn.relplot(data=metrics, kind=\"line\")"]}, {"cell_type": "markdown", "id": "27bce374", "metadata": {"papermill": {"duration": 0.006044, "end_time": "2023-01-05T11:17:50.433618", "exception": false, "start_time": "2023-01-05T11:17:50.427574", "status": "completed"}, "tags": []}, "source": ["## Congratulations - Time to Join the Community!\n", "\n", "Congratulations on completing this notebook tutorial! If you enjoyed this and would like to join the Lightning\n", "movement, you can do so in the following ways!\n", "\n", "### Star [Lightning](https://github.com/Lightning-AI/lightning) on GitHub\n", "The easiest way to help our community is just by starring the GitHub repos! This helps raise awareness of the cool\n", "tools we're building.\n", "\n", "### Join our [Slack](https://www.pytorchlightning.ai/community)!\n", "The best way to keep up to date on the latest advancements is to join our community! Make sure to introduce yourself\n", "and share your interests in `#general` channel\n", "\n", "\n", "### Contributions !\n", "The best way to contribute to our community is to become a code contributor! At any time you can go to\n", "[Lightning](https://github.com/Lightning-AI/lightning) or [Bolt](https://github.com/Lightning-AI/lightning-bolts)\n", "GitHub Issues page and filter for \"good first issue\".\n", "\n", "* [Lightning good first issue](https://github.com/Lightning-AI/lightning/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22)\n", "* [Bolt good first issue](https://github.com/Lightning-AI/lightning-bolts/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22)\n", "* You can also contribute your own notebooks with useful examples !\n", "\n", "### Great thanks from the entire Pytorch Lightning Team for your interest !\n", "\n", "[![Pytorch Lightning](data:image/png;base64,NDA0OiBOb3QgRm91bmQ=){height=\"60px\" width=\"240px\"}](https://pytorchlightning.ai)"]}, {"cell_type": "raw", "metadata": {"raw_mimetype": "text/restructuredtext"}, "source": [".. customcarditem::\n", "   :header: Introduction to Pytorch Lightning\n", "   :card_description: In this notebook, we'll go over the basics of lightning by preparing models to train on the [MNIST Handwritten Digits dataset](https://en.wikipedia.org/wiki/MNIST_database).\n", "   :tags: Image,GPU/TPU,Lightning-Examples"]}], "metadata": {"jupytext": {"cell_metadata_filter": "id,colab,colab_type,-all", "formats": "ipynb,py:percent", "main_language": "python"}, "language_info": {"codemirror_mode": {"name": "ipython", "version": 3}, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.9.16"}, "papermill": {"default_parameters": {}, "duration": 52.600272, "end_time": "2023-01-05T11:17:51.562931", "environment_variables": {}, "exception": null, "input_path": "lightning_examples/mnist-hello-world/hello-world.ipynb", "output_path": ".notebooks/lightning_examples/mnist-hello-world.ipynb", "parameters": {}, "start_time": "2023-01-05T11:16:58.962659", "version": "2.4.0"}, "widgets": {"application/vnd.jupyter.widget-state+json": {"state": {"01baac8cb1944700be1cc8e22e1db1cb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_e84218fca08e449cbcfe5c2de4c1e2b0", "IPY_MODEL_750c1a456ada4b91be4097a45981fa49", "IPY_MODEL_50c9f06461574e87a0d1c0c392bc601a"], "layout": "IPY_MODEL_47e550c6045c4f4d9c95b4d9985b9de5", "tabbable": null, "tooltip": null}}, "02c519f9e8204aa0bffbf6a97d681af6": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "02fd1a140eeb4c59a858d5e24c096de6": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_a55e1e6cf5a54e92b2df61f1f8cd43ce", "IPY_MODEL_9029ebfdef854950872afd501b704fbf", "IPY_MODEL_38a6653ac1a1426695709d4180afc2d8"], "layout": "IPY_MODEL_f5658954e07b4f81946cf6318d90e2c0", "tabbable": null, "tooltip": null}}, "031461fcb9414f04b215db110cea1cf4": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "0a1b776c561e447893988e6ffaf7ca33": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "0a8d5347830e4becae1dfcd24c857a69": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "1ab07c6ca4534b638faf471f00750a97": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "1d61ede8b09b4cadb24cb00453ceed6f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "2282c9a638c54587b528c2d4c3dfd4c0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "2502b717b2de46d694a23cf573f7d9fa": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "265e93c8e2154ed9bb0a5f71b9d57023": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_4d67eb74d18a4b9eadaaa1fbf0453ccc", "placeholder": "\u200b", "style": "IPY_MODEL_8badf02c77814872bd312279d4569390", "tabbable": null, "tooltip": null, "value": " 2/2 [00:00&lt;00:00, 55.32it/s]"}}, "27500fa5f81840b2ae7aac5ea1150541": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "279e74201f8e4859a626af9fa2c9b3d7": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "28a49757e2fc419ea663c2d3c7ea1b4a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "2a94d18f350445c887d242e40b8ef6c6": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "2fbc4194907a4b8b8e1feb6fa5c251ea": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "305c036a0e6b435688e1a912fbb4077c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "30ab072572f7416399e614334a2f796c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "32438ca7240540278a646dbd5dd8d247": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "344beec4521d477780b5adf92b7d735d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "34851989fd9d446fa4bb259f512c7ba3": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_8a6a4d5352c441f0841eee773495bdb9", "max": 2.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_fc35656ee75e4c3f994d6d8616882a6f", "tabbable": null, "tooltip": null, "value": 2.0}}, "3594ec161a2248549478839105482ad0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "375d557e9362457ea7aa87d5e404b79a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_5d5fce5fbb6b4b6c9825b877c1d61a5d", "max": 4542.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_6f2972ba8f7c436bb5f02df2a3715f89", "tabbable": null, "tooltip": null, "value": 4542.0}}, "37cbbf517c2444deaf22817f9398d013": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "38a6653ac1a1426695709d4180afc2d8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_9a62487db0574d36b6360e66982216f1", "placeholder": "\u200b", "style": "IPY_MODEL_0a8d5347830e4becae1dfcd24c857a69", "tabbable": null, "tooltip": null, "value": " 28881/28881 [00:00&lt;00:00, 2134850.62it/s]"}}, "390c51848413458b93a7c0ebd1874ab8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "39d287fa391b46d7b79dd570141b4e86": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_a247905ef2d14115bd35dd92db103650", "IPY_MODEL_34851989fd9d446fa4bb259f512c7ba3", "IPY_MODEL_7cce47b2f04b4a0d95e9e5e415348001"], "layout": "IPY_MODEL_60490d66e48542b584e6ee0341d2c21e", "tabbable": null, "tooltip": null}}, "3b6b4bc1dc0a4418ac5c7c3029577cbb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_8bf1dce773084034bf0b44da52b8f522", "IPY_MODEL_ffc979d836824defb6c31f412b58086c", "IPY_MODEL_4e79553f0a8b411fa66b01fc6ca04201"], "layout": "IPY_MODEL_8ca81de9cdbb4c02903c3cfee0d22b47", "tabbable": null, "tooltip": null}}, "43b93132772c4cea88ae0d507362ec05": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_fdcbd0e5a8de47d8b01f69f78eecf3e7", "IPY_MODEL_83cad3f95c1f4030a41290b3d25fc658", "IPY_MODEL_908b57193ca94e86b45776c6c82876d9"], "layout": "IPY_MODEL_0a1b776c561e447893988e6ffaf7ca33", "tabbable": null, "tooltip": null}}, "46705534468844d19edaca9f22cb011d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "46b7e9c67b794de7914de031730ada05": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "47e550c6045c4f4d9c95b4d9985b9de5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "486976c52285415b94510dc4d852e4fb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_5686846a52ad47cab26780235239f671", "placeholder": "\u200b", "style": "IPY_MODEL_5615077e3a5d4bbca18986d7757634d2", "tabbable": null, "tooltip": null, "value": " 1648877/1648877 [00:00&lt;00:00, 15321305.22it/s]"}}, "4d67eb74d18a4b9eadaaa1fbf0453ccc": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "4e79553f0a8b411fa66b01fc6ca04201": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_dc38673f37a64ee6bdf798182c6df325", "placeholder": "\u200b", "style": "IPY_MODEL_bc051cd5d43d4c1a96bc93958c7a0db5", "tabbable": null, "tooltip": null, "value": " 20/20 [00:00&lt;00:00, 32.36it/s]"}}, "4f5cb6ae9c654aff9e89389e6a7e08ac": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "4f98d39a0d9c44d4bb388a4f20854c3d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "50c9f06461574e87a0d1c0c392bc601a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_fa261c5c2af848408ab907881ee22a3b", "placeholder": "\u200b", "style": "IPY_MODEL_2fbc4194907a4b8b8e1feb6fa5c251ea", "tabbable": null, "tooltip": null, "value": " 235/235 [00:08&lt;00:00, 28.73it/s, loss=0.341, v_num=0, val_loss=0.265, val_acc=0.922]"}}, "5615077e3a5d4bbca18986d7757634d2": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "5686846a52ad47cab26780235239f671": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "58918cb3bad44bcb9c3fcc9444981a8f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "5987f39e92454a4db991f558a744a974": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "5b5280848d804b8c8875f38576bbb93b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "5d5fce5fbb6b4b6c9825b877c1d61a5d": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "60490d66e48542b584e6ee0341d2c21e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "61e0d0d7dc72431ea2735586bf18ae7b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_80ebc2696a8f416791ef5fece3a38db1", "IPY_MODEL_a1d902f3007c491c833ed50ec625aae1", "IPY_MODEL_c943cf8e6eb64bb2af7455d2d923bc64"], "layout": "IPY_MODEL_93cd023269e242838aa7b4c199ec7c78", "tabbable": null, "tooltip": null}}, "62b760b9c7a943809fd0a94078e25e58": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "6be426595ba444c693034eb158560057": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_ac03d3194a4a41f6a474984a08cc94a1", "placeholder": "\u200b", "style": "IPY_MODEL_62b760b9c7a943809fd0a94078e25e58", "tabbable": null, "tooltip": null, "value": " 9912422/9912422 [00:00&lt;00:00, 35484401.57it/s]"}}, "6f2972ba8f7c436bb5f02df2a3715f89": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "7344db0a68674893be68d1608c595fa9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "750c1a456ada4b91be4097a45981fa49": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_46b7e9c67b794de7914de031730ada05", "max": 235.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_5b5280848d804b8c8875f38576bbb93b", "tabbable": null, "tooltip": null, "value": 235.0}}, "750dd52407b345f18b0611712d222985": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "75de41210f0c4e619c3402a258eceb12": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "7b0ff8839ef54929a074b9321ac1dc6b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "7cce47b2f04b4a0d95e9e5e415348001": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_5987f39e92454a4db991f558a744a974", "placeholder": "\u200b", "style": "IPY_MODEL_344beec4521d477780b5adf92b7d735d", "tabbable": null, "tooltip": null, "value": " 2/2 [00:00&lt;00:00, 46.21it/s]"}}, "80ebc2696a8f416791ef5fece3a38db1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_75de41210f0c4e619c3402a258eceb12", "placeholder": "\u200b", "style": "IPY_MODEL_390c51848413458b93a7c0ebd1874ab8", "tabbable": null, "tooltip": null, "value": "Validation DataLoader 0: 100%"}}, "83cad3f95c1f4030a41290b3d25fc658": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_d1313a64e5ad4929a8eec7518d16297f", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_87348c46a3f14397955505981101d357", "tabbable": null, "tooltip": null, "value": 40.0}}, "84f8479fb4684f21b9d0cde239e1ef38": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "8585a1fa725a4fefa95dd56fb5fc4be7": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_f606cae51a31423db781c6941a5de61b", "placeholder": "\u200b", "style": "IPY_MODEL_2502b717b2de46d694a23cf573f7d9fa", "tabbable": null, "tooltip": null, "value": "Epoch 2: 100%"}}, "87348c46a3f14397955505981101d357": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "8a6a4d5352c441f0841eee773495bdb9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "8badf02c77814872bd312279d4569390": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "8bf1dce773084034bf0b44da52b8f522": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e124de34f2b74353b48ae5f685ef6e54", "placeholder": "\u200b", "style": "IPY_MODEL_91bbb86f51874c5b8b44efb3b422e42d", "tabbable": null, "tooltip": null, "value": "Validation DataLoader 0: 100%"}}, "8ca81de9cdbb4c02903c3cfee0d22b47": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "8cdf825af75f462fb1564645639da9ed": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_279e74201f8e4859a626af9fa2c9b3d7", "placeholder": "\u200b", "style": "IPY_MODEL_2282c9a638c54587b528c2d4c3dfd4c0", "tabbable": null, "tooltip": null, "value": "100%"}}, "8df407b3fc984f6a8deb6b9120be0ea3": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "9029ebfdef854950872afd501b704fbf": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_d98917faf7aa4814b2e4a17653e2afc5", "max": 28881.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_46705534468844d19edaca9f22cb011d", "tabbable": null, "tooltip": null, "value": 28881.0}}, "9081419f28a44f2b94de23669c5b6bb2": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_8cdf825af75f462fb1564645639da9ed", "IPY_MODEL_cb61315bf1564bf28c975c8020b6b66c", "IPY_MODEL_486976c52285415b94510dc4d852e4fb"], "layout": "IPY_MODEL_990cde0e6ae94c57884e57708c60d8e8", "tabbable": null, "tooltip": null}}, "908b57193ca94e86b45776c6c82876d9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_7344db0a68674893be68d1608c595fa9", "placeholder": "\u200b", "style": "IPY_MODEL_3594ec161a2248549478839105482ad0", "tabbable": null, "tooltip": null, "value": " 40/40 [00:01&lt;00:00, 34.93it/s]"}}, "91bbb86f51874c5b8b44efb3b422e42d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "9302ef5237834c03822bf1770069db4d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "93cd023269e242838aa7b4c199ec7c78": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "9446642ca58b40b0bf193fbacdccf984": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "958dd59e91664603b95c638a97bd10c9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_031461fcb9414f04b215db110cea1cf4", "max": 9912422.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_f490bf6b489b4ae3bc700837b12b5fb1", "tabbable": null, "tooltip": null, "value": 9912422.0}}, "95cf3faf041b40b1a3c673e84d68867e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "963e1798e37141c3928e07e4091f0ba2": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_fbbadadc12b44b5c81abab4195fa9d54", "max": 235.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_32438ca7240540278a646dbd5dd8d247", "tabbable": null, "tooltip": null, "value": 235.0}}, "972f675b5de847189cf3e4e6a2e5ddeb": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "990cde0e6ae94c57884e57708c60d8e8": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "9a62487db0574d36b6360e66982216f1": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "9d8858c77b824cb48fd088e775841d7d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "9ee97ed600734644a64069e01fb48f50": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_37cbbf517c2444deaf22817f9398d013", "placeholder": "\u200b", "style": "IPY_MODEL_cf0bb07656d2437aa02306794691ca8d", "tabbable": null, "tooltip": null, "value": " 20/20 [00:00&lt;00:00, 32.38it/s]"}}, "9f64136d6d124edc9b4db9904acd8efd": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_a40733c04bf943c8b22afb6d7791b1b5", "max": 20.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_28a49757e2fc419ea663c2d3c7ea1b4a", "tabbable": null, "tooltip": null, "value": 20.0}}, "a0a3102540cb4973a1f78cb74480bc06": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_9446642ca58b40b0bf193fbacdccf984", "max": 2.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_fc13858ce266455b90c7e00bb976ff1b", "tabbable": null, "tooltip": null, "value": 2.0}}, "a1d902f3007c491c833ed50ec625aae1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_305c036a0e6b435688e1a912fbb4077c", "max": 20.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_95cf3faf041b40b1a3c673e84d68867e", "tabbable": null, "tooltip": null, "value": 20.0}}, "a247905ef2d14115bd35dd92db103650": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_27500fa5f81840b2ae7aac5ea1150541", "placeholder": "\u200b", "style": "IPY_MODEL_9d8858c77b824cb48fd088e775841d7d", "tabbable": null, "tooltip": null, "value": "Sanity Checking DataLoader 0: 100%"}}, "a40733c04bf943c8b22afb6d7791b1b5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "a55e1e6cf5a54e92b2df61f1f8cd43ce": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_afa7619f5d2540769fa9c1bdeed453ab", "placeholder": "\u200b", "style": "IPY_MODEL_f07e9c30446f4a4fa4e2a70c374b7a12", "tabbable": null, "tooltip": null, "value": "100%"}}, "a763e96bdb0640f5b4e4b90c3606c0ae": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "a792c413dfda4625bd2cfff59f634cb9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_58918cb3bad44bcb9c3fcc9444981a8f", "placeholder": "\u200b", "style": "IPY_MODEL_84f8479fb4684f21b9d0cde239e1ef38", "tabbable": null, "tooltip": null, "value": "Sanity Checking DataLoader 0: 100%"}}, "aa4b1a3a3abb4a9b83136445e00fd749": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "ac03d3194a4a41f6a474984a08cc94a1": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "ad876cff6db646d1ac74f79ffc4eecda": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "ae4fe106dbeb455eb46807f706f52841": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_7b0ff8839ef54929a074b9321ac1dc6b", "placeholder": "\u200b", "style": "IPY_MODEL_30ab072572f7416399e614334a2f796c", "tabbable": null, "tooltip": null, "value": " 4542/4542 [00:00&lt;00:00, 454775.10it/s]"}}, "afa7619f5d2540769fa9c1bdeed453ab": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "b6a42908b3ab4cbb832ce31902f6766e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "b6fb967d829e440fbce259baaeb43f29": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "bc051cd5d43d4c1a96bc93958c7a0db5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "bf9ae660143b48ecb89e7080715b9a18": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_c0a1ae5972da464f957852f0402e74f8", "IPY_MODEL_958dd59e91664603b95c638a97bd10c9", "IPY_MODEL_6be426595ba444c693034eb158560057"], "layout": "IPY_MODEL_750dd52407b345f18b0611712d222985", "tabbable": null, "tooltip": null}}, "bfc6fdd824ac40de8abe7184272f7129": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "c0a1ae5972da464f957852f0402e74f8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_8df407b3fc984f6a8deb6b9120be0ea3", "placeholder": "\u200b", "style": "IPY_MODEL_4f98d39a0d9c44d4bb388a4f20854c3d", "tabbable": null, "tooltip": null, "value": "100%"}}, "c6630190d413419e8ff1c2541c3a8f70": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "c943cf8e6eb64bb2af7455d2d923bc64": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_1d61ede8b09b4cadb24cb00453ceed6f", "placeholder": "\u200b", "style": "IPY_MODEL_d4eaadf3344e491b9fcdeead6da24ba5", "tabbable": null, "tooltip": null, "value": " 20/20 [00:00&lt;00:00, 32.19it/s]"}}, "cb61315bf1564bf28c975c8020b6b66c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_df80408d56214c119b812634c7cd9790", "max": 1648877.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_1ab07c6ca4534b638faf471f00750a97", "tabbable": null, "tooltip": null, "value": 1648877.0}}, "ccc427227c1b45b98a5851a745e9527e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_8585a1fa725a4fefa95dd56fb5fc4be7", "IPY_MODEL_963e1798e37141c3928e07e4091f0ba2", "IPY_MODEL_f0b5978eb0684f6ca4992519fe1ebb37"], "layout": "IPY_MODEL_c6630190d413419e8ff1c2541c3a8f70", "tabbable": null, "tooltip": null}}, "cf0bb07656d2437aa02306794691ca8d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "d1313a64e5ad4929a8eec7518d16297f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "d481bc2d8980491b8b5ea2237d46c2a9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "d4eaadf3344e491b9fcdeead6da24ba5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "d98917faf7aa4814b2e4a17653e2afc5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "dc38673f37a64ee6bdf798182c6df325": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "df80408d56214c119b812634c7cd9790": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e07ae7dd1ba04691a4a043dc5f2c0166": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_ef5d37a8ae684d5d9daffa932ccfa736", "placeholder": "\u200b", "style": "IPY_MODEL_a763e96bdb0640f5b4e4b90c3606c0ae", "tabbable": null, "tooltip": null, "value": "Validation DataLoader 0: 100%"}}, "e08c061a231141798d4cdf30bb6f881f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "e124de34f2b74353b48ae5f685ef6e54": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e3ae3881c87e4d2d874b0ff385de8837": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_a792c413dfda4625bd2cfff59f634cb9", "IPY_MODEL_a0a3102540cb4973a1f78cb74480bc06", "IPY_MODEL_265e93c8e2154ed9bb0a5f71b9d57023"], "layout": "IPY_MODEL_e08c061a231141798d4cdf30bb6f881f", "tabbable": null, "tooltip": null}}, "e84218fca08e449cbcfe5c2de4c1e2b0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_02c519f9e8204aa0bffbf6a97d681af6", "placeholder": "\u200b", "style": "IPY_MODEL_f0222cb2f8b04f65b77b25370213d2eb", "tabbable": null, "tooltip": null, "value": "Epoch 2: 100%"}}, "e8fdc1872be740b0aeba4a9f602f91c4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_e07ae7dd1ba04691a4a043dc5f2c0166", "IPY_MODEL_9f64136d6d124edc9b4db9904acd8efd", "IPY_MODEL_9ee97ed600734644a64069e01fb48f50"], "layout": "IPY_MODEL_aa4b1a3a3abb4a9b83136445e00fd749", "tabbable": null, "tooltip": null}}, "ecfb0c477d7c451a93c6bab38ec300af": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_f5add436f274411c9be1b62921489322", "IPY_MODEL_375d557e9362457ea7aa87d5e404b79a", "IPY_MODEL_ae4fe106dbeb455eb46807f706f52841"], "layout": "IPY_MODEL_4f5cb6ae9c654aff9e89389e6a7e08ac", "tabbable": null, "tooltip": null}}, "ef5d37a8ae684d5d9daffa932ccfa736": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "f0222cb2f8b04f65b77b25370213d2eb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f07e9c30446f4a4fa4e2a70c374b7a12": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f0b5978eb0684f6ca4992519fe1ebb37": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_972f675b5de847189cf3e4e6a2e5ddeb", "placeholder": "\u200b", "style": "IPY_MODEL_ad876cff6db646d1ac74f79ffc4eecda", "tabbable": null, "tooltip": null, "value": " 235/235 [00:04&lt;00:00, 50.25it/s, loss=0.866, v_num=0]"}}, "f490bf6b489b4ae3bc700837b12b5fb1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "f5658954e07b4f81946cf6318d90e2c0": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "f5add436f274411c9be1b62921489322": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_d481bc2d8980491b8b5ea2237d46c2a9", "placeholder": "\u200b", "style": "IPY_MODEL_bfc6fdd824ac40de8abe7184272f7129", "tabbable": null, "tooltip": null, "value": "100%"}}, "f606cae51a31423db781c6941a5de61b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "fa261c5c2af848408ab907881ee22a3b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "fbbadadc12b44b5c81abab4195fa9d54": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "fc13858ce266455b90c7e00bb976ff1b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "fc35656ee75e4c3f994d6d8616882a6f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "fdcbd0e5a8de47d8b01f69f78eecf3e7": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_2a94d18f350445c887d242e40b8ef6c6", "placeholder": "\u200b", "style": "IPY_MODEL_b6a42908b3ab4cbb832ce31902f6766e", "tabbable": null, "tooltip": null, "value": "Testing DataLoader 0: 100%"}}, "ffc979d836824defb6c31f412b58086c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_b6fb967d829e440fbce259baaeb43f29", "max": 20.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_9302ef5237834c03822bf1770069db4d", "tabbable": null, "tooltip": null, "value": 20.0}}}, "version_major": 2, "version_minor": 0}}}, "nbformat": 4, "nbformat_minor": 5}