{"cells": [{"cell_type": "markdown", "id": "b5ada09c", "metadata": {"papermill": {"duration": 0.003366, "end_time": "2024-07-26T12:02:26.787316", "exception": false, "start_time": "2024-07-26T12:02:26.783950", "status": "completed"}, "tags": []}, "source": ["\n", "# PyTorch Lightning CIFAR10 ~94% Baseline Tutorial\n", "\n", "* **Author:** Lightning.ai\n", "* **License:** CC BY-SA\n", "* **Generated:** 2024-07-26T12:02:20.094943\n", "\n", "Train a Resnet to 94% accuracy on Cifar10!\n", "\n", "\n", "---\n", "Open in [![Open In Colab](data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAHUAAAAUCAYAAACzrHJDAAAIuUlEQVRoQ+1ZaVRURxb+qhdolmbTUVSURpZgmLhHbQVFZIlGQBEXcMvJhKiTEzfigjQg7oNEJ9GMGidnjnNMBs2czIzajksEFRE1xklCTKJiQLRFsUGkoUWw+82pamn79etGYoKek1B/4NW99/tu3e/dquJBAGD27NkHALxKf39WY39gyrOi+i3xqGtUoePJrFmznrmgtModorbTu8YRNZk5cybXTvCtwh7o6NR2KzuZMWNGh6jtVt7nA0ymT5/eJlF9POrh7PAQl6s8bGYa3PUum//htmebVtLRqW0q01M5keTk5FZFzU0oRle3+zxwg5Hgtb+PZiL/ZVohxCI+hL5JgjmfjPxZ26+33BG3dA+ealHPM4gQAo5rU59gsI8bRvl54t3Ca62mvHyUAhtOlLd5WSQpKcluBjumnoCLs1EARkVd9E8l3p9y2i7RbQ1B6pFwu/YDgW8KbHJHMTQrwnjz2oZm9M4pavOCfo5jWrgCaaMVcMs6/pNhDr0+AMN93XlxV7R6DNpyzi7W/OE+yIrsjU6rTrbKV5cd/pNyItOmTbMp6sbBB+EqaYJY4cWE3VUciNt1TpgfcRFv71Fi54xT5kSoyLvOBEJMOMxWXkFlBeBSX4u6Zkcs+3KszYRtiapbNRqF31UgetVuc8z9vBXIv1qD+F1f83B6uDlCUyfsZGepGPpmg01OB7EITQbhS9ribKy+DmP1DUiClLz4bnIHVOqa7BY+Z1wg5g3zgUvyehiNpnJKxSLc/ts76LKm0BzX3c0RNy1yXjDcB5lWoro4iNHQxM+f1kWeWQARAWQS++trISJTp061Kep25X/MycwtjuctSC5rxo7ppi7VNUox5+PhPHtrsS2O1qJ6yx1QujQUzm9sh6hbkBlvvGcN8hYnwjUjH6kjfZEd5c/jitz5Jc5U3ENnFynKl4eB7nyEgP2UZ+Yz3/rVEbyYr27qELrtC4FIC0J7sc7xWnmccdHfRRTs0VB+cA4lt+oFcRR/wUeH8FG5w2Mbx8FQ8TXEvv1xYf4wBP3O2WyL3/UVjpXWgIqaFeUPr+wTmDvUB7njH6/bOv+HRg4SqioAg5GDe1aB3ZeMTJkyRSBqkLsWqSEm0fZVBEN94zEZnYvrdx1JL5cxe+a+AbhSJecRRHW/ikTFRTa38dtQlNZ5CRKwFvUtZU/kvBoEF9Uxni/XqIM+dwKbTw3rhcxIf7gmr2M+H6SMwx8iBzJbw5oxeG3Lv5FX9B3AGaHPS8e8z77H7v9VMpvPG5ug1enh7eGK8h0LBTwUb+GInqzInlRUK65DmTPQu4c3+uQKjwKK77zwUxBX4Tq7yR1RuiwUsqlrABCM6esHdXoy47fk4+prYKy8ZF574x4V5BnHQBuf4g9Z9ld8U36L2aktZNNplNfw7zotwWTy5MkCUft4aLEopJj5/OPHl1BQqeAVOnHgNSQOqmBzq9V9cfEm/yx5ubMGKS9cYPZ3vx2OS/c6PVHUuUO7Y1Pci3BO/1zgq18byebfGemLtNF+6JRtOvMk926ibussZqM+1mNz4TWkH7rCbM5phwGRGDAaoF8fY5OHFnlldAA8sgoEXKnDukA1NgSeNjqkJT9brbN4pC9WRweYXyLugR73c+MYvyWfu0yC6+mjzN1Isfw3FKJS98CU/zI1IHFkFPR52cHL2FJk0sB6kMTERIGo9GzcPkLNfA0cwdwi/hfEYO86ZMd9w+y1egfM2T2Eh/vesMNwljSzuZRT420SW3eqy8N6aHMmwmnFUZ7/PGVPbIoNZvNU1BURdHs0bT2+HjL8sDSM2e6vi4Lj5NW8WOLVA6RTT2azxLV+bglaFNqLieqemS/gWkw7NyoAHo+2dEsiivengjKsPFoqWOvbSh/kxPaxyW/JRzH2Fl3EzD9/xjAefJqB3usKUFn/0Gb+S/d/jy3FN2yLOmnSJJtn6oehByEiHPSeXnDxFGPRnoFoaBJjcdQlbDwcjL1zTNuQpoxD7R0OG0uUTMi0fkVwdzBdYIwcwZunxrVJVLplNm54BZp7jfDfYLoNyqQi1K6KxIdHzmN+QQ2WjFIwUT2zTGdlRXo4NFXVUO4sgX5dFC7f0aP/ZlNeUjFBuL8Xjl6uRuP6aMjSjpjzsH62FDU7JhBuGccEXIvDfJFFBc/gHw80dklfCVYnRaDfpiJcutPA4F7qJsfJeUPQI+1fqMlNhFx1FM0GDqkjFVg7NojlQ0Vt4aM5ReSqcbpaCg8nCW5lRsBvbT4T1TLfFptsfh7gItzuKTdJSEiwKSrt1vcmnEXXrsLbYnWDA1bu+z2WKy9Arq+1KRqdfKsoBo0GcdtEpS/B1bO4v0cFiUhkjskvKcMrWwtAPHuwQq8Z+4LZ1vTQANfXt4J0DwZX9gWa9qh4XDM/voC9JXfwYEMMHJcfNtusn82ihvliVUwg5KrPGVf6GH94ZJpEZBen6EC4qYTHA1dXhW0JIex8txzv//c8lhzXIi/BFxOH9jGbQhZsRalTIBZZ8KkGyZAxeRQvXkFF1TWz/Hm46jNYUnjPbt3JxIkT7f6dSj8qfJJyVvBxgaIlblOyjtysNHWN9fjjqWi7glJfW3/S0Hlj2XnA8PhKT9w6g3Qx3XiXhvuxQsuT1proxBKI/AaZqY1Xz5muvY8G8XkRRCaHsfQsRAFDH/tZPbcYuHotOG0FRIqB4HR3wNVoIPLtz8ycTguu+jpEigE218vd1YCr5m+HpHMvEI9u4LTXwNWaLjl0iPwGAmIpeHx1VeCqTJdPs1/vweweQPO3HC24NhOhnTphwoQnfv6QSY2ICbkNmdSA4h87oaLaiYfn5diIEd4att2erOwJXbPUHp953p6orQVSUVWRAXBT8c/dJ5L9xhzaJGp71GR/wFP8P5V2z10NSC9T93QM2xUg8fHxT+zU9ijeU4naHon8CjFJXFzc8/kn+dN06q9QgF98SYSo2Xen2NjYZy5sR6f+4nLSK5Iam2PH/x87a1YN/t5sBgAAAABJRU5ErkJggg==){height=\"20px\" width=\"117px\"}](https://colab.research.google.com/github/PytorchLightning/lightning-tutorials/blob/publication/.notebooks/lightning_examples/cifar10-baseline.ipynb)\n", "\n", "Give us a \u2b50 [on Github](https://www.github.com/Lightning-AI/lightning/)\n", "| Check out [the documentation](https://lightning.ai/docs/)\n", "| Join us [on Discord](https://discord.com/invite/tfXFetEZxv)"]}, {"cell_type": "markdown", "id": "b87b42e7", "metadata": {"papermill": {"duration": 0.00255, "end_time": "2024-07-26T12:02:26.792578", "exception": false, "start_time": "2024-07-26T12:02:26.790028", "status": "completed"}, "tags": []}, "source": ["## Setup\n", "This notebook requires some packages besides pytorch-lightning."]}, {"cell_type": "code", "execution_count": 1, "id": "6b142279", "metadata": {"colab": {}, "colab_type": "code", "execution": {"iopub.execute_input": "2024-07-26T12:02:26.799156Z", "iopub.status.busy": "2024-07-26T12:02:26.798815Z", "iopub.status.idle": "2024-07-26T12:02:27.887049Z", "shell.execute_reply": "2024-07-26T12:02:27.885674Z"}, "id": "LfrJLKPFyhsK", "lines_to_next_cell": 0, "papermill": {"duration": 1.094628, "end_time": "2024-07-26T12:02:27.889910", "exception": false, "start_time": "2024-07-26T12:02:26.795282", "status": "completed"}, "tags": []}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["\u001b[33mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.\u001b[0m\u001b[33m\r\n", "\u001b[0m"]}], "source": ["! pip install --quiet \"torchvision\" \"matplotlib\" \"torchmetrics>=1.0, <1.5\" \"numpy <2.0\" \"pytorch-lightning >=2.0,<2.4\" \"pandas\" \"seaborn\" \"torch>=1.8.1, <2.5\""]}, {"cell_type": "code", "execution_count": 2, "id": "8c9dc532", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:02:27.904167Z", "iopub.status.busy": "2024-07-26T12:02:27.903582Z", "iopub.status.idle": "2024-07-26T12:02:27.909387Z", "shell.execute_reply": "2024-07-26T12:02:27.908237Z"}, "papermill": {"duration": 0.015785, "end_time": "2024-07-26T12:02:27.911887", "exception": false, "start_time": "2024-07-26T12:02:27.896102", "status": "completed"}, "tags": []}, "outputs": [], "source": ["# Run this if you intend to use TPUs\n", "# !pip install cloud-tpu-client==0.10 https://storage.googleapis.com/tpu-pytorch/wheels/torch_xla-1.8-cp37-cp37m-linux_x86_64.whl"]}, {"cell_type": "code", "execution_count": 3, "id": "2e36949c", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:02:27.925406Z", "iopub.status.busy": "2024-07-26T12:02:27.925020Z", "iopub.status.idle": "2024-07-26T12:02:31.713881Z", "shell.execute_reply": "2024-07-26T12:02:31.712450Z"}, "papermill": {"duration": 3.798618, "end_time": "2024-07-26T12:02:31.716496", "exception": false, "start_time": "2024-07-26T12:02:27.917878", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["Seed set to 7\n"]}], "source": ["import os\n", "\n", "import pandas as pd\n", "import pytorch_lightning as pl\n", "import seaborn as sn\n", "import torch\n", "import torch.nn as nn\n", "import torch.nn.functional as F\n", "import torchvision\n", "from IPython.display import display\n", "from pytorch_lightning.callbacks import LearningRateMonitor\n", "from pytorch_lightning.loggers import CSVLogger\n", "from torch.optim.lr_scheduler import OneCycleLR\n", "from torch.optim.swa_utils import AveragedModel\n", "from torch.utils.data import DataLoader, random_split\n", "from torchmetrics.functional import accuracy\n", "from torchvision.datasets import CIFAR10\n", "\n", "pl.seed_everything(7)\n", "\n", "PATH_DATASETS = os.environ.get(\"PATH_DATASETS\", \".\")\n", "BATCH_SIZE = 256 if torch.cuda.is_available() else 64\n", "NUM_WORKERS = int(os.cpu_count() / 2)"]}, {"cell_type": "markdown", "id": "90bc56a5", "metadata": {"papermill": {"duration": 0.005914, "end_time": "2024-07-26T12:02:31.728782", "exception": false, "start_time": "2024-07-26T12:02:31.722868", "status": "completed"}, "tags": []}, "source": ["### CIFAR10 DataLoaders\n"]}, {"cell_type": "code", "execution_count": 4, "id": "a02ff1a6", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:02:31.742303Z", "iopub.status.busy": "2024-07-26T12:02:31.741912Z", "iopub.status.idle": "2024-07-26T12:02:40.079127Z", "shell.execute_reply": "2024-07-26T12:02:40.077123Z"}, "lines_to_next_cell": 2, "papermill": {"duration": 8.346829, "end_time": "2024-07-26T12:02:40.081487", "exception": false, "start_time": "2024-07-26T12:02:31.734658", "status": "completed"}, "tags": []}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to /__w/14/s/.datasets/cifar-10-python.tar.gz\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  0%|          | 0/170498071 [00:00<?, ?it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  0%|          | 229376/170498071 [00:00<01:29, 1912574.27it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  1%|          | 2097152/170498071 [00:00<00:15, 11015781.10it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  4%|\u258d         | 6488064/170498071 [00:00<00:06, 25331296.42it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "  7%|\u258b         | 11370496/170498071 [00:00<00:04, 34256379.97it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 10%|\u2589         | 16220160/170498071 [00:00<00:03, 39256523.43it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 12%|\u2588\u258f        | 21069824/170498071 [00:00<00:03, 42351582.35it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 15%|\u2588\u258c        | 25886720/170498071 [00:00<00:03, 44233984.59it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 18%|\u2588\u258a        | 30736384/170498071 [00:00<00:03, 45493641.45it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 21%|\u2588\u2588        | 35323904/170498071 [00:00<00:03, 44740462.63it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 23%|\u2588\u2588\u258e       | 39845888/170498071 [00:01<00:02, 43784455.69it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 26%|\u2588\u2588\u258c       | 44695552/170498071 [00:01<00:02, 45103885.39it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 29%|\u2588\u2588\u2589       | 49545216/170498071 [00:01<00:02, 45201213.86it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 32%|\u2588\u2588\u2588\u258f      | 54099968/170498071 [00:01<00:02, 44605950.65it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 34%|\u2588\u2588\u2588\u258d      | 58654720/170498071 [00:01<00:02, 44821892.92it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 37%|\u2588\u2588\u2588\u258b      | 63242240/170498071 [00:01<00:02, 45112808.26it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 40%|\u2588\u2588\u2588\u2589      | 67928064/170498071 [00:01<00:02, 45595170.41it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 43%|\u2588\u2588\u2588\u2588\u258e     | 72515584/170498071 [00:01<00:02, 44353341.86it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 45%|\u2588\u2588\u2588\u2588\u258c     | 76972032/170498071 [00:01<00:02, 41082001.69it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 48%|\u2588\u2588\u2588\u2588\u258a     | 81133568/170498071 [00:02<00:02, 39118700.97it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 50%|\u2588\u2588\u2588\u2588\u2589     | 85098496/170498071 [00:02<00:02, 38165805.10it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 52%|\u2588\u2588\u2588\u2588\u2588\u258f    | 88965120/170498071 [00:02<00:02, 37222192.94it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 54%|\u2588\u2588\u2588\u2588\u2588\u258d    | 92733440/170498071 [00:02<00:02, 36943603.30it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 57%|\u2588\u2588\u2588\u2588\u2588\u258b    | 96468992/170498071 [00:02<00:02, 36860374.50it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 59%|\u2588\u2588\u2588\u2588\u2588\u2589    | 100171776/170498071 [00:02<00:01, 36827814.43it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 61%|\u2588\u2588\u2588\u2588\u2588\u2588    | 103874560/170498071 [00:02<00:01, 36871888.91it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 63%|\u2588\u2588\u2588\u2588\u2588\u2588\u258e   | 107610112/170498071 [00:02<00:01, 36973957.03it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 65%|\u2588\u2588\u2588\u2588\u2588\u2588\u258c   | 111312896/170498071 [00:02<00:01, 36875505.34it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 67%|\u2588\u2588\u2588\u2588\u2588\u2588\u258b   | 115015680/170498071 [00:02<00:01, 36900474.63it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 70%|\u2588\u2588\u2588\u2588\u2588\u2588\u2589   | 118784000/170498071 [00:03<00:01, 37084481.20it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 72%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258f  | 122552320/170498071 [00:03<00:01, 37215376.42it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 74%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258d  | 126353408/170498071 [00:03<00:01, 37421920.62it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 76%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258b  | 130187264/170498071 [00:03<00:01, 37552924.40it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 79%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258a  | 134053888/170498071 [00:03<00:00, 37821138.96it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 81%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588  | 137920512/170498071 [00:03<00:00, 38015181.09it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 83%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258e | 141787136/170498071 [00:03<00:00, 38163184.43it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 85%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258c | 145719296/170498071 [00:03<00:00, 38443729.81it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 88%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258a | 149618688/170498071 [00:03<00:00, 38551887.61it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 90%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588 | 153583616/170498071 [00:03<00:00, 38775461.23it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 92%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258f| 157548544/170498071 [00:04<00:00, 38924880.10it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 95%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258d| 161513472/170498071 [00:04<00:00, 39053149.38it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 97%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u258b| 165445632/170498071 [00:04<00:00, 39107394.21it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", " 99%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2589| 169377792/170498071 [00:04<00:00, 38478808.16it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\r", "100%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588| 170498071/170498071 [00:04<00:00, 38826098.18it/s]"]}, {"name": "stderr", "output_type": "stream", "text": ["\n"]}, {"name": "stdout", "output_type": "stream", "text": ["Extracting /__w/14/s/.datasets/cifar-10-python.tar.gz to /__w/14/s/.datasets\n"]}, {"name": "stdout", "output_type": "stream", "text": ["Files already downloaded and verified\n"]}, {"name": "stdout", "output_type": "stream", "text": ["Files already downloaded and verified\n"]}], "source": ["\n", "cifar10_normalization = torchvision.transforms.Normalize(\n", "    mean=[x / 255.0 for x in [125.3, 123.0, 113.9]],\n", "    std=[x / 255.0 for x in [63.0, 62.1, 66.7]],\n", ")\n", "\n", "\n", "def split_dataset(dataset, val_split=0.2, train=True):\n", "    \"\"\"Splits the dataset into train and validation set.\"\"\"\n", "    len_dataset = len(dataset)\n", "    splits = get_splits(len_dataset, val_split)\n", "    dataset_train, dataset_val = random_split(dataset, splits, generator=torch.Generator().manual_seed(42))\n", "\n", "    if train:\n", "        return dataset_train\n", "    return dataset_val\n", "\n", "\n", "def get_splits(len_dataset, val_split):\n", "    \"\"\"Computes split lengths for train and validation set.\"\"\"\n", "    if isinstance(val_split, int):\n", "        train_len = len_dataset - val_split\n", "        splits = [train_len, val_split]\n", "    elif isinstance(val_split, float):\n", "        val_len = int(val_split * len_dataset)\n", "        train_len = len_dataset - val_len\n", "        splits = [train_len, val_len]\n", "    else:\n", "        raise ValueError(f\"Unsupported type {type(val_split)}\")\n", "\n", "    return splits\n", "\n", "\n", "train_transforms = torchvision.transforms.Compose(\n", "    [\n", "        torchvision.transforms.RandomCrop(32, padding=4),\n", "        torchvision.transforms.RandomHorizontalFlip(),\n", "        torchvision.transforms.ToTensor(),\n", "        cifar10_normalization,\n", "    ]\n", ")\n", "test_transforms = torchvision.transforms.Compose(\n", "    [\n", "        torchvision.transforms.ToTensor(),\n", "        cifar10_normalization,\n", "    ]\n", ")\n", "\n", "dataset_train = CIFAR10(PATH_DATASETS, train=True, download=True, transform=train_transforms)\n", "dataset_val = CIFAR10(PATH_DATASETS, train=True, download=True, transform=test_transforms)\n", "dataset_train = split_dataset(dataset_train)\n", "dataset_val = split_dataset(dataset_val, train=False)\n", "dataset_test = CIFAR10(PATH_DATASETS, train=False, download=True, transform=test_transforms)\n", "\n", "train_dataloader = DataLoader(dataset_train, batch_size=BATCH_SIZE, shuffle=True, num_workers=NUM_WORKERS)\n", "val_dataloader = DataLoader(dataset_val, batch_size=BATCH_SIZE, shuffle=False, num_workers=NUM_WORKERS)\n", "test_dataloader = DataLoader(dataset_test, batch_size=BATCH_SIZE, shuffle=False, num_workers=NUM_WORKERS)"]}, {"cell_type": "markdown", "id": "d96859c5", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.004985, "end_time": "2024-07-26T12:02:40.091930", "exception": false, "start_time": "2024-07-26T12:02:40.086945", "status": "completed"}, "tags": []}, "source": ["### Resnet\n", "Modify the pre-existing Resnet architecture from TorchVision. The pre-existing architecture is based on ImageNet\n", "images (224x224) as input. So we need to modify it for CIFAR10 images (32x32)."]}, {"cell_type": "code", "execution_count": 5, "id": "9ffeedd0", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:02:40.104063Z", "iopub.status.busy": "2024-07-26T12:02:40.103761Z", "iopub.status.idle": "2024-07-26T12:02:40.111335Z", "shell.execute_reply": "2024-07-26T12:02:40.110298Z"}, "lines_to_next_cell": 2, "papermill": {"duration": 0.015804, "end_time": "2024-07-26T12:02:40.112680", "exception": false, "start_time": "2024-07-26T12:02:40.096876", "status": "completed"}, "tags": []}, "outputs": [], "source": ["def create_model():\n", "    model = torchvision.models.resnet18(pretrained=False, num_classes=10)\n", "    model.conv1 = nn.Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n", "    model.maxpool = nn.Identity()\n", "    return model"]}, {"cell_type": "markdown", "id": "464ae149", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.004931, "end_time": "2024-07-26T12:02:40.123320", "exception": false, "start_time": "2024-07-26T12:02:40.118389", "status": "completed"}, "tags": []}, "source": ["### Lightning Module\n", "Check out the [`configure_optimizers`](https://lightning.ai/docs/pytorch/stable/common/lightning_module.html#configure-optimizers)\n", "method to use custom Learning Rate schedulers. The OneCycleLR with SGD will get you to around 92-93% accuracy\n", "in 20-30 epochs and 93-94% accuracy in 40-50 epochs. Feel free to experiment with different\n", "LR schedules from https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate"]}, {"cell_type": "code", "execution_count": 6, "id": "caa2c787", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:02:40.134241Z", "iopub.status.busy": "2024-07-26T12:02:40.134046Z", "iopub.status.idle": "2024-07-26T12:02:40.143277Z", "shell.execute_reply": "2024-07-26T12:02:40.142159Z"}, "papermill": {"duration": 0.016417, "end_time": "2024-07-26T12:02:40.144707", "exception": false, "start_time": "2024-07-26T12:02:40.128290", "status": "completed"}, "tags": []}, "outputs": [], "source": ["class LitResnet(pl.LightningModule):\n", "    def __init__(self, lr=0.05):\n", "        super().__init__()\n", "\n", "        self.save_hyperparameters()\n", "        self.model = create_model()\n", "\n", "    def forward(self, x):\n", "        out = self.model(x)\n", "        return F.log_softmax(out, dim=1)\n", "\n", "    def training_step(self, batch, batch_idx):\n", "        x, y = batch\n", "        logits = self(x)\n", "        loss = F.nll_loss(logits, y)\n", "        self.log(\"train_loss\", loss)\n", "        return loss\n", "\n", "    def evaluate(self, batch, stage=None):\n", "        x, y = batch\n", "        logits = self(x)\n", "        loss = F.nll_loss(logits, y)\n", "        preds = torch.argmax(logits, dim=1)\n", "        acc = accuracy(preds, y, task=\"multiclass\", num_classes=10)\n", "\n", "        if stage:\n", "            self.log(f\"{stage}_loss\", loss, prog_bar=True)\n", "            self.log(f\"{stage}_acc\", acc, prog_bar=True)\n", "\n", "    def validation_step(self, batch, batch_idx):\n", "        self.evaluate(batch, \"val\")\n", "\n", "    def test_step(self, batch, batch_idx):\n", "        self.evaluate(batch, \"test\")\n", "\n", "    def configure_optimizers(self):\n", "        optimizer = torch.optim.SGD(\n", "            self.parameters(),\n", "            lr=self.hparams.lr,\n", "            momentum=0.9,\n", "            weight_decay=5e-4,\n", "        )\n", "        steps_per_epoch = 45000 // BATCH_SIZE\n", "        scheduler_dict = {\n", "            \"scheduler\": OneCycleLR(\n", "                optimizer,\n", "                0.1,\n", "                epochs=self.trainer.max_epochs,\n", "                steps_per_epoch=steps_per_epoch,\n", "            ),\n", "            \"interval\": \"step\",\n", "        }\n", "        return {\"optimizer\": optimizer, \"lr_scheduler\": scheduler_dict}"]}, {"cell_type": "code", "execution_count": 7, "id": "781305df", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:02:40.156025Z", "iopub.status.busy": "2024-07-26T12:02:40.155766Z", "iopub.status.idle": "2024-07-26T12:03:48.063835Z", "shell.execute_reply": "2024-07-26T12:03:48.062973Z"}, "papermill": {"duration": 67.916165, "end_time": "2024-07-26T12:03:48.065904", "exception": false, "start_time": "2024-07-26T12:02:40.149739", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.\n", "  warnings.warn(\n", "/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`.\n", "  warnings.warn(msg)\n", "GPU available: True (cuda), used: True\n"]}, {"name": "stderr", "output_type": "stream", "text": ["TPU available: False, using: 0 TPU cores\n"]}, {"name": "stderr", "output_type": "stream", "text": ["HPU available: False, using: 0 HPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["You are using a CUDA device ('NVIDIA GeForce RTX 3090') that has Tensor Cores. To properly utilize them, you should set `torch.set_float32_matmul_precision('medium' | 'high')` which will trade-off precision for performance. For more details, read https://pytorch.org/docs/stable/generated/torch.set_float32_matmul_precision.html#torch.set_float32_matmul_precision\n"]}, {"name": "stderr", "output_type": "stream", "text": ["Missing logger folder: logs/lightning_logs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\n", "  | Name  | Type   | Params | Mode \n", "-----------------------------------------\n", "0 | model | ResNet | 11.2 M | train\n", "-----------------------------------------\n", "11.2 M    Trainable params\n", "0         Non-trainable params\n", "11.2 M    Total params\n", "44.696    Total estimated model params size (MB)\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "1daed6795a834524bc551aac17af7364", "version_major": 2, "version_minor": 0}, "text/plain": ["Sanity Checking: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "f2ca7ee12a4349dab5e0b60a481e1eb4", "version_major": 2, "version_minor": 0}, "text/plain": ["Training: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "44aa97e3b56b4e75922cdb7e1cd2a8c0", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "35a373973f574d20a8b324debd9f49a6", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "e49f3f0f600b447681837035e944f0c3", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "1f45bbb27ef9457d8992a657b0b51b65", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "303d30d6c30d48d6880a1dcad86ea931", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["`Trainer.fit` stopped: `max_epochs=5` reached.\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "8d57edc23628484ebc18ba428d5057b7", "version_major": 2, "version_minor": 0}, "text/plain": ["Testing: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "       Test metric             DataLoader 0\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "        test_acc             0.817799985408783\n", "        test_loss            0.529252290725708\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n"]}, {"data": {"text/plain": ["[{'test_loss': 0.529252290725708, 'test_acc': 0.817799985408783}]"]}, "execution_count": 7, "metadata": {}, "output_type": "execute_result"}], "source": ["model = LitResnet(lr=0.05)\n", "\n", "trainer = pl.Trainer(\n", "    max_epochs=5,\n", "    accelerator=\"auto\",\n", "    devices=1,\n", "    logger=CSVLogger(save_dir=\"logs/\"),\n", "    callbacks=[LearningRateMonitor(logging_interval=\"step\")],\n", ")\n", "\n", "trainer.fit(model, train_dataloaders=train_dataloader, val_dataloaders=val_dataloader)\n", "trainer.test(model, dataloaders=test_dataloader)"]}, {"cell_type": "code", "execution_count": 8, "id": "9752fd5e", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:03:48.082169Z", "iopub.status.busy": "2024-07-26T12:03:48.081688Z", "iopub.status.idle": "2024-07-26T12:03:48.837787Z", "shell.execute_reply": "2024-07-26T12:03:48.836620Z"}, "papermill": {"duration": 0.766096, "end_time": "2024-07-26T12:03:48.839855", "exception": false, "start_time": "2024-07-26T12:03:48.073759", "status": "completed"}, "tags": []}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>lr-SGD</th>\n", "      <th>test_acc</th>\n", "      <th>test_loss</th>\n", "      <th>train_loss</th>\n", "      <th>val_acc</th>\n", "      <th>val_loss</th>\n", "    </tr>\n", "    <tr>\n", "      <th>epoch</th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.012079</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.852811</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.034132</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.636740</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.062440</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["         lr-SGD  test_acc  test_loss  train_loss  val_acc  val_loss\n", "epoch                                                              \n", "NaN    0.012079       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.852811      NaN       NaN\n", "NaN    0.034132       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.636740      NaN       NaN\n", "NaN    0.062440       NaN        NaN         NaN      NaN       NaN"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"text/plain": ["<seaborn.axisgrid.FacetGrid at 0x7f1f370ec490>"]}, "execution_count": 8, "metadata": {}, "output_type": "execute_result"}, {"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHqCAYAAAAHwkogAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjkuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/TGe4hAAAACXBIWXMAAA9hAAAPYQGoP6dpAACfG0lEQVR4nOzdd3hUZfbA8e+9d/qk91BDb1KCFIFdRUARNBYUFVgVu7u6ruuyKmtFV/25lrX3voINwS6CKCCIIEpvIQkhQHqv0+/vj0AkkEDKzATI+TzPPJK5977nTdRw5m1H0XVdRwghhBCinVLbugNCCCGEEG1JkiEhhBBCtGuSDAkhhBCiXZNkSAghhBDtmiRDQgghhGjXJBkSQgghRLsmyZAQQggh2jVJhoQQQgjRrkkyJIQQQoh2TZIhIYQQQrRrzUqGHn30UYYPH05oaChxcXFceOGF7Ny585jPffzxx/Tt2xeLxcLAgQP5+uuvW9xhIYQQQgh/alYytHz5cm6++WZ+/vlnlixZgtvt5uyzz6aqqqrRZ3766SemTZvGtddey/r167nwwgu58MIL2bJlS6s7L4QQQgjRWkprCrUWFBQQFxfH8uXLOf300xu857LLLqOqqoovv/yy7r3TTjuNIUOG8PLLL7c0tBBCCCGEX7RqzVBZWRkAUVFRjd6zevVqJkyYUO+9iRMnsnr16kafcTqdlJeX173KysooKCigFXmbEEIIIUSDWpwM+Xw+brvtNsaMGcMpp5zS6H25ubnEx8fXey8+Pp7c3NxGn3n00UcJDw+ve0VERBAXF0dFRUVLuyuEEEII0aAWJ0M333wzW7Zs4YMPPvBnfwCYPXs2ZWVlda+9e/f6PYYQQgghBIChJQ/dcsstfPnll6xYsYJOnTod9d6EhATy8vLqvZeXl0dCQkKjz5jNZsxmc0u6JoQQQgjRLM0aGdJ1nVtuuYWFCxfy/fff061bt2M+M2rUKJYuXVrvvSVLljBq1Kjm9VQIIYQQIgCaNTJ08803M2/ePD777DNCQ0Pr1v2Eh4djtVoBuPLKK+nYsSOPPvooAH/7298444wzePLJJzn33HP54IMPWLduHa+++qqfvxUhhBBCiOZr1sjQSy+9RFlZGWPHjiUxMbHu9eGHH9bdk5WVRU5OTt3Xo0ePZt68ebz66qsMHjyY+fPn8+mnnx510bUQQgghRLC06pyhYCkvLyc8PJyysjLCwsLaujtCCCGEOIlIbTIhhBBCtGuSDAkhhBCiXZNkSAghhBDtmiRDQgghhGjXJBkSQgghRLsmyZAQQggh2jVJhoQQQgjRrkkyJIQQQoh2TZIhIYQQQrRrkgwJIYQQol2TZEgIIYQQ7Vq7S4Z8Tie+qqq27oYQQgghjhPtLhnyFhZSs30H3kpJiIQQQgjRDpMhXQdPXh7OXan4HI627o4QQggh2li7S4YAFJMRT2EhzrR0dLe7rbsjhBBCiDbULpMhVBVDbBzu7P04MzLQvd627pEQQggh2kj7TIYAxWBAi47BlZWFa08Wuq63dZeEEEII0QbaXTJUU1lJ6s6tAKhmM1pEJK7dGbj272/jngkhhBCiLRjaugPB5Kyu5qNnHqG8uAhzdAw9BwxGtVrRPR5caWmoRhPG+Li27qYQQgghgqhdjQyZbTZ6DBoKwPeff0xBTu1okBYaimIw4tyViqekpC27KIQQQogga1fJEMDoc6fQqXMSHo+bbz5+l+qqSgC0iAh0jxfnzp14KyrauJdCCCGECJZ2lwypqsq4cZMIj4qhsqyUb+e/h9frAUCLjsZbVYVjZyq+6uo27qkQQgghgqHdJUMAZrOFyZddhclsxuVw4KypAUBRFAyxcXhLinHs2oXP5WrjngohhBAi0NrVAupDRcbEkTLjeqJi4zGaTHXvK6qKIS4eT14eLqMRc+/eKIZ2+2MSQgghTnrtcmTooPiOnTGaTOi6zpZ1q8nekwGAomkYYmNx7duPc/dudJ+vjXsqhBBCiEBp18nQQds3/MKKbz5l0fz3qCit3U2mGI1oUVG4Mvfg2rtXDmUUQgghTlKSDAG9ThlCTEIHPG43JUUFde+rFgtaWBiu9HQ8ublt2EMhhBBCBIoshgGMRhOTLr0Sp8NBTHxivWuq3Y7u8eDYtQvFaMQQE9NGvRRCCCFEIMjI0AGh4ZF1iVBhbjZb1q2uu6aFh4MOjtRUvKWlbdRDIYQQQgSCjAwdprykmAVvv4jH7SEkLJyk3v0BMERH4y7Ix7FrF5Z+/dFC7G3cUyGEEEL4g4wMHSYsMoq+g4cBOvsP7C47yBATi6+sDOeuVHwOR9t0UAghhBB+JSNDDRhzdgqduvWke99T6r2vKApabBye/DycaelY+vRGMRrbqJdCCCGE8AcZGWqApml1iZDb5WTdj9/j83mBA2cQxcTizt6PMyMD3etty64KIYQQopVkZOgodF3n8/deJ29/Fs6aKsacnQIcOIMoOgZXVhaK0YSpWxKKorRxb4UQQgjREjIydBSKojBk1OkAbFyzkh0bf627pprNaBGRuHZn4N6f3VZdFEIIIUQrSTJ0DD36DWTYH8cDsPyrBeTtz6q7plqtKDY7zrRduPPy26qLQgghhGgFSYaaYPgZE+jWuz9er4dvPnqXqoryumtaaChoBpy7UvGUlLRhL4UQQgjREpIMNYGiqIy/8HKiYuMxGIw4HTX1rhsiI9HdHpw7U/FWVLRRL4UQQgjRErKAuolMZjOTL5+JyWTGYjvywEUtJgZPfh6OnalYB/RHtVrboJdCCCGEaK5mjwytWLGClJQUOnTogKIofPrpp8d8Zu7cuQwePBibzUZiYiLXXHMNRUVFLelvmwqLiKpLhHZt3cjmX36qu6YoCobYOLwlxThSU/G5XG3VTSGEEEI0Q7OToaqqKgYPHswLL7zQpPtXrVrFlVdeybXXXsvWrVv5+OOPWbt2Lddff32zO3u8yNmbyZIF81j57edkpafWva+oKoa4eDx5+bjS09E9njbspRBCCCGaotnTZJMmTWLSpElNvn/16tUkJSVx6623AtCtWzduvPFGHnvsseaG9gv3/v1ULl9O5KWXtbiNhE5d6Tt4GKmb11NdWX+NkKJpGGJjce3dB0Yj5u7dUVRZmiWEEEIcrwL+t/SoUaPYu3cvX3/9Nbquk5eXx/z585k8eXKjzzidTsrLy+u9/MGdl8/eG26g7KOPcWzf3uJ2FEXhjMkXMeXqv9B38KlHXjca0aKicGdm4tq7F13XW9NtIYQQQgRQwJOhMWPGMHfuXC677DJMJhMJCQmEh4cfdZrt0UcfJTw8vO7VuXNnv/TFGB9HyLhxABS9/HKr1vVoBgNxHToBUFZcxKrFX6DrvrrrqsWCEhqGKz0DT25u6zouhBBCiIAJeDK0bds2/va3v3Hffffx66+/smjRIjIzM7npppsafWb27NmUlZXVvfbu3eu3/kTfcANqWBju/fspW7Cg1e153G4+ffdlNq5ZydplS+pd0+x2FLMZx640PIWFrY4lhBBCCP8LeDL06KOPMmbMGP75z38yaNAgJk6cyIsvvsibb75JTk5Og8+YzWbCwsLqvfxFCw0l4tKpAJQtXIhrz55WtWcwGjltXO0aqtKignqjQwBaeDjoOo5du/CWlbUqlhBCCCH8L+DJUHV1NephC4g1TQNos7U0liFDsI0YAV4vFd991+r2+gwaSsqM6zj74hkoypE/UkN0NL6amtot91VVrY4nhBBCCP9pdjJUWVnJhg0b2LBhAwC7d+9mw4YNZGXV1uyaPXs2V155Zd39KSkpLFiwgJdeeomMjAxWrVrFrbfeyogRI+jQoYN/votmUhSFqGuvJfrGG4m6+mq/tNm5ey8URcHr9bB66TfUVFXWu26IjcNXVlabEDmdfokphBBCiNZrdjK0bt06kpOTSU5OBuD2228nOTmZ++67D4CcnJy6xAhg5syZPPXUUzz//POccsopTJ06lT59+rDAD+t1WsMQHU3oWWehqCq614vXTyM2y778hPU/LePb+e/h9f5+zpCiKGixcXgKC3HuSkN3u/0STwghhBCto+gnwL7v8vJywsPDKSsra/X6Ide+/Th27sAYnwDUnjtU8PzzaCEhxP3rXyiK0qr2iwvy+OTNF3C7nAw49TTOmHxRveu6242nIB9T1yTMPXugHJgyFEIIIUTbkNMAAdfu3dSsX0/VypWtbisqNp6zpkwDFLb++jNbfv253nXFaESLjsGVtQfXniw5g0gIIYRoY+0+GTJ27EjE1NrdZc5du/zSZlKvfpw2biIAKxd9RvaejHrXVbMZLSIS1+4M3Puz/RJTCCGEEC0jVeuB8PPPx9y7N9aBA/3WZvLosRTm5bA/M73Bchyq1Yru8eBMS0MxGjHGx/ktthBCCCGaTpIhaqeuDiZCPocDT0EBplaeeq0oCmemXIKzppqQsIgG79FCQ/F4PDh37UIxGTFERrYqphBCCCGar91Pkx3KtXcv2bffTt4jj+CrqWl1e0ajqS4RykpPZdmXnxyxRsgQGYnuduPcmYq3oqKBVoQQQggRSJIMHcIQE4Ou63gLCij98EO/tVtdWcE3H73DtvVr+W3VD0dc12Ji8FZV4tiZ6pckTAghhBBNJ8nQIVSrlegbbgCg/Ouv/bag2hYSyh8nng8oDW7dVxQFQ2wc3pJiHGlprSogK4QQQojmkWToMLbkZOynnw4+H4UvvYTu8Rz7oSboP3Qkl93wN4aOObPB64qqYoiLx5OTiys93W9xhRBCCHF0kgw1IGrmzNrK9llZlH/9td/ajY5PBGqnzZYs/ABHTXW964qmYYiNxbV3H87MTHSfr6FmhBBCCOFHspusAVpYGFFXX41z+3ZCx4/3a9u6rvPt/PfI2ZtJTXUl5027GlX9/RRqxWhEi4rCnZmJYjJh7tLFr/GFEEIIUZ+MDDUi5I9/JPqGG1Dtdr+2qygKfzznAgxGI7rPh6eBGmWqxYISGoYrLR13To5f4wshhBCiPhkZOgZfVRXF772HuXt3Qs86yy9txiR04KKr/kx0fEK9UaFDaXY7Xo8Hx67aQxkNMTF+iS2EEEKI+mRk6BgqV66kcskSiv/3PzxFRX5rNzaxI6qq4fP5WPPDt+TtzzriHi08HHQdx65deMvK/BZbCCGEEL+TZOgYQidMwNSrF3p1NeVffOH39jesXs6vK7/nm4/epaqi/IjrhuhofDU1OFJT8VVV+T2+EEII0d5JMnQMiqYR8+c/EzFtGpF/+pPf2z9l2GiiYuOprqxg0cfv4vEcuYbIEBuHr6wMx65d+JxOv/dBCCGEaM8kGWoCU5cuRFx8MYrBgK7r6A0sem5x22Yzky69CrPFSt7+vSz/auERJTsURUGLjcNTUIhzV5pf4wshhBDtnSRDzeApKCD/kUcoev11v7YbHhXN2RfPQFFUdm76lU1rVh5xj6JpGGJicGfvx5mxG93r9WsfhBBCiPZKkqFm8BQUULN+PZVLl1KzebNf2+7cvRejzzoXk9lMeHTDO8cUoxEtOgZXVhauPVlHjCAJIYQQovkkGWoGS//+hJ59NgBFr7zi9/U7g0aMYdqfZ5HUq1+j96hmM1pEBK7dGXiys/0aXwghhGiPJBlqpsgZM9CiovDk5lL68cd+bVtRFOyhYQDkZe/l87mv43I6jrhPtVpRbHYcu9Jw5+f7tQ9CCCFEeyPJUDOpdjvR118PQPnnn+PMyPB7DJ/Py5IF77MvYxffffohun5kjTItNBQ0DWfqLjwlJX7vgxBCCNFeSDLUArbhw7GNGoWpRw8Uk8nv7auqxllTpqFpBsIjoxpdG2SIjER3u3GmpuKtrPR7P4QQQoj2QNFPgFW45eXlhIeHU1ZWRlhYWKvacu3bj2PnDozxCa1qx1dTg2IyoWgNl9Pwh/KSYsIio456j67rePJyMURGYunfH9VqDVh/hBBCiJORjAy1kGq1omgaus9HxeLFuHNz/R7jYCLkdNTw7fz3KMjZf8Q9iqJgiIvHU1yMIy0N3eXyez+EEEKIk5kkQ61U8t57FL36KkWvvBKwre4/f7+I9O2b+ebjd6muOnI6TFHV2oQoJxdnejq6xxOQfgghhBAnI0mGWin0rLNQTCYcmzdTtXx5QGKMPHMi4VExWG12fI0ctqhoGobYWFz79uHMzET3HbnoWgghhBBHMrR1B050xsREIi69FGdaGpbBgwMSw2K1kTLjWmz2UAxGY6P3KUYjWmQU7sxMFJMJc5cuAemPEEIIcTKRZMgPwi64AEVRAhsjonb9kK7rbFqzEoPJxIChI4+4T7VY0EPDcKWlo5pMGBNat1BcCCGEONlJMuQHBxMhn8tF2fz5mHv3xjZsWEBi7dm1nVVLvkRVVSKjY+nQtfsR92h2O16PB0fqLhSjEUN0dED6IoQQQpwMZM2QH5V/9RVlCxZQ9Npr+KqrAxKja69+9Ow/CJ/Px6L571FR2vCBi1p4OOg6jtRUvGVlAemLEEIIcTKQZMiPwiZPxpCQgLeoiJJ58wISQ1EUzjx/KjEJHXBUV/HNR+/ibmQ7vSE6Gl9NDY7UVHxVVQHpjxBCCHGik2TIj1SzmegbbwSg4ttvcezYEZA4RqOJSZdeidUeQmFeNt9/8XHjp1THxuErK8Oxa5ffC8sKIYQQJwNJhvzMOnAgIePGga5T9PLL6G53QOKEhkdyziV/wmgyk9SrX6MLuBVFQYuNw1NQiHNXWsD6I4QQQpyoJBkKgMgrrkCNiMBbXo57/5GnRvtLYpduXHHrXfQZNBSg0dEhRdMwxMTgzt6PM2O3nEEkhBBCHKLd7SZTjEbw6ehud+2fA0ALDSXujjswJibWVpcPIIvVBkBJYT7fffoh4y+4lKjY+CPuU4xGtOgYXFlZKEYjpm5JAT8OQAghhDgRtLuRIUNMNMbERLxFhQGNY+nduy4RcmZkoDdycrS/rF76DQU5+/jmo3dw1DS8k001m9HCw3Fl7saTnR3Q/gghhBAninaXDCmahimpK4rVGpQt5yXz5pFz551UfPttQOOced7FhIZHEt+xCwZD4yNeqs2GYrXh2JWGOz8/oH0SQgghTgTtLhkC0EJCMCcl4auuDviCYi06GnSdknnz8BQUBCyO1R7CxdfczPgLLsNgNB61aKwWGgqahjN1F56Shs8pEkIIIdqLZidDK1asICUlhQ4dOqAoCp9++ukxn3E6ndx999107doVs9lMUlISb775Zkv66zeGhISgTJeFnnUW5r59a8/8CfBZP7aQUBRFweN2s/Szj9ix8ddG7zVERqK73ThTU/FWVga0X0IIIcTxrNkLqKuqqhg8eDDXXHMNU6ZMadIzl156KXl5ebzxxhv07NmTnJwcfG28o+ngdJm3rBRvWVntic2BiKOqxP7jH6h2O6rJFJAYh9uxcR2pm38jfdsmImNiie/YcMFWLSYGT14uzp07sfTvj2q1BqV/QgghxPGk2cnQpEmTmDRpUpPvX7RoEcuXLycjI4OoqNpio0lJSc0NGxAHp8tqtm2vXUsToN1lhshIoHbre/WaNVj690cLCwtILIABp44kKz2VksJ8TGZLo/cpioIhLh5Pbi6OtDSsffqgBClhE0IIIY4XAV8z9PnnnzNs2DD+85//0LFjR3r37s2sWbOoqakJdOgmCdZ0GUDJ//5HwRNPUPzOOwGNoygqEy68nEuuvYXImLij36uqGOLi8OTk4kxPD/iuNyGEEOJ4E/BkKCMjg5UrV7JlyxYWLlzI008/zfz58/nLX/7S6DNOp5Py8vJ6r0AJ5u4y22mngaJQtXw5NRs2BDSWyWzGbKmd9tq56TeWfbWg8UMZDQa0mBhc+/bhzMyUQxmFEEK0KwFPhnw+H4qiMHfuXEaMGMHkyZN56qmneOeddxodHXr00UcJDw+ve3Xu3DmgfQzW7jJL796EHphiLHr1VXwOR8BiHVRWXMj3n3/Mtt/WsGnNykbvU00mtIhI3Lt349q3L+D9EkIIIY4XAU+GEhMT6dixI+GHLFDu168fuq6zr5G/dGfPnk1ZWVnda+/evYHuZtCmyyKnTatduJyfT+mHHwY0FkB4VAyjzzoXgJ+++4q9GamN3qtarSihYbjS0nHn5ga8b0IIIcTxIODJ0JgxY8jOzqbykO3bqampqKpKp06dGnzGbDYTFhZW7xVowZouU61Wom+4AYDyb77BU1wcsFgHDRoxhr6DT0XXdRZ/Mo+y4sYTPs1uRzGbcaTuwlNUFPC+CSGEEG2t2clQZWUlGzZsYMOBNS+7d+9mw4YNZGVlAbWjOldeeWXd/dOnTyc6Opqrr76abdu2sWLFCv75z39yzTXXYD3OtnIHa7rMNnQoEZddRuIjj2A4sMMukBRF4YzJU4jv2AWno4avP3wHt9vV6P1aeDjoOo7UVLwBXK8lhBBCHA+anQytW7eO5ORkkpOTAbj99ttJTk7mvvvuAyAnJ6cuMQIICQlhyZIllJaWMmzYMGbMmEFKSgrPPvusn74F/wrWdFnE1KmYu3cHCPgp2ACawcA5U68gJDyC/skjjlqyA6g7JNKVtfeop1kLIYQQJzpFPwH+pisvLyc8PJyysrKgTJl5Kyup2bgRUAJ2GCPUnjtUuWwZpe+/T8IDD2Ds0CFgsQ5yu10YjbVnCfl8PlS18XzY53Tiq6jANjQ5oOciCSGEEG2pXdYmO5Zg1i6rWrUKb3ExhS+/HJQt7QcTocryUj558wXStm5s9F7VbEb3uKWgqxBCiJOaJEONCMZ0maIoRN9wA4rZjCsjA/f+/QGLdbht63+hIGcf33/xMYV5OY3ep4aE4snLw3ecHJIphBBC+Fuzy3G0F8GqXWaMiyP2ttswdeuGISYmIDEaMuyP48jbtwdF1QgNj2j0PtVux5OTjaeoGFOnjkHrnxBCCBEssmboGNz791OzbTuGmJiA1S47lKewMGhJkdvlRDMY69YN6boPRTlysNBbWopiNmEbMiQoPwMhhBAimGSa7BiCWbusdOFC9t1yC1U//xzwWABGkxlVVfH5vKxc/AUrvvmswfvU0FC8pWV4SkqC0i8hhBAimCQZOoZg1i7THQ7weCh+4w28VVUBjXWovP172bRmFVt//Zmtvx6ZiCmahmIw4M7NlW32QgghTjqSDDVBsHaXhV98MYYOHfCWlFDy3nsBi3O4xM5JjDxzIvbQMGISGl4XpIaH4y0qwltaGrR+CSGEEMEgyVATBWO6TDWZiLnpJgAqlyzBsXVrwGIdbuiYsVx2w23Ed6wtinv4CJBqMoHXiye/IGh9EkIIIYJBkqEmCtZ0maV/f0LPPhuAwpdfxudqvGyGPymKgsVmByBz13Y++9+rR5TsUMPC8RTk4wviFJ4QQggRaJIMNYMWEoK5W7eAT5dFzpiBsWtXIi6+OOi7t9wuF8u+/ITsPRn88PnH9UaIVJsNX00NbingKoQQ4iQiyVAzGeLjAz9dZrfT4fHHCRk7FkVRAhanIUaTibMvnoGqaqRt28SmtSvr981mx5OdjR6kESshhBAi0CQZaqZgTZcpB87+cWZkUPjCC+heb8BiHa5Dl26MOfs8ANZ8/y1lJb+PBKmhoXgrKvAUFwetP0IIIUQgSTLUAsGaLvM5neT9+99U/vAD5V9/HbA4DTll2Cg6dO2Ox+Nm+VcL6qbLFFVFMZlx5+QEpZaaEEIIEWiSDLVQUKbLzGYip08HoPSDD/BWVAQs1uEUReHM8y7GaDIRk9AR3yGJjxYWhrekRLbZCyGEOClIOY5W8FZWUrNxI6AErHaZrusUvfgi9tNPxzpwYEBiHI2juqpul9mh3Hl5mDokYunXL+h9EkIIIfxJRoZaIRjTZYqiEHPzzXWJULBz14OJUHVVJZvWrqp7XwsLw11QgLeyMqj9EUIIIfxNkqFWCsZ02UHV69aR/c9/BrwsyOHcLicfvvJfVn77Obt31h4EqVqt6E6nHMIohBDihCfJUCvV7i5LCvjuMt3rpeSDD3BnZlL81lsBi9MQo8lM38HDANixYV3d+2pIKO68XHxOZ1D7I4QQQviTJEN+oIXYAz9dpmm1pTpUlaqVK6n+9deAxGnM8NMncMbki5g49Yq699SQEHyVlXjlEEYhhBAnMEmG/CQY02Xmnj0JO/dcAIpeew1fTU3AYh3OYDQy4NTTUFUVXdepqihHURQUixVXdk5Qz0ESQggh/EmSIT+pmy6z2QI6XRZx2WUY4uLwFhZSMm9ewOI0prK8lM/+9yqfvvsKHrcbLTQUX2kJ3pKSoPdFCCGE8AdJhvxIC7FjTkoK6HSZarEQfeONoKoomhb03WVGk5nSogLKigv5deX3KAYDuqrhzs0Lel+EEEIIf5BzhvxM93pxbN+BJzcHQ0JiwOK4c3MxJiQErP2jydixlW3r13LG5AsJDY/E53Tiq6jAljwkYOctCSGEEIEiyVAAeCurqNm0EXQCnhx4Kypwbt+ObcSIgMY5nK7r9YrIunNzMCUlYenZM6j9EEIIIVpLpskCIBjTZQCeoiL2/+1v5D/1FK69ewMWpyGKouD1elj341I2rvkRNTQMT15eUBd1CyGEEP4gyVCABGN3mRYVhblXL/B4KHrppaAXTt29cxtrly3m5+8XUeGoxldVhadIqtkLIYQ4sUgyFCDB2F2mKArR11+PGhGB7bTTIMgznj36DaRTt554PR6Wf70QxWrDnb0/oKNhQgghhL9JMhRAwZguM8TE0OmFFwg//3wUTQtIjMYoisIZ507BYDCyPzOdnRk78ZaV4ymWbfZCCCFOHJIMBVgwpstUsxkAd04OJR9+GNQt7uGR0YwYezYAq5d+Q7XTgTs3J+hTdkIIIURLSTIUYME6jNFXVUX2nXdS9vHHVP/0U8DiNGTQyDHEJnZCURTK3U68xcVBLyYrhBBCtJQkQ0EQlMMY7XbCzzsPgKI33sBbURGQOA3GVjXOumga0/78Dzr36gs+n1SzF0IIccKQZChIgjFdFn7RRRg7dcJXXk7Ju+8GLE5DIqJjsIWEAlBcXUVl1h68lVVB7YMQQgjREpIMBUlQdpcZjUT/+c+gKFT+8AM1mzYFJM7RbFq7ik/mvs7PP36HJ4CJnxBCCOEvkgwFUTCmyyx9+hB6zjkAVC5bFpAYRxOT0AFd97Fz51byt2zC53IFvQ9CCCFEcxjaugPtjSE+HmNxSUBrl0VOn46pWzdCxo4NSPtH06FLN4afcRaxCR0JN1nwFhejtlENNSGEEKIppDZZGwhm7TLd68VbXo4hMjKgcRriKSpCsduwJycH/QwkIYQQoqlkmqwNBKt2mTs3l5y77yb/4YfRPZ6AxWlMdlEe77/yNNmb1gc9thBCCNFUkgy1EUNCQuAPY7Ra8eTm4srMpPyLLwIWpzE7tmygvLyUJW+9grcNkjEhhBCiKSQZaiOKqgZ8d5kWHk7UzJlA7ShRsP1h4vlYbXY6JnbCUy6HMAohhDg+NTsZWrFiBSkpKXTo0AFFUfj000+b/OyqVaswGAwMGTKkuWFPSsGYLrOfcQYJDz9MzJ//HJD2j8ZmD2HGLXcwcvgYKC0PenwhhBCiKZqdDFVVVTF48GBeeOGFZj1XWlrKlVdeyfjx45sb8qQW6OkyRVGw9OkDgM/hwJGaGpA4jTGZLaj2EMoz0lj94XtSs0wIIcRxp9lb6ydNmsSkSZOaHeimm25i+vTpaJrWrNGkk93B6TJveRnesrKA7S5z5+WRN2cO3spKOj7zTFB3l+lWCwtee4bKqgpsUdEMPqv5//0IIYQQgRKUNUNvvfUWGRkZ3H///cEId8IJxnSZISYGNTQUvbqa4jfeCEiMRmMbjAxMHgHAirlvUVEsJ1MLIYQ4fgQ8Gdq1axd33XUX7733HgZD0wainE4n5eXl9V4nu4PTZZ7CwBQ4VTStdt2QqlL9889UrVkTkDiNGfSHM4mLS8BVU83SN17iBDjeSgghRDsR0GTI6/Uyffp05syZQ+/evZv83KOPPkp4eHjdq3PnzgHs5fHh4HSZarcHbHeZKSmJ8AsuAKD49dfxVgWvkKpmNHL62Imoqkr6ujWk/rwqaLGFEEKIowloMlRRUcG6deu45ZZbMBgMGAwGHnzwQTZu3IjBYOD7779v8LnZs2dTVlZW99q7d28gu3ncCMZ0Wfgll2BITMRbUkLZJ58EJEZjYpJ6MOTAdNnGJV8HNbYQQgjRmIDWJgsLC2Pz5s313nvxxRf5/vvvmT9/Pt26dWvwObPZjNlsDmTXjluGhASMxSW4c7IxJnbwe/uq2UzMTTdRuXIlERdf7Pf2jxU7efAwbPEJnDr9qqDGFkIIIRrT7GSosrKStLS0uq93797Nhg0biIqKokuXLsyePZv9+/fz7rvvoqoqp5xySr3n4+LisFgsR7wvagVjd5llwAAsAwbUfa3rOoqi+D1OQwwRUQywh6K63egGAzXlZdjCI4ISWwghhGhIs6fJ1q1bR3JyMsnJyQDcfvvtJCcnc9999wGQk5NDVlaWf3vZzgSrdpm3qorCV16h9IMPAhbjcKrNhq+6mrLM3Xz6+EPMvfsfuB2OoMUXQgghDidV649Tus+Hc/t2XNmBmS4DqF67lvz//Ac0jQ6PPYYpKSkgcQ7nLSvDrXv5eN4bVBQVcup5FzH2imuDElsIIYQ4nNQmO04pqoqxa2B3l9lGjMA2ciR4vZR9+WVAYjREDQlBq3Fy5tQ/0bHvAAaNnxi02EIIIcThZGToOOfOzqZm6zYMMTEoRqPf2/cUF1O1fDlhKSkoTTwHyi9xCwvRIiKwDDwFVdOCFlcIIYQ4nIwMHecMCQmYOgTuMEZDVBThF12EYjCg6zq+mpqAxDmcFh6Ot7gYX3k5Pp+X3775nHVfLgxKbCGEEOJQwRsKEC1ycLrMUxbY2mWeggKKXnkFHYi/++6A7y5TjEZ0nxdPfj7Zu9P44e1X0QwGuiUPI7rjyX/IphBCiOOHjAydAIKxu0x3u6nZuhXHhg1U/fhjQGIcTguPwJ2fT5de/eg25FQMZjNl+blBiS2EEEIcJGuGThDB2F1WumABpfPmoYaG0vHppwM2CnUod04O5t69cIeGoKgq9ojIgMcUQgghDiUjQyeIYOwuCz//fIxdu+KrqKD47bcDEuNwqt2OOzsbW0hoXSKUn5lBRZFUthdCCBEckgydQAI9XaYYDHWV7at+/JHq337ze4zDqSEh+Cor8RYVAbD5+8W8N/s2vnv9BalsL4QQIigkGTrBBHp3mblnT8LOPRdz794YYmMDEuNQiqqimMy4c3LQvV469O6Lqqpk/PYLO39aEfD4QgghhCRDJ5hgTJdFTp9OwkMPYeocnF1dWng43tJSvKWlRHfqwsiLLgPg+7dfpaaiPCh9EEII0X5JMnQCCvh0mdGIomnoPh8VS5bgTE/3e4x68QwGdMCTm4uu64y48BJiOnelpryMZe+8FtDYQgghhCRDJ6i66bIALjQu++QTil55pfb8Ia83YHEAtLBw3IWF+Cor0QxGzr7xVlAUtv34A7npuwIaWwghRPsmydAJqm66zGYL2HRZ6FlnodrtuDIyqFi0KCAxDlItFnSXC09B7VqoxF59GD11Oufddifx3XsGNLYQQoj2Tc4ZOsEFunZZxZIl1GzeTNTVV2OIDOwZQN6KCtB92IYORbVY6l3TfT4UVXJ3IYQQ/id/u5zgAj1dFjJhAnG33x7wRAiO3GZ/UHbqdt6981ayU3cEvA9CCHGiGzt2LLfddltbd+OEIsnQCS7Q02UHa5T5nE5K3n+fqrVr/R7j0FiK1YYrJxfd46l7f+OSbyjMymTxK8/i9QSmHIkQQrRny5cvZ9y4cURFRWGz2ejVqxdXXXUVLper7h5d13nttdcYNWoUYWFhhISEMGDAAP72t7+RlpZWd98DDzxQ+/tcUTAYDMTExHD66afz9NNP43Q62+LbOyZJhk4CWogdc7duAa1dVvHNN5R98gnFr7+Or7o6IDEAtLAwfKUleEtK6t4be+V12MIj6NinP95DkiQhhBDNc2hyc9C2bds455xzGDZsGCtWrGDz5s0899xzmEwmvAc2z+i6zvTp07n11luZPHkyixcvZtu2bbzxxhtYLBb+/e9/12tzwIAB5OTkkJWVxQ8//MDUqVN59NFHGT16NBUVFUH5XptDqtafJAzx8ZiKi3Hl5GBMSPR7+6GTJlHx3Xd4cnMpef99oq+91u8xABRNA82AKzcXLSYGRVGwhoZx9VMvYwkJCUhMIYQ4WSUlJXHttdeya9cuPv30U6ZMmcLbh5VbWrx4MQkJCfznP/+pe69Hjx6cc845dV9/+OGHfPDBB3z22Wecf/75de936dKF00477YiKAQaDgYSEBAA6dOjAwIEDOeussxg8eDCPPfbYEclTW5ORoZNEoKfLVLOZ6BtuAKBi0SKchwyJ+j1WWBjeoiJ8h3wfBxMhZ3UVaz+bj88X2K3+QghxOF3XqXZ5gv5q7T6nJ554gsGDB7N+/XruvffeI64nJCSQk5PDihWNn/r//vvv06dPn3qJ0KEOLqk4mr59+zJp0iQWLFjQ9M4HiYwMnUQOTpc5tm5Ft9n8vrvMOmgQ9tNPp2rFCopefpnExx6rHcnxM9VsxlfiwV1QgBYRUfe+z+dl3j2zKN6/F6PZTPI5KX6PLYQQjalxe+l/37dBj7vtwYnYTC3/63rcuHH84x//aPT61KlT+fbbbznjjDNISEjgtNNOY/z48Vx55ZV1O7hTU1Pp06dPveduu+02Xn/9dQAiIiLYt2/fMfvSt29fFi9e3OLvJVBkZOgkY4iPx5gYuN1lUVddhRoSgqe4GHd2dkBiAKihYXjy8uqtT1JVjeSJ5wGw7ccf0H2+gMUXQoiTxbBhw+r+fNNNNxESElL3AtA0jbfeeot9+/bxn//8h44dO/LII4/UrftpzN13382GDRu47777qKysbFJfdF1v0ihSsMnI0Enm4HSZp6wMb1kZWni4X9vXwsOJu+MOjJ07o4WG+rXtQ6l2O+7sMtxFRZhttrr3B581CVXT6H/GeDl3SAgRVFajxrYHJ7ZJ3Naw2+11f37wwQeZNWtWg/d17NiRK664giuuuIKHHnqI3r178/LLLzNnzhx69erFzp07690fGxtLbGwscXFxTe7L9u3b6datW8u+kQCSZOgkFOjpMkv//nV/du3fj7FDh4Bk+qrdjic7G1N8PIrJBNQme4Mm1C7q03WdyuIiQqNj/B5bCCEOpyhKq6arjgdxcXFNSl4iIyNJTEykqqoKgGnTpjF9+nQ+++wzLrjgghbF3rFjB4sWLWL27Nktej6QTux/q6JRhvh4jAHcXQZQ/M47lH/5JbH/+Af2007ze/tqSAie/Hw8JSUY4+PrXXNUVrLopafZv3MbVz/1ErYw/46ACSFEe/HKK6+wYcMGLrroInr06IHD4eDdd99l69atPPfccwBcfvnlLFiwgMsvv5zZs2czceJE4uPj2bNnDx9++CHaYetHPR4Pubm5+Hw+ioqKWLZsGf/+978ZMmQI//znP9vi2zwqmWc4SQWjdpliNoOuU/zGG/gOfHrwa/uahmI04s7JPWJ9kNFioTw/F0dFuVS2F0KIVhgxYgSVlZXcdNNNDBgwgDPOOIOff/6ZTz/9lDPOOAOoHRX78MMPefrpp/n6668ZP348ffr04ZprrqFz586sXLmyXptbt24lMTGRLl26MHbsWD766CNmz57Njz/+WLdW6XgitclOcu6cHBxbt6JF+792mc/lIvv221E0jdh//hNTp05+bR9Ad7vxlhRjTU4+oiRIbloq8+6Zha77mHLXA3RLHtZIK0IIIUTjZGToJBfI3WWqyUT83XfT4YknApIIAShGI7qu48nLO+JaQs/eDJ1ce+bFktdewFUTuJOxhRBCnLwkGTrJ1U2X2e0BmS4zJibWJSzV69fXqynmL1pYOO78ArwNbN0cc+mfCI+Lp6KogJUf/M/vsYUQQpz8JBlqB7QQO+akJPSawNUuK3rxRfIffpjyr77ye9uq1YrudOApPHJ0y2ixcNb1fyWuWw8GnDHe77GFEEKc/CQZaicCfRijuV8/AEo/+gh3fr7f21dDQnHn5OBroMhg10FD+NMj/yW+e0+/xxVCCHHyk2SonQj0dFnImWdi7t8f3emk+PXXW11L53Cq3Y6vshJvUVGD1xVVRdd1tiz7jl++OP7q3gghhDh+STLUjgRyukxRFKJvvBEMBmp++43q1av9276qopgtuPZno3sbLtK6d+tmvn3paVa+/y6FWZl+jS+EEOLkJclQOxPI6TJTx46EX3QRUHsgo78TLi0sDF9ZKd6Skgavdx4wkB7DTkM1aBTt3+vX2EIIIU5ecgJ1O1NXu6y8PCC1y8Ivugj3/v2EX3ih3881UgwGdBTceXlo0dFHlABRFIUJ1/0Fr9tFeFyCX2MLIYQ4ecmhi+1UIA9jPJS/KxT7nE58lRXYkpPRjvHfQnH2fgxGI2GxTS8iKIQQov2RabJ2KtC7y3Rdp+KHH8ibM8evZw+pZjO6293gNvtD7Vi1nHfvuIXFrz7n98XcQgghTi6SDLVTiqpiSgrc7jJfVRUl//sfji1bKP/iC7+2XbfNvqam0XviutVus9+zaT17Nq33a3whhDiejR07lttuu81v7c2cOZMLL7zQb+0djyQZasdUe+B2l2khIURdeSUAZV9+ic/p9Fvbqt2Or6oKT1Fxo/dEdejI2Cuu49xb/0nXQcl+iy2EEOLkI8lQOxfI6TL7GWcQPnUqHR57DNVs9lu7iqKgWG24c7KPOgU3ZOK59B1zBoqi4GtkO74QQpxMZs6cyfLly3nmmWdqf1cqCpmZmWzZsoVJkyYREhJCfHw8V1xxBYWHLDeYP38+AwcOxGq1Eh0dzYQJE6iqquKBBx7gnXfe4bPPPqtrb9myZcfsx5133knv3r2x2Wx0796de++9F/dhH7q/+OILhg8fjsViISYmhosO7EYGcDqd3HnnnXTu3Bmz2UzPnj154403/PZzOlyzk6EVK1aQkpJChw4dUBSFTz/99Kj3L1iwgLPOOovY2FjCwsIYNWoU3377bUv7K/wskNNliqIQedllGGJiAPw6+lS7zb4MT3Hjo0MHZafu4N07/kraujV+iy+EaMdcVUd/eQ/5kOZxHf1e9yHT/bp+5PVmeuaZZxg1ahTXX389OTk55OTkEBoayrhx40hOTmbdunUsWrSIvLw8Lr30UgBycnKYNm0a11xzDdu3b2fZsmVMmTIFXdeZNWsWl156Keecc05de6NHjz5mP0JDQ3n77bfZtm0bzzzzDK+99hr//e9/665/9dVXXHTRRUyePJn169ezdOlSRowYUXf9yiuv5P333+fZZ59l+/btvPLKK4SEhDT759FUzd5N9s0337Bq1SpOPfVUpkyZwsKFC486l3jbbbfRoUMHzjzzTCIiInjrrbd44oknWLNmDcnJTZu+kN1kgRfI3WW6203ZwoVUfP89HZ54As1P/0F7CgrQoqOwDhx41B1ry997k3VfLCAkKpqZT76I2Wb3S3whRDv1wDGOJJn6Ngw4MMqx+B746bnG7+2QDDcsq/1zVSE83uOwWM3/kDp27FiGDBnC008/DcC///1vfvzxx3oDEfv27aNz587s3LmTyspKTj31VDIzM+natesR7c2cOZPS0tJjDn4czRNPPMEHH3zAunXrABg9ejTdu3fnvffeO+Le1NRU+vTpw5IlS5gwYUKLYzZHs88ZmjRpEpMmTWry/Qf/ZRz0yCOP8Nlnn/HFF180ORkSgWeIj8dYXIwrJwdDfIJft8MDVK1ahbewkJK5c4m58Ua/tKmGh+MtKsJXVoYWEdHofaOnTidt7WpK83L4cd7bTLjuZr/EF0KIE8HGjRv54YcfGhxZSU9P5+yzz2b8+PEMHDiQiRMncvbZZ3PJJZcQGRnZ4pgffvghzz77LOnp6VRWVuLxeOoNZmzYsIHrr7++wWc3bNiApmmcccYZLY7fXEE/dNHn81FRUUFUVFSj9zidTpyHLLgtLy8PRtfatYPTZZ7ycnzl5X49jFExGom+8UZy77uPyiVLCDnjDCx9+7a6XdVkwuf14s7LP2oyZDRbOOuGv/LxQ/9i45Jv6DvmDDr1O6XV8YUQ7dS/so9+XTtkjeS4+2Ds7MbvVQ5ZrWKLPnbbLVBZWUlKSgqPPfbYEdcSExPRNI0lS5bw008/sXjxYp577jnuvvtu1qxZQ7du3Zodb/Xq1cyYMYM5c+YwceJEwsPD+eCDD3jyySfr7rFarY0+f7RrgRL0BdRPPPEElZWVdXOVDXn00UcJDw+ve3Xu3DmIPWy/Arm7zNK/PyHjxgFQ9MorfmtfDQ3DU5CPr+roc+tdThnEwHFnA7D4lefwuFx+iS+EaIdM9qO/tEPGGQymo99rPOQvfkU58npLumcy4T1k08jQoUPZunUrSUlJ9OzZs97LbrcfCK0wZswY5syZw/r16zGZTCxcuLDB9o7lp59+omvXrtx9990MGzaMXr16sWfPnnr3DBo0iKVLlzb4/MCBA/H5fCxfvry533qLBTUZmjdvHnPmzOGjjz4iLq7xU4Fnz55NWVlZ3WvvXqkzFSyH7i7z92GFkVdcgRoWhnvvXsr8dPaQarfjq3HgbqSa/aFO/9M12CMiiUvqLsmQEOKklZSUxJo1a8jMzKSwsJCbb76Z4uJipk2bxi+//EJ6ejrffvstV199NV6vlzVr1vDII4+wbt06srKyWLBgAQUFBfTr16+uvU2bNrFz504KCwuP2BV2uF69epGVlcUHH3xAeno6zz77bF1iddD999/P+++/z/3338/27dvZvHlz3chVUlISV111Fddccw2ffvopu3fvZtmyZXz00UeB+YERxGTogw8+4LrrruOjjz465oIos9lMWFhYvZcIjkN3l/n8PD2phYYSNXMmamho3Q4zf1BtNjw5OejHSHAs9hCu/M9znHfbnVgCuCtBCCHa0qxZs9A0jf79+xMbG4vL5WLVqlV4vV7OPvtsBg4cyG233UZERASqqhIWFsaKFSuYPHkyvXv35p577uHJJ5+sWx98/fXX06dPH4YNG0ZsbCyrVq06avzzzz+fv//979xyyy0MGTKEn376iXvvvbfePWPHjuXjjz/m888/Z8iQIYwbN461a9fWXX/ppZe45JJL+Mtf/kLfvn25/vrrqTrGDEBrtKo2maIox9xNBvD+++9zzTXX8MEHH3DBBRc0O47sJgu+QO0u03UdX1WV33aUAeg+H568XKyDBmGMj2/SM26ng03ffUvyOeehaprf+iKEEOLE0+wF1JWVlaSlpdV9vXv3bjZs2EBUVBRdunRh9uzZ7N+/n3fffReonRq76qqreOaZZxg5ciS5ublA7QKpcD9XTBf+U7e7bH82hoQEFNU/g4iKotQlQs6MDLxlZdhauatQUVUUkxl3djaG2Nhj9lXXdT58YDZ5GbvQfV6GpUxpVXwhhBAntmb/Dbdu3TqSk5PrtsXffvvtJCcnc9999wG1hzdlZWXV3f/qq6/i8Xi4+eabSUxMrHv97W9/89O3IAJBUVVM3bujRUUdsyhqS9Rs3EjOXXdR+PzzeCsqWt2eFhaGt6QEb2npMe9VFIXBZ9UO/27+YYmcTi2EEM3wyCOPEBIS0uCrOUfvHE9aNU0WLDJN1nY8JSU4tm4FRfXrdnvd7Sb7n//EvW8fIePHE/PnP7e6TXdeLqYOHbAcWPR31Pi6zvpFX3LKmRMwWYK/jVMIIU5UxcXFFDdy+r/VaqVjx45B7lHrSTIkjsmdk4Nj+3bU0DBUP57/4Ni2jcKXXyb6+uuxDhzY6vZ8NTX4amqwDU1u9pqkqtIS7BEtP2BMCCHEiUsKtYpjMiQkYEpKwlta4tfzhyz9+9Pxv//1SyIEoFqt6E4HnoKCJj/jctTwzfNP8vbtf6aqtMQv/RBCCHFikWRIHJOiKJi6dMGY2AFPYYFfzx9SDuzkql63jnI/FPBVQ0Jx5+biO+QE86MxGE0U7svCUVXJ92+/2ur4QgghTjySDIkmUQwGzD26o0VE4PXzgmrH1q3k/9//Ufz227hzclrVlhoSgq+iEm8TDmEEUDWNiTf9jYQevRhx/sWtii2EEOLEJMmQaDLVasXcsycYNLxlza+k3Bhz//5YBg0Ct5ui115r1ciToigoFguu7Bz0Ju4Si0vqzvSHnyK+e88WxxVCCHHikmRINIshMhJLz57ojtrFyv6gKArRN9yAYjLh2LSJqh9/bFV7WlgYvrJSvCVNXwOkKAq6rrN1+VJWzHu7VfGFEEKcWCQZEs1mSEjAmJSEt6QY3ePxS5vGhATCL7kEgOK3327V2UOKwYCuqLhz85o1ylSwZzeLXvwvv3w2n73bNrc4vhBCtGeZmZkoisKGDRvauitNJsmQaDZFUTB36YKxQ0c8Bfl+W1AdnpKCsXNnfBUV1Gzc2Kq2tPBwPIWF+JqRVMUldWfQhHMAWPzKs7hdTVuELYQQx5OxY8dy2223+a29mTNnHrPs1olOkiHRIorRiLl7N78uqFaMRmJuvpnERx4h5A9/aFVbqtmM7nHjzs9v1nOnz7iakMgoSnNzWD3//Vb1QQghxIlBkiHRYqrN9vuCaj9VuDf37Im5Vy8AvBUVrTrXSA0JxZOX16y1TWabnfHX/gWAdV8sIC8j7RhPCCHE8WPmzJksX76cZ555pnZDiaKQmZnJli1bmDRpEiEhIcTHx3PFFVdQeMgH2fnz5zNw4ECsVivR0dFMmDCBqqoqHnjgAd555x0+++yzuvaWLVvW7H4tX76cESNGYDabSUxM5K677sJzyDKLxuIDLFu2jBEjRmC324mIiGDMmDHs2bOn1T+rQ0kyJFrFEBmJpUcP9Jpqvy2oBqj6+Wf2/+1vlH36aYvbUO12fFVVeIoaPja+MT2Hn0bv0/6Aoqjk78locXwhxMmp2l1Ntbu6bolAjaeGanc1Xl/tDlan10m1uxq3r/bDnNvrptpdjcvrAsDj81DtrsbhcQDg0311bR4eo7meeeYZRo0axfXXX09OTg45OTmEhoYybtw4kpOTWbduHYsWLSIvL49LL70UqK0pOm3aNK655hq2b9/OsmXLmDJlCrquM2vWLC699FLOOeecuvZGjx7drD7t37+fyZMnM3z4cDZu3MhLL73EG2+8wb///e9jxvd4PFx44YWcccYZbNq0idWrV3PDDTegKEqzfzZH0+yq9UIczpCYiLG6GldGBooxHsXQ+v+sdI8HX3k5pQsWYB8zBmOHDs1uQ1EUVJsdd/Z+jPFxKEZjk58dd/WNjJ46nehOXZodVwhxchs5byQAyy9bTpQlimlfTiO9LJ03J77J8IThzP5xNkv2LOFfI//FtL7TeG3za7y08SUu63MZ95x2D0uzljJr+SyGxQ/jrXPeIqM0g4s+v4hIcyQrLl9RL8bmq5q3mSM8PByTyYTNZiMhIQGAf//73yQnJ/PII4/U3ffmm2/SuXNnUlNTqaysxOPxMGXKFLp27QrAwEMqA1itVpxOZ117zfXiiy/SuXNnnn/+eRRFoW/fvmRnZ3PnnXdy3333kZOT02j84uJiysrKOO+88+jRowcA/ZpQf7K5ZGRItJqiKJi7dsWQmOi3BdX2MWOwDBmCoqq4WjEcqoaG4i0rx9OMbfYA9ojIukSovLCAsvy8FvdBCCHa0saNG/nhhx/qVZfv27cvAOnp6QwePJjx48czcOBApk6dymuvvUZJM39nHs327dsZNWpUvdGcMWPGUFlZyb59+44aPyoqipkzZzJx4kRSUlJ45plnyGnl4bwNkUKtwm981dXUbN2Kr7IKQ2xsq9vzFNSW/jDGxbW6HS0qEuugQc0eWk3/dS1fP/c48d16MvW+R/w+NCuEOPEcnL6yGqwoikKNpwZd1zFrZjRVw+l14vV5MWpGjKoRt9eN2+fGoBowaSY8Pg8urwtVUbEYLPh0X92Umc1oqxfj4NfNMXbsWIYMGcLTTz8NwKRJk7DZbDz22GNH3JuYmIjdbkfXdX766ScWL17MwoULyc3NZc2aNXTr1o2ZM2dSWlrKp01ctpCZmUm3bt1Yv349Q4YMYcqUKYSHh/PWW2/V3bNx40aGDBnCnj176NKly1HjA6xfv55FixbxxRdfsHnzZpYsWcJpp53W7J9NY2RkSPiNvxdUG2Jj6xIhd25ui88eUsPD8RYX4y0tbfaz0Z264PP52LttM2nrfm5RfCHEycVmtGEz2uo+HFkNVmxGG5paW2vRrJmxGW0Y1dqpeaNmxGa0YdJMABhUAzajDYvBAoCqqHVtHh6jJUwmE95DTuAfOnQoW7duJSkpiZ49e9Z72e12oHaEf8yYMcyZM4f169djMplYuHBhg+01V79+/Vi9enW9WYNVq1YRGhpKp06djhkfIDk5mdmzZ/PTTz9xyimnMG/evBb3pyGSDAm/qreg2uHwS5sVP/xA9u23U/Luuy16XjWZwOfDk9/0avYHRcQnMPaKa5lw3c30PHVki+ILIUQwJSUlsWbNGjIzMyksLOTmm2+muLiYadOm8csvv5Cens63337L1VdfjdfrZc2aNTzyyCOsW7eOrKwsFixYQEFBQd3anKSkJDZt2sTOnTspLCzE3cxdvn/5y1/Yu3cvf/3rX9mxYwefffYZ999/P7fffjuqqh41/u7du5k9ezarV69mz549LF68mF27dvl93ZAkQ8LvDImJGLt2xVtc5JcTqo0dOqC7XFT+8AM1W7a0qA01NAx3fh6+A1s1m2PwWZMZfNYkFFVF9/laFF8IIYJl1qxZaJpG//79iY2NxeVysWrVKrxeL2effTYDBw7ktttuIyIiAlVVCQsLY8WKFUyePJnevXtzzz338OSTTzJp0iQArr/+evr06cOwYcOIjY1l1apVzepPx44d+frrr1m7di2DBw/mpptu4tprr+Wee+4BOGp8m83Gjh07uPjii+nduzc33HADN998MzfeeKNff2ayZkgEhO52U7NjB568PAzxCa1ea1P06qtULF6MoUMHOj75ZLN2hh3kzsnG3Ls35gO7FZqrICuTxa88y4jzL6HXyOZtLRVCCHH8kpEhERCK0YilRw+0sDC/nFAdMWMGWkQEnuxsyg6ZR24O1WbHk5OD7nK16PnUn1eSm5bK0jdfwlFZ2aI2hBBCHH8kGRIBo9pstadJa61fUK3Z7URdcw0ApQsW4M5r/lZ3NTQUb0UFnuLmHcJ40MiLLiOqQyc69h2Az9fyxYRCCHEie+SRR+pt0z/0dXBq7UQj02Qi4NzZ2Ti2bUONiES1WFrcjq7rFD7zDJYBAwgZPx5FbX4u7ykqQgsLxTp4cIued1RVYrGHNPs5IYQ4WRQXF1PcyIdKq9VKx44dg9yj1pNkSAScrus409Jw7d6NIc4/J1S3uC9uN96SYqxDhmCIimpxO26Xk9+++oyhk8/HaG55gieEEKLtyTSZCDhFUTAnJdWeUF1Y4JcTql2ZmeQ98gjesrLm9cVoRNfBk5vbqvifPjaHlR+8y08f+/esCyGEEMEnyZAICsVoxNK9u18WVOu6TuGLL1Lz228U/+9/zX5eCwvDXVjY4kMcAU499yIAfv3yU6lsL4QQJzhJhkTQqHb77wuqW5GIKIpC9HXXgaJQtWwZrqys5vXDakV3OvEUtDwp6z50OH3HnIGu+/j25Wfw+uE8JSGEEG1DkiERVLUnVHdHr6ps1QnV5t69ibj8cuLvuQdTl+ZXlldDQnHn5eJzOlvchzOvuh5LSCgFe3az7osFLW5HCCFE25JkSASdoUMHv5xQHXHxxViHDAFo9snQakgIvspKvEVFLY5vC4/gzKuuB2DT0kV4mnlEvRBCiOND223rEe3WwQXVPofDLydUV69fT/FbbxF3xx2YDhT9a0ofFIsVV3YOhri4Fu9w6/fHM6kuL2PA2AkYWnAqthBCiLYnI0OiTdRbUN2K0RmAikWL8GRnU/TKK80aIdLCwvCVluAtKWlxbEVRGHbeRVhDQgHITUv1y245IYQ4HiQlJfH000/7pa1ly5ahKAqlpaV+ac+fJBkSbUa12zH37Amq2qoF1dHXXYdiNuPcvp3KH35o8nOKpqGrGu68fL8kMCs/eJe5d9/OxiXftLotIYRoqbFjx3Lbbbf5pa1ffvmFG264wS9tHc8kGRJtyhAV9fuC6hYuZjbExhJx2WUAlPzvf806e0gLD8dTWIivleVCAMwHTqZe8d6bVJc37/wjIYQIFl3X8TRxvWZsbCw2my3APWp7kgyJNle3oLqoEN3bsppfYeeeiykpCV9lJcXvvNPk51SzGTxu3AUFLYp7qGHnXcTgs8/l4rsfwhYW3ur2hBCiuWbOnMny5ct55plnatdGKgpvv/02iqLwzTffcOqpp2I2m1m5ciXp6elccMEFxMfHExISwvDhw/nuu+/qtXf4NJmiKLz++utcdNFF2Gw2evXqxeeff97i/n7yyScMGDAAs9lMUlISTz75ZL3rL774Ir169cJisRAfH88ll1xSd23+/PkMHDgQq9VKdHQ0EyZMoKqqqkX9kGRItLm6E6oTEvAWtGzKStE0om+6CVQV1WJpVlKlhIbhyc3DV1PT7Lj12lEUJlz7Zzr26QdARXGhFHQV4iTkq65u8HXw947u89V7/yDd7W742UN+9/hcrt/fd7ma3bdnnnmGUaNGcf3115OTk0NOTg6dO3cG4K677uL//u//2L59O4MGDaKyspLJkyezdOlS1q9fzznnnENKSgpZxzi7bc6cOVx66aVs2rSJyZMnM2PGjEZrlR3Nr7/+yqWXXsrll1/O5s2beeCBB7j33nt5++23AVi3bh233norDz74IDt37mTRokWcfvrpAOTk5DBt2jSuueYatm/fzrJly5gyZUqLlzzIbjJxXFCMRiw9elBTU4O3qAhDTEyz2zD37EmnF17AEBvbrOdUmw1Pbg6eoqIm70Y7lt0bfuXrZx8neVIKo6fO8EubQojjw86hpzb4fpd33sE+cgTurCzSzzlQvd1goN+WzQCUfPQReQ/9+4jnTD170OPLLwHIf+IJSt6tPVk/8sorSPjXv5rVt/DwcEwmEzabjYSEBAB27NgBwIMPPshZZ51Vd29UVBSDBw+u+/qhhx5i4cKFfP7559xyyy2Nxpg5cybTpk0DaivYP/vss6xdu5ZzzjmnWX196qmnGD9+PPfeey8AvXv3Ztu2bTz++OPMnDmTrKws7HY75513HqGhoXTt2pXk5GSgNhnyeDxMmTKFrl27AjBw4MBmxT+UjAyJ40bdCdWq0uIF1QcTIW9VFdW//NKkZxRFQbXacGdno/vprKCainIcVZWs/uQDctJ2+qVNIYRojWHDhtX7urKyklmzZtGvXz8iIiIICQlh+/btxxwZGjRoUN2f7XY7YWFh5OfnN7s/27dvZ8yYMfXeGzNmDLt27cLr9XLWWWfRtWtXunfvzhVXXMHcuXOpPjDSNnjwYMaPH8/AgQOZOnUqr732GiWt2BksI0PiuGKIisLcvQfOnTvwmUy1a3qayVNSQvY//4mvspIOjz+O6cAQ8dGooaF48vPxFJdgjI9rSdfr6f/HM8nZtZOQqGgSuvdqdXtCiONHn99+bfB95cDvK2OXLg3eE3nppURcdFEDD/5+zlrcrFnEHdwJ1sLzzxpjt9vrfT1r1iyWLFnCE088Qc+ePbFarVxyySW4jjE9ZzzsTDVFUfA18+DbpggNDeW3335j2bJlLF68mPvuu48HHniAX375hYiICJYsWcJPP/3E4sWLee6557j77rtZs2YN3bp1a3YsGRkSxx1jh0SMXbq0eEG1FhFRu2Xf42ny2UOKpqEYjbhzc5p9mnVjxl19IyMvnIqiqng9HjmhWoiThGqzNfhSNA0ARVXrvX+QYjQ2/KzV+nvbJtPv75tMLeqfyWTC24TfnatWrWLmzJlcdNFFDBw4kISEBDIzM1sUsyX69evHqlWrjuhT79690Q78LA0GAxMmTOA///kPmzZtIjMzk++//x6oTcLGjBnDnDlzWL9+PSaTiYULF7aoLzIyJI47iqpi7toVX3U13oJ8tGaeUK0oCtHXXkt2airWoUOhiQvqtPBwvEXFeMvKMERGtrT79foBtQupv3z6P8R07sJZ1zc+Dy+EEP6QlJTEmjVryMzMJCQkpNFRm169erFgwQJSUlJQFIV77703ICM8jfnHP/7B8OHDeeihh7jssstYvXo1zz//PC+++CIAX375JRkZGZx++ulERkby9ddf4/P56NOnD2vWrGHp0qWcffbZxMXFsWbNGgoKCujXr1+L+iIjQ+K4pJhMWHr2RA0NbdEJ1YbYWDq99BIRU6bUfVo7ZkyjEd3nxdOCue+jKdq3l+zU7Wz6bhFbly/1a9tCCHG4WbNmoWka/fv3JzY2ttE1QE899RSRkZGMHj2alJQUJk6cyNChQ4PWz6FDh/LRRx/xwQcfcMopp3Dffffx4IMPMnPmTAAiIiJYsGAB48aNo1+/frz88su8//77DBgwgLCwMFasWMHkyZPp3bs399xzD08++SSTJk1qUV8UvZn70FasWMHjjz/Or7/+Sk5ODgsXLuTCCy886jPLli3j9ttvZ+vWrXTu3Jl77rmn7pttivLycsLDwykrKyMsLKw53RUnOE9RETVbt6IYTWihoS1qw52fT/WaNYSnpBzzXl91NT6nA1vyULQQ+zHvb6rV89/np4/nYjCamPbvJ4hL6u63toUQQrROs0eGqqqqGDx4MC+88EKT7t+9ezfnnnsuZ555Jhs2bOC2227juuuu49tvv212Z0X7Y4iOxty9R4tPqPZWVJD9j39Q8s471GzceMz7VZsN3eHEU1TYku426rQpl9FtyKl43C6++O+jOKtbdjCYEEII/2t2MjRp0iT+/e9/c1FDK+Ib8PLLL9OtWzeefPJJ+vXrxy233MIll1zCf//732Z3VrRPrVlQrYWGEjJuHABFr77apIRKtdvx5OS06MCzxiiqyqRb/kFoTCyluTn88M5rfmtbCCGOBzfddBMhISENvm666aa27t5RBXwB9erVq5kwYUK99yZOnHjUInJOpxPnIX9plfuhbpQ4cSmqijkpCV9NTYsWVEdefjnVq1fjycuj7JNPiJw+/aj3qyEhePJy8RYXox44tMwfrKFhnP/32ayY+xZjLv2T39oVQojjwYMPPsisWbMavHa8L3EJeDKUm5tLfHx8vffi4+MpLy+npqYG6yFbCg969NFHmTNnTqC7Jk4gismEuUdPHA4H3uJiDNHRTX5WtVqJuu46Cv7zH8o++wz7H/6AqUuXxmOpKorJjDs7G0NsbJMXYDdFQs/eTL3vkbpkzu1wYLRY/Na+EEK0lbi4OOLiWn9OW1s4LneTzZ49m7KysrrX3r1727pL4jighdhrzw9Cb/YJ1fYRI7AOHw5eLxVNWK+mhYXhLS3FW1rass4ehaIo6LrO2s/m8+ZtN1BZ3PzdckIIIfwn4MlQQkICeXl59d7Ly8sjLCyswVEhALPZTFhYWL2XEFC7oNrUo2ULqqOvvZao664j6pprjnmvYjSi6+DJzW1pV4/K43axY+UyKkuK+fKZ/7S4uKAQQojWC3gyNGrUKJYurX+2ypIlSxg1alSgQ4uTlKlDB4ydm7+g2hATQ9g556BoWm1V6WNUqdfCw3EXFbW4TtrRGE1mUm6fTVhsHMPPv7hZa6CEEEL4V7OTocrKSjZs2MCGDRuA2q3zGzZsqDvUafbs2Vx55ZV19990001kZGRwxx13sGPHDl588UU++ugj/v73v/vnOxDtjqKqmLslYYiPx1uQ3+xRFff+/eTedx9FL7981PtUiwXd6cRT4N9t9gdFJnbkmqdfpcepIwD8VgZECCFE8zQ7GVq3bh3JyckkJycDcPvtt5OcnMx9990HQE5OTr3TLrt168ZXX33FkiVLGDx4ME8++SSvv/46EydO9NO3INqjgwuq1ZBQvMXFzXrW53TiTE2latUqqtevP+q9akgo7twcfA5Ha7rbKO1AIcbs1B28PetmivbL+jghhAi2Zp9A3RbkBGrRGE9RETVbtqCYzM06obr47bcp//JLQs89l+irr270Pl3X8eRkYx0wAGPHjv7ocoPmP3wvezatJ7pTF6Y//CQmS8Pr6YQQItCSkpK47bbbjnoEzsnmuNxNJkRTGaKjMXXv3uwF1RGXXUbcv/511EQIand+KVYbrpxcdI+ntd1t1KSbb8ceGUXS4GQ0gzFgcYQQQhxJqtaLE56pY0f06hpcmZkoCQlNOhdItVqxHShI6HO58FVUNHp2kRYWhrewAG9JCYbYWL/2/SB7RCRXPfEC1pCW1V8TQgjRcjIyJE54rVlQ7czIIPv22yl48slGFzArmgaqhis3N6Bb4A8mQo7KSj5/8hGyU3cELJYQ4uT06quv0qFDB3yH/T674IILuOaaa0hPT+eCCy4gPj6ekJAQhg8fznfffdfieE899RQDBw7EbrfTuXNn/vKXv1BZWVnvnlWrVjF27FhsNhuRkZFMnDiRkpISAHw+H//5z3/o2bMnZrOZLl268PDDD7e4Py0lyZA4KSgmE+aezV9QrYWH4y0rw5maSsWSJY3ep4aF4S0qwldW5o/uHtVPH89l19qf+OLp/6O6PPDxhBDN43Z6m/TyemsTEq/HV/u1u/Zrn9fX5Daaa+rUqRQVFfHDDz/UvVdcXMyiRYuYMWMGlZWVTJ48maVLl7J+/XrOOeccUlJS6m18ag5VVXn22WfZunUr77zzDt9//z133HFH3fUNGzYwfvx4+vfvz+rVq1m5ciUpKSl4DxyLMnv2bP7v//6Pe++9l23btjFv3rwjqlYEgyygFicVT2EhNVu3opgtaCEhTXqm/OuvKX7zTRSbjY7PPIMhMrLhtnNzMHbtiqVXL392+QjO6mrm3n07Jdn76DJwCBf/aw6q6r+SIEKI1nnhpu+bdN/pl/dm4NhOrP0ig1++yuSUMzpyxrQ+pP2az7evbWlSGze/PK7Z/bvwwguJjo7mjTfeAGpHi+bMmcPevXtR1SPHQE455RRuuukmbrnlFqB1C6jnz5/PTTfdRGFh7ZEk06dPJysri5UrVx5xb0VFBbGxsTz//PNcd911zY7lTzIyJE4qhpgYTN2746uoaPKC6tCJEzH17IleXU3xW281ep8SGoYnLx9fdbW/utsgs83G+bfPxmA2k7V5A6s/nhfQeEKIk8uMGTP45JNP6gqez507l8svvxxVVamsrGTWrFn069ePiIgIQkJC2L59e4tHhr777jvGjx9Px44dCQ0N5YorrqCoqIjqA78nD44MNWT79u04nc5GrweTLKAWJ526BdV79qDExx9zQbWiaUTfeCM5d95J9U8/UT12bN3i6kOpNhuenBzcRUWYbbZAdR+AmM5dOfuGv/L1c0/w84IPSezVl+5Dhwc0phCiaW545owm3acaak+WP3VSEslnd0VVa7/uPiSmyW20REpKCrqu89VXXzF8+HB+/PFH/vvf/wIwa9YslixZwhNPPEHPnj2xWq1ccskluFyuZsfJzMzkvPPO489//jMPP/wwUVFRrFy5kmuvvRaXy4XNZmu07BZw1GvBJsmQOOkcXFDtq6nBW5CPFp9wzHIX5m7dCDvvPHxVVZgbmQZTFAXVbseTnY0pIQHFGNgt8P3+MJbs1O1kbdlEeFxCQGMJIZrOaG7etLVmUNEO+dtW1VQCOfNtsViYMmUKc+fOJS0tjT59+jD0wAe8VatWMXPmTC666CKgtqpEZmZmi+L8+uuv+Hw+nnzyybrpt48++qjePYMGDWLp0qXMmTPniOd79eqF1Wpl6dKlbT5NJsmQOCnVLqjugcNRg7e4uNFt84eKvOKKYyZNakgInvx8PMXFGIOwyG/sldfh9XjkEEYhRLPMmDGD8847j61bt/KnP/2p7v1evXqxYMECUlJSUBSFe++994idZ03Vs2dP3G43zz33HCkpKaxatYqXDytzNHv2bAYOHMhf/vIXbrrpJkwmEz/88ANTp04lJiaGO++8kzvuuAOTycSYMWMoKChg69atXHvtta36/ptL1gyJk5YWEoK5Z0/QdbyHbfVsyMFEyFddTdGbb+LcvfvIezQNxWjEnZMblFpimsFYlwht+WEJS988ej01IYQAGDduHFFRUezcuZPp06fXvf/UU08RGRnJ6NGjSUlJYeLEiXWjRs01ePBgnnrqKR577DFOOeUU5s6dy6OPPlrvnt69e7N48WI2btzIiBEjGDVqFJ999hmGA6WI7r33Xv7xj39w33330a9fPy677DLy8/Nb/o23kOwmEyc95969OHfsRIuKQjWbj3l/4SuvULlkCaaePUl8+OEj1hzpbjfekhKsyUMa3Xnmb0X7snhn1i3ouo+zb7qVgWeeHZS4QgjRHsjIkDjpmTp2xNSlM96iInTvsc/tiJg6FcVqxZWWRuXy5UdcV4xGdN2HJy8vEN1tUHSnLoy+dAYGowlNk9ltIYTwJxkZEu2Cz+XCsW073sKCJi2orliyBG9pKeEXXtjgQmlfTQ2+mhpsQ4eihdgD1e16dJ+P0rwcIhMDVzBWCCEOmjt3LjfeeGOD17p27crWrVuD3KPAkWRItBveykpqNm9Gd7mbtKD6WNw5OZh79cSclNT6zjVT0b4sNi39lrFXXIvSwCFqQgjRWhUVFeQ1MgJuNBrp2rVrkHsUODLeLtoNLSQES69e1GzZireyskknVHsKCyl64w1Cx4/HNmxYvWuq3Y47Jwdjhw6oJlOgun0El6OGDx64C0dFObbwCEZeODVosYUQ7UdoaCihoe2jeLR8pBTtSu0J1d2afEJ1xbffUvPLLxS9/jq+mpp619SQEHyVlXiLigLV3QaZLFb+OO0qAEqy9we0eKwQQrQHMjIk2h1Tp07oNTW49mQd84Tq8IsvpmrVKjz5+ZR+9BFRV11Vd01RVRSzBXdODoa4uGOedO1PA8edTUR8Ap0HDDrm+ichhBBHJyNDot1RVBVTt24Y4mLxFhYcdWRFtViIOnAyavlXX+HMyKh3XQsLw1tSgre0NJBdPoKiKHQ5ZTCKouB2Oliz8CO8HndQ+yCEECcLSYZEu6SaTJh79kSx2fCWlBz1XtvQodhGjwafj6JXX623PV8xGNAVBU9ubptMV+m6zsL/m8PKD95lxXuNF5kVQgjROEmGRLulhYRg6dkTfD68VVVHvTfq6qtRbLbae8vL67cTFo67sBBvURE+lyuoSZGiKAw990IAfvvmc3b8tCJosYUQ4mQhyZBo1wyxsbULqsvL8R2larMhMpLEBx8k8dFHjzh1WrVYwOulZvNmqtf+QvWvv+LYvh3X3r248/PxlpXhczgCliT1HDaSEQd2lC1++VmK9u0NSBwhRPuQlJTE008/3aR7FUXh008/DWh/gkEWUIt2r6kLqk0HzhPSdR3H5s1YBw2qu2aIi0f3eNDdbnSnC3dFJXiz0dFRVA3FZEQxmVBDQtBCQlDMZlSzGeXgq5VnBY259E/kpu0ka8smPn/yYWY88hQmq61VbQohRHshyZBo9w4uqPZVV+MpyMeYkNjovbrPR97DD+PYuJG4O+/ENnz47+0YDCgGA1jrV5jXvV50lwvd7caTX4AnO7v2gqqC0YhqNKHabaihoagWS/1EqYk71FRN49xb7+B/d96K2+mkoqiI6E6SDAkhRFPINJkQHFhQ3asXqt2Op7i40fsOJk5Ag2cPNfiMpqFarWhhYRhiYjAkJGJISESLjkG12tB1HU9xCc60NBxbtlDz629UrfuV6l9+oXrjRpwZGbhzcvAUF+OtrEL3eBqMYwuP4KK7HuBP//c00Z06t+wHIYQ4ob366qt06NABn89X7/0LLriAa665hvT0dC644ALi4+MJCQlh+PDhfPfdd36Lv3nzZsaNG4fVaiU6OpobbriBysrKuuvLli1jxIgR2O12IiIiGDNmDHv27AFg48aNnHnmmYSGhhIWFsapp57KunXr/Na3o5GRISEOOLigumbrVrxVVWj2hmuORUydSvVPP2Hs0gXd5TpiJKipFE2rHfmxWOq9r/t8tdNtLhe+snI8hUWg+1AAjAem26zW2ik3qxXl4GiSyURcUve6dtLWrcEWFkaH3v1a1D8hRMPcDkeD72smI6qqoft8eA6sQVQNGprBWO85RVUxHDi13u1ygu/I9YSHPtccU6dO5a9//Ss//PAD48ePB6C4uJhFixbx9ddfU1lZyeTJk3n44Ycxm828++67pKSksHPnTrp06dLseIeqqqpi4sSJjBo1il9++YX8/Hyuu+46brnlFt5++208Hg8XXngh119/Pe+//z4ul4u1a9fWnZU2Y8YMkpOTeemll9A0jQ0bNmBsoDZkIEgyJMQhahdUd8e5MxXFaGywzIZqNpP46KOoYWEBOfCw9jBHM5jN9d7Xdb0uSfJWVOIpKv49STIYUUxGVIsFNSSE9NTtLPrfa4RERjHjoSewx8TK4YxC+MmzV13S4PuX3vcInQcMojQvhzdvqy1wevqMqxl+/sUAvPLnq3BWV9F75BhSbp8NwKf/eYiszRuOaGvkRZfyh8uvbHbfIiMjmTRpEvPmzatLhubPn09MTAxnnnkmqqoyePDguvsfeughFi5cyOeff84tt9zS7HiHmjdvHg6Hg3fffRf7gQ+Tzz//PCkpKTz22GMYjUbKyso477zz6NGjBwD9+v3+YS0rK4t//vOf9O3bF4BevXq1qj/NIdNkQhzG1KkTps6d8BYV1jtT6FBaeDiKoqC73ZR/+22j9/mToiioJhNaSAiGyEiM8fEYExLR4hNq+6MZ8FZV49q3nwTNSER4JFWlJWR89QXVv/6GY8cOXPv2/b7DzemUUh5CnIRmzJjBJ598gvNAyaG5c+dy+eWXo6oqlZWVzJo1i379+hEREUFISAjbt28nKyur1XG3b9/O4MGD6xIhgDFjxuDz+di5cydRUVHMnDmTiRMnkpKSwjPPPENOTk7dvbfffjvXXXcdEyZM4P/+7/9IT09vdZ+aSkaGhDiMoqqYunfHV1Nz1AXVuq6Te//9OFNTweMh7Nxzg9zTWoqi1E6fGY2oB34JGYFzpl1NTXkZiYmd0J1O3BUV6N7a9Ua1O9xMKGYTqt1+YIebBdVs8tsONyFOVre+M7/B9zVT7ZRORHxi3T2q4fdNEDe+9A5Avf+3Lrzj3kanyVoqJSUFXdf56quvGD58OD/++CP//e9/AZg1axZLlizhiSeeoGfPnlitVi655BJcRzlaxJ/eeustbr31VhYtWsSHH37IPffcw5IlSzjttNN44IEHmD59Ol999RXffPMN999/Px988AEXXXRRwPslyZAQDTh4QrXP4cBTXIwhKuqIexRFIWTsWJypqZS8/z7mPn0w9+zZBr1tWFRsPMTGA1BRVkp5VTkdk2qHput2uLlceKpqd7jpHPglfWB6ULWHoIbYW7zDTYiTlfGwdX6HU1S1wXsafM9kPuK91rJYLEyZMoW5c+eSlpZGnz59GDp0KACrVq1i5syZdQlGZWUlmZmZfonbr18/3n77baqqqupGh1atWoWqqvTp06fuvuTkZJKTk5k9ezajRo1i3rx5nHbaaQD07t2b3r178/e//51p06bx1ltvBSUZko9+QjRCCw3F3KMH+LyNnlAdMmEC5r590R0Ocu66i/ynnsJ9yLDv8aA4P5ePX3uGbz56l7LiIuCQHW7h4XU73IyH7nDz+vAUFdXucNu8mZrfft/hVrN5M86M3XU73HxVje9wE0K0jRkzZvDVV1/x5ptvMmPGjLr3e/XqxYIFC9iwYQMbN25k+vTpR+w8a01Mi8XCVVddxZYtW/jhhx/461//yhVXXEF8fDy7d+9m9uzZrF69mj179rB48WJ27dpFv379qKmp4ZZbbmHZsmXs2bOHVatW8csvv9RbUxRIMjIkxFEY4+Lw1dTgTN3V4IJqRVWJmzWL4nffperHH6n+6Se0sDCiDxR3PR6ER8cQHh1D3r4stqz7iTFnpzR6b1N2uHmKS9Dz8gG9dvG2yVT7szlwfMDBkaS60aQg7QYRQvxu3LhxREVFsXPnTqZPn173/lNPPcU111zD6NGjiYmJ4c4776T8sBJDLWWz2fj222/529/+xvDhw7HZbFx88cU89dRTddd37NjBO++8Q1FREYmJidx8883ceOONeDweioqKuPLKK8nLyyMmJoYpU6YwZ84cv/TtWBT9BFhBWV5eTnh4OGVlZYSFhbV1d0Q7o3u9OFNTce3bhyGu8ROqXZmZlH78MdHXX48WEYG3ooLyL78kLCUFLSQkyL2ur7K8lF1bNjJk1B9RFP8NCOu6Xneg5MFkCd8hxwCYTahmc+0xAHb770mS3S5rkoQQxw1JhoRoAp/LhWPrVjzFxRjjE5r0TPH//kf5Z5+h2u1EXH45YZMmBbiXTePzeSnI2U98x9adKXI0uq6Dx1NbuPZAsoTXAygoRiPGzp0wd+smCZEQ4rggv4mEaIKDC6pVmw1PSUmTnrEMGICxSxd8VVX1Tqpuy88fLqeDz//3Gp++8woFOfsDFkdRapMezW6vPQYgLg5jYgeMiYmodjuujN24srJka78Qx7G5c+cSEhLS4GvAgAFt3T2/kpEhIZrBnZ+PY+tWVJu9bhv70eheL1WrVmEbORLVbMadm0v+Y48RMXUqttNOC/rIiK77+ObDd8nctZ3QiEimXncrljYo6OqrrsZXUY6pd2/MnaV0iBDHo4qKCvLy8hq8ZjQa6dq1a5B7FDiSDAnRTM49e3Cm7kKLjm7whOqjKXzlFSqXLAHA1L07kTNmYBk0KKinQztqqpn/xnOUlxTTtVdfJl92lV/XETWVt7ISvboaS7++GBMbL44rhBCBJtNkQjSTqVMnTJ06HvWE6sZEXXklEZddhmKx4MrIIO+hh8ibMwdnEE9atVhtTLz4T2iagT27dvDrymVBi30oLSQExWLBkZqKOy+/TfpwPKoud5G5qZA1n2fgcsiRBUIEgyRDQjSTommYunfHEBODp7CgWc+qVisRU6fS6YUXak+sNhhwbNmCyw9H4TdHbGJHTp98IQCb167E6ag5+gMBooWFgarh3JWKp6ioTfrQllwOD9m7SigvrP35//RJGm/dsZKvXtzEuq8zKdxb0cY9FKJ9aFEy9MILL5CUlITFYmHkyJGsXbv2qPc//fTT9OnTB6vVSufOnfn73/+Oo5Gqv0KcCFSzuXZBtdXa5AXVh9LCw4m6+mo6Pfcc4RddRMjppwPgTE2l8KWX8BQW+rvLR+g3ZDinjZvEJdf+FbPFGvB4jTFERqJ7fTh27mzRz/JE4fX6KNhbwdYf91OaVw3Asrk7WfjkelJ/qV2XERFvAwUiE+30HZWA0SJHwQkRDM3+P+3DDz/k9ttv5+WXX2bkyJE8/fTTTJw4kZ07dxIXF3fE/fPmzeOuu+7izTffZPTo0aSmpjJz5kwURak7iEmIE5EWGoq5Z08cW7fiq6pq0oLqwxliY4k85HTYknnzcGzZQuWKFURddRVh55zjzy4fYeiYsXV/zs/eR3R8ApoW/L+ADdHReAoKcO5MRenfr3bE6ASm6zrlhQ7yM8vJyywnP7OcgqwKPO7ak37/MLUXEfE24pPCyEkr5eCSsZ7D4uh5ahwmqyRBQgRTsxdQjxw5kuHDh/P8888D4PP56Ny5M3/961+56667jrj/lltuYfv27SxdurTuvX/84x+sWbOGlStXNimmLKAWx7PaBdWptaUsmrmg+nCOnTspmTsX57ZtxN93H9ZBg2oPNnQ6UY9RD6k1tvz6Mz9+8xmnDDuNP55zQcDiHI2u63jy89HCQrH0648W0vzksq2t+yaTnLQy8jPLcVS5j7hushqI6xpK/z90oNeweHw+HVUN3uJ5IUTDmvXxw+Vy8euvvzJ79uy691RVZcKECaxevbrBZ0aPHs17773H2rVrGTFiBBkZGXz99ddcccUVreu5EMcJU6dO6NXVuPbtg4hIVGvLp5wsffqQMGcOztRULAcKG1avWUPR668TcfHFhE6YEJDyFiGh4ei6j82//ES/IcOJSejg9xjHoigKhrg4vHm5OFN3YunXr1U/y0DxuLwYTBq6T2fJm1vJ3V3O1LuGYQ01sXtDAfl7atf5qAaF2M6hxCWFEd+19p8RcTaUQ5IfSYSEOD40KxkqLCzE6/USHx9f7/34+Hh27NjR4DPTp0+nsLCQP/zhD7Wf/DwebrrpJv71r381GsfpdOJ0Ouu+9lfdFCECQdE0zL16oZgtuDIz8TkcGCIjW96eotQlQgCV33+Pr7SU4jfeoPzLL4m4/HLsY8b49YyipN79OG3cOUREx7VJInSQoihocfF48nJxpKZi6dsX1ez/qt5N5fP6KMquqjfdVZJbzbVP/hGTxUDhvkoqihzkZZaTNDCGQWd2wuXwEt8tjOiOIWgG2aMixIkg4BPTy5Yt45FHHuHFF19k5MiRpKWl8be//Y2HHnqIe++9t8FnHn300aAVZxPCHxSDAVO3JFS7HWd6Gu68XAwxsY3WMWuOuH/+k4qlSymdPx9PXh6FzzxD2WefEXPDDZh79/ZD72sNHXNm3Z8d1VWomgFTGyQiiqpiiIvHk5+HUzNg6d0LpZXTj01xrHU+hyrcV0mHnhGMntITg0klLql2+r7PaXJekhAnomatGXK5XNhsNubPn8+FF15Y9/5VV11FaWkpn3322RHP/PGPf+S0007j8ccfr3vvvffe44YbbqCyshK1gU+3DY0Mde7cWdYMiROCt7wcZ3o6nsJCtKhov41s+BwOyr/6irLPPkOvqaHD449jSkpC13W/HtqYn7OPRR//j/gOnTn74hlBPRDyULrHgyc/D1PnzrUjbwb/fnZz1XjITivF7fDSa3g8BVkVfPTIL0fcZ7JotVNdSWF1/7RHtN1olRDC/5r128VkMnHqqaeydOnSumTI5/OxdOlSbrnllgafqa6uPiLh0Q58Wm4sDzObzZjbcGhciNbQwsKwDBiAa/duXFl70UND/VK1XrVYatcNnX02NRs3YkpKAqBi0SJqNm4kcvp0TF1aX3zV5/VSXVFB+vbN7Nqygd4Dk1vdZksoBgOG2LjatViqhrlnjxaPtLmdXgr2VpCfWY5mUBk4thOF+yr56oVN2CPM9BoeT1RHOyaroW6XV3xSw+t8hBAnn2Z/1Lr99tu56qqrGDZsGCNGjODpp5+mqqqKq6++GoArr7ySjh078uijjwKQkpLCU089RXJyct002b333ktKSkpdUiTEyUY1mWpHM2w2XBkZeJxOtKgov4yyaKGhhPzhD0Bt7bOyhQvxFhdT8+uvxNx8MyFjx7aq/YROXRlz9nmUFhXQo//AVve3NRSjES0qGlfWHhSjAVNS0jHXSvm8PopzqsjbXTvVlbenguLsKnRf7YeviHgbA8d2IrZLKJGJduK6huJ1+9CMKtc+8QdUTdb5CNHeNDsZuuyyyygoKOC+++4jNzeXIUOGsGjRorpF1VlZWfVGgu655x4UReGee+5h//79xMbGkpKSwsMPP+y/70KI45Ciqpg7d0az2XCmpeE5uI7Ij9M9iqYRf//9lL7/PjXr12MZNAgAX1UVuseDFh7eonYHDh9d92dd13G7XG2yfghqD7gkIhJXRgZoGqYuXeqSSl3X8Xl1NINK2q/5bPphLwV7Gl7nYws31Y74dAtD13WMZo3p94+sH0sSISHaJSnUKkQQ+KqqcGRk4MnJQYuMCsiWcU9JSd0utpK5cyn/5hvCzz+fsJSUFsdzOmr4/vOPcTpqOP9P16GqbTea66uqorq4EnPPHoT16sr6xVn8tngPg87sxPBzu7FtVTY//K92V6vJohHbNezAdFftWp+QSJl6F0I0TI45FSIIVLsda9++OK1W3FlZ6C5Xi0dtGnMwEdJ1HcfOnegOB6UffUT5okV1a42ae0ZRdWUl+3bvwu1yseaHxYwaP8mvfT4aj1unqNBNQV7tqzDPQ0U5DBuSztAQE6pBwVHprjvXp3O/KMbP7Ee8rPMRQjSTjAwJEUS6ruPJy8OZlo7P5aydNvPjeUF1cXw+qn/+mZL338eTkwOAFhtL3B13YO7WrVltpW3bxOJP5gJwztQr6d53gN/7C1BS5KlLfAry3JQUeWjot1O/vhrDk8HbsSdOLZSYTiFoRpneEkK0nIwMCRFEiqJgTEhAtVhwpKX/vo7Iz6dKK6qKffRobCNGUPnDD5R+/DG604kxIQEAn9OJYjI1aUF3z/6DyNu3h41rVvL95x8SHXcr4VExre5jZpqD/Dw3A5PtWG0qP35fRmGep949VptKbLyR2HgjMfEGYuKMmM1q7ZRg7m5C+vWTREgI0WoyMiREG/E5HLXb7/ftQw0LR2tBodcmx3I6ce/bh7lHDwAKX3gBd3Y2kTNmYOnf/5jPe71ePvvfq+TuzSS+UxemzPxLs3bGeTw6+/Y42ZvpZPTYMDRNYcG8QkqLvUw4N4Iu3cys+6mCgjw3MQeSn9h4Iza72mgcT1ERismItV8/tIiIJvdFCCEOJ8mQEG1I93px7duHa/duUDW0yMiAH3Lorahg35//jO5wABD3r39hGzr0mM9VVZSzZOH7nH7OBUTFJRzzfrfLx949LvakO9i7x4XHXfur5qyUCDp3NbNhXSXVVT5697MSE9eykTF3fj6a3Yalf3+00NAWtSGEEJIMCXEc8BQU4EhLQ6+qQouN80sZj6PGKy6mbP58HDt20OHxx1E0Dff+/WAwYDys9mBjXE4HJrOl/nsuH3t3O8lMd7JvjxOv9/dr9lCVpB4W+g6wEh7pnxn62kr3eWjhEVj79UUN4OiaEOLkJcmQEMcJb2VlbRmPvDy06JigFCjV3e669Uq5Dz6IY9s2QidMIOKSS4469bRz02+s/PZzUmZcR1yHTui6zg+Lysja7cR3yBE/oeEaST3MdOthITrOEJBRL93nw5ufhxYdXVvY9TisdC+EOL7JAmohjhNaSAjWfv1w2my49+xBt9nRApz8H0yEfA4HqCp4PFQsWkTlsmWEnXsu4eeff8Roi67rZOzYgtNRw6fvvsPU6/5OZIwNr1fH54PwCI2knhaSepiJiglMAlTve1BVtNg4PPl5x0WleyHEiUdGhoQ4zui6jicnB0d6Oni8aNHRAdl+35CaLVsomTsX165dAKghIXR4/HEMsbFUV3nZk+GkW08LiuLk3WefR9eSGT1+FKcMsVNU4EZVFSKitDYp7qp7vXjy8zAmdghapXshxMlBkiEhjlOekhKcaWl4S0oxxPp/+31jdF2neu1aSt9/H2dEIjUX3kJmhpO8bDcAfxgXRu/+VtJTq6gsh269zISEqkcUZG4LutuNpyA/YJXuhRAnJ0mGhDiO+WpqcKZn4M7JRguPQLXZAh6zotxLZrqDzDQHBYed+xNes59TTjHQ+5yBdaM/JYUFfPvJe4yeMJkuPfoEvH/H4nO58BYWYkrqirlHyyvdCyHaD/nYJMRxTLVasfTtg2qz4crMxOd01pXd8LcdW6rZubWGooL6CVB8opHOMQ4s7z2GqWQ/rAH3Kf/F1LkzAFt+XU1xfi7fLfyAqdffSmh4YPrXVKrJBNHRuPbsQTE0rdK9EKJ9k2RIiOOcYjBg6paEarfjTE/DffDU6laOeJSWeMhMc9C5m5noGCNFBR6KCjwoCiR0MJLU00LX7mZs9to4vmGPUPbFF3hLS+sSoerffmNo977k7s0kIioWizXwI1dNcbRK90IIcThJhoQ4ASiKgjE+DtVmxZmWdmD7fXSzdk3puk5xkQerRcUWorF+bSW7dzlxuXSiY4z0GWAlJs5Al+4WrNYjR1JUu53Iyy+v+9rndFL00kt4S0oYPeo0YiefgdF0/OziUq1W8PlwpaejaAZMnTq2dZeEEMcpSYaEOIFooaFYBgyoLeORtRc9JOSoJy/ruk5Rvqd2DVC6k/IyL0NH2hkyPITuvSx4XDpxCbULs2PijM06CVp3OrEMHEjVjz/iXv0z2WvWYh13Jltjw+jYqx99Bh37VOtAU+12dJ8P565UFINWV5tNCCEOJQuohTgB6T4frv37a8t4+PTa7fcHpoF0Xacg101mupPMdAeVFb+fgqhp0H+QjeFj/Fe6wpWZScm8edT89ht7osPY2ikWg8HIxdfcTHR8ot/itIa3rAzd68Harx+G2Ni27o4Q4jgjyZAQJzBPcXHt9vvyckr1SNJ3uchMd1Jd9XsCZDBApyQzST0sdO5qwmgKzGJix7ZtFM99j58jLOQ6qgiPiiHl9ImE9O5zXByC6CkpQVEULP37YYiKauvuCCGOI5IMCXGC8nl97N9ViknxEOrK49fvc9m0vXaxs9Go0LmbmaQeZjp1MWMwBmfxsK7r1JSXMf/tF6ksLyOhooZhpQ4ip04l5Mwz2/zcH09hIYrZJJXuhRD1yH5TIU4gXo8PR1Xt4YdrvtjN509vYNOqAqx9+9JrdGd6JMG4sUamXRvL2LPDSephCVoiBLULvW3hEUy85ApUVSU31Eqa5qVk3jx0pzNo/WiMISYGn8OBIzUVb0VFW3dHCHGckGRIiOOcx+1l96ZClr69jbfuWMmazzMA6DYoBovdiDXUhGI0Ej+sD+Nn9qdzJxW9OB/90IqpQRbfsTN/mHg+9pBQup45gcgZM+pqnJV9+inOtLQ265shJhZvRQWOnan4qqrarB9CiOOHTJMJcRxyu7xkbS0i/bcCMjcX4nZ4665Fdwrh8ntGoPt0dF1H1ep/pvGWleHYlYa3pKR2+30b1ejSdR2X04HZ8nsVedf+/WT//e8AhJ13HhGXXdYm64nqVbrv1w/VYgl6H4QQxw9JhoQ4TrgcHvZsKSL9t3z2bCnC4/p9ZMceYaZHciw9hsaS0CMCVT361JfP6cSVkYFr337UsDC0wyrPB9ueXTvYtn4t4yecR9m771K1ciUAhoQEom+6CesppwS9TwcLuxri42sr3UthVyHaLUmGhGhDzhoPNeUuIuJtbP1xP8vm7qy7FhplocfQWHoMjSM+KQzlGAnQ4XSvF9e+fbh2Z4KioEVFtckpzE5HDf979v9wOR0MGXU6oyecS/W6dRS9+ire4mIAwi++mMhp04Let3qV7vv0DloxXCHE8UUOXRQiyHSfjqIqpP+Wz+I3t5LYI4IL/55M9yGxbPhuL92H1I4AxXYJbVXyomga5q5d0ez22u33eblosXFBL1xqtlg5M2Uqiz+Zi8VaO0JlGzYMS79+FL/3HpVLlmDq1i2ofTpI0TQMMbG4s/ejaKpUuheinZKRISGCoLrcxe6NBaSvL8Bk0TjnhoGUF9bwv3tWE9XBzqX/Go5mCNx+Bm9lFc70A2U8oqLbZI1MWXER4VHRABQX5BEZE4uiqLj27MHUtSsAjh07qPj2W6JmzkQLDw9a3+oq3XdLqq10L4VdhWhX5COQEAFSVeYkY30B6evzyU4t5eDHDs2o4nZ5CYuxMuPB04iIC3xxUy3EjrVfP5w2G+49e9BtdrQgf7A4mAjVVFex4K0XCI+KYcxZ59Gha3egdlFz0Suv4N67l5qNG4m5+WZsp54alL7VVbrP3FNbx6xbkhR2FaIdkWRICD+qKHbUJUA56WVwyLhrbJfQ2jVAyXEYTbVTVcFIhA5STCbMPXui2e040tPxFBTUlvEI8ihIYe5+dB0KcvZTXJBXlwwpqkrMzTdT+OKLuPfuRT1KzbVAqK10H4ErIx0MGqbOnSUhEqKdkGkyIVpJ13UURSF7VwkLn1xf71p8tzB6DI2jR3IsYTHWRloIPk9JCc70DLwlxRhiYoO+cLimqpLN61Zz6h/GoWkahXk5bPx5BSPGnk2ILQTH1q1YhwwBoOrnn/FVVBAyYUJQkhNfVRW+6iosvXtj7CiV7oVoD2RkSIgWctZ4WP/tHvKzKkj562Dik8Ix2wxEdbDXJUAhkcfn+TWGyEjUAf1rt99nZ6OFR6DagjdKZbWHMOKMs+q+/vn7b8hK20na1k0MHDGaoWPOBMBbUUHRq6/iKy+natUqom+8EWNiYIu/Hqx079i1CzSpdC9EeyAjQ0I0k9frQ9NUqsqcvHfPajxuHxf+PZmOfSJxOTyYLCfOZwzd48G1dy+uzEwwGDFERrZJP/Ky97L6u6/J3lN7urbZYmXoH87klKEjqV7yHaXvv4/udKKYTERcfjlh554b8F1xtZXuvVj79ZVK90Kc5CQZEqKJ3E4vm5ftY8PSvUyZNZSIOBubfthHSKSZboNjTuj1Je68fJwZ6fiqqjC0wfZ7qJ1uzErbyeql31BckAvA5MuuIql3f9x5eRS9/DKOzZsBMPfpQ8KDDwa8n57iYhRVxTKgf5slikKIwJNkSIhj8Li9bF2Rza+LMqmpqC2SOuSsLoy5uGcb98y/vBUVONPS8BQU1pbxaIMyGQA+n4+dm34lKz2Vs6dMR1EUcvZm4nI6iczcS8m77xI2aVLQDmmsq3Tfv39Qt/sLIYJHkiEhGuH1+Nj+Uw7rvs6kqrS24npYjIXh53Wj9/D4I2qCnQx8Lheu3btxZe1FDQlBC/KOrobouo+PX3+OwtxsOnfvxcSJF2IMD0cxGvGUlFDw5JNEXXkl5t69A9YHd34eWkgIlv790UJCAhZHCNE2TpzFDUIEic/rY+eaXH75KpOKIgcAIZFmhk1Oou/oRLSTMAk6SDWZak9htttxZWTgKawdJWrLKUCvx0vHpB4UF+RhDwvHFBMDgMfjpvT993Hu2EHO3XcTfsklRF52WUD6YIiNw5OXi2PHTqz9+wV1sbkQIvAkGRLiEAVZFXz7+hbK8msAsIWZOHVSV/r/oQMGY/DX0bQFRVUxd+qEZrPVTpvl5dZuv2+jMhUGo5ExZ53HwOGjMRhqjwBwOR28/9KTdO/Zl25/GINn5SoMUVEB64OiKBji4msTop07pdK9ECcZSYZEu6frOvl7KohPCiMk0kx1mQtLiJGhZ3fllLEd6w5IbG8MUVGop5xSe0Bjbi5aRCSqte3OSgqL+D3ZSdu2iaqKcjavX0voWefS95xJmPv0AcCVlUX5N98Q+ac/odntfouvqGptQpSfh2PXLix9+kileyFOErJmSLRrbpeXhU/8RsHeCqbdN5KoRDv7d5YQ2zX0hNoiH0i6x4MrKwtXZiaKyYwWEdHWXQIgKz2VLb/8xNmXzMBgMFJaVEj2ngwi5i/ElboLLSqK6OuvxzZ8uF/j1la6z8fUIRFzb6l0L8TJQH7bi3ZH13X27SghPikMk9VAaJSF0rxqirOriEq007GPbKE+lGIwYOrWDdVmw5mWjjsvD0NsbJsXM+3Sozddevy+aPrn778hY8cWIuLC6e3sSPSe/eQ/9hi20aOJvvZav+0Eq610H4Nr/34wGGoLu0qleyFOaDIyJNqV7F2lrPk8g+xdpYxI6cbwc7tRUezAYFKxhsiUx7F4y8pq1xEVF6NFxxw300S6rrNxzY/8+uP3OB21671iLXZ6bdlFRFUNamgoiY89hjEuzm8xfS4X3qJCTElS6V6IE12L/u994YUXSEpKwmKxMHLkSNauXXvU+0tLS7n55ptJTEzEbDbTu3dvvv766xZ1WIiWyMss54tnN7Dwyd/I3lWKalDweWs/B4RGWSQRaiItPBzLKadg6tQJb1ER3qqqtu4SULvAechppzPjljtIHnUGmmagwFHFTz07UNYjCXPPnnWnSPvr859qMqFF1Va6d2Xu8Vu7Qojga/bI0IcffsiVV17Jyy+/zMiRI3n66af5+OOP2blzJ3ENfOpyuVyMGTOGuLg4/vWvf9GxY0f27NlDREQEgwcPblJMGRkSLVW4r4I1n+8mc1MhAKqq0G9MIqdOSiI0SnYDtZTu9eLavx9Xxm5QFLSoqOPqBO6KslJ+Wb6YovxcLr7qJnSHkwqXA6NmoPyJJ7H/8Y+EnnWWX0ZzfDU1+MpKMfXuLZXuhThBNTsZGjlyJMOHD+f5558Hak+L7dy5M3/961+56667jrj/5Zdf5vHHH2fHjh0YW7jQUJIh0VzFOVWs/WI36b/lA6Ao0Oe0BIZN7kZ47PFTPf5E5yksxJmWjq+yAq2NyngcjdfjQTMY0HWdhW+/RGH2PrrtL6BnfgnWAQOIv+cevyyA9lZVoVdVYunTRyrdC3ECatbHIpfLxa+//sqECRN+b0BVmTBhAqtXr27wmc8//5xRo0Zx8803Ex8fzymnnMIjjzyC1+ttNI7T6aS8vLzeS4imqixx8uFDa2sTIQV6DYtj2v0jGX9Vf0mE/MwQE4PllFPQYmPx5OXiczjaukv1aAcWNjtrqvF6vXh8Xlz9+6CazRg6dPDbTjDNbkex2nDsSsOdl+eXNoUQwdOsLRCFhYV4vV7i4+PrvR8fH8+OHTsafCYjI4Pvv/+eGTNm8PXXX5OWlsZf/vIX3G43999/f4PPPProo8yZM6c5XRPtXEWxg/Xf7mHE+d0JiTTTY2gsXo/OiJRuRHeU8gmBpIXYsfbrh9Nmw52Vhe60Hnc1vCw2O5dcezNp2zYT16ETtqlX4DOb+ex/rzJg4KmEfLOYqGnTMCUltTiGFhr6/+3deXRU9f3/8ecsyUz2kJXsCSAkBAmyBWQRFLVqaXO+3xbq1xYUe3qOBb8qtSpqXbCn0J/H/tCDosd6Su33Z9HqD62lIotlB4HQtBAh7IYl+76Qyczc+/1jNBpXAiQzYV6Pc+ac5DL3znvugeE178/n3g9er5eOssNdV5yJSP/Qo2Gys2fPkpaWxo4dO5g4cWLX9gceeIDNmzfz4YcffmmfoUOH0tHRwYkTJ7B90kL/3e9+x9NPP01FRcVXvo7L5cLlcnX93tzcTEZGhobJ5Gv9Zckeqj9uYcx3sphQNBiv17isl80IRKZp4qmooOPYMUy3B3tCQkBfYfXPnZvZucF3IceIU9VkNrUTU1RE7A9+cFEdI099PRabFedwrXQv0l/06JMqISEBm81G1RfawFVVVQwcOPAr90lJSWHo0KFdQQggLy+PyspKOjs7v3Ifh8NBdHR0t4fI551r6WT7m0c4WuybEzTmpmzShg0ge6Tv27iCUN+zWCyEpKYSNmIEtuhoPFWVmG63v8v6WvmjCxkz+VqiomMZMjgXvF6q3nmbsgcfoKOs7IKPa4+Lw+x003HoEN6mpktYsYj0lh4Nk4WGhjJmzBg2btxIUVER4JtAvXHjRhYsWPCV+0yaNInXXnsNwzCwfvIt8fDhw6SkpBAaIPcokf6jo81Nyfpy/vWP03hcXmKT6xg0KoGcggQGjUr0d3kC2AcMwDoin85jx+g8cxZbTAzWS7gsxqUS6nBSOP1Gxk6dgc1mo23XLjasXsXZiBDSVyxjwn/+iMQp11zQse2Jibirq3zrmGmle5GA1+OvzwsXLuTll1/mj3/8IwcPHuSuu+6ira2NO+64A4A5c+awaNGiruffdddd1NfXc88993D48GHWrFnDb37zG+bPn3/p3oVc9jrPediz5gR/enQnxWs/xuPykpgZxeRZV2CxWnQ5c4CxOp04cnNxDL0Co70NT0ODv0v6Wp92rcPGjyekYCSmxcKp+GhWb1/P7k3rcLW3X9Bx7YlJGC0tdBwqw7jAY4hI37igO1AvX76cp59+msrKSkaNGsVzzz1HYWEhANOmTSM7O5uVK1d2PX/nzp3cd999lJSUkJaWxp133smDDz7Ybejsm+jS+uDldnnZv+k0+9Z9jKvNA0B8WgTjZw4ipyBBIagfcFdX4zp2DKOtDXsAXn7/RRXlJ9ix7l2qKs4A4LBYmRadTPa8n/a4w2MaBp7qKt9Vd7m5WuleJEBpOQ4JSIbXYP+mMxSvPcm5Ft+8k9jkcMbPzGHI6CQsVoWg/sTb0oLr2DE81TXY4uOxOhz+LukbmabJ8UMH2LnuXbzVNUwpO0VIbCwDHn2EiKzsHoVw38KuVdgHDtRK9yIBSmFIAorXY2CxgMVq4c2le6n+uIXoBCfjvpvD0HHJWDUxut8yOjvpPHES96lyCAnFGhkZ8KHI6/VS/89iXK/+D7bISPYMz6HT5WLijJtJyxp03scxPR7fSvdpqVrpXiQAKQxJwDiyt4qdq48x7pZs8q5O5UxZA43V7eRenaKrwy4TpmHgqarCXVmJt7kZs9ONxeHAGhER0MHI6Oyk6cxp/vL6H/C4O0mxhnD9pBlEXHPNeXeJTLcbT001oVlZOIYMCfjhQpFgojAkfmUaJh3tbsIiQ/nnunJ2/P+jJOdE84MHx/q7NOlFpmlitLXhbWzCU1ONt6kZ0x34wai9tYUdr/+J5A+2EuVyE1JQwImCPEZNm0FkdOy37m+4XHjr6wjNycExaFBA34dJJJgoDIlfmKbJiZJaPnz3OJGxDmb+9yjcnV4+2nqW4VNSCQnVt+ZgYZomRmsr3qZmPNVVeJtbfMHI6fQFowCbY2N6PDT99a80/uUvnIgJ52BaAjaLle/MnkPWFXnfur/R0YG3oQHHkMGEZvds/pGI9I4e3WdI5GKZpsnHB+rY/e4JaspbAGhrdNHW6CIi1kHBdRl+rlD6msViwRYVhS0qipC01E+CUROe6mq8zc14AywYWex2Yv/jPwgvLKTtxeepbG2l1RmKY9tOuCIPV8c57PaQrnXRvsjqdEJMDJ3Hj4PdTmh6ugKRiJ+pMyR95vShej7863Eqj/sW3g1x2Ci4LoNRMzJwhGtCqXRnGoYvGDU3466swmj9tGMUhi0yMiAmIZuGQfPatVS8s5rBTz5FyMCBbPrbW5w6cYTCaTdyxYgCLJavHgrzrXTfhjN3GCGpqX1cuYh8nsKQ9LqzRxvZ/dfjnDncCIA9xMqV09K56sZMwiL9/01fAt+nwcjT2IinugajpRnT4wmYYGS4XFgdDjxuN//zzFO0u31rKyYOTGPijJtJzxnylfv5JpF34szLIyQ5qS9LFpHPURiSXrXxjx9xaGclAFa7hRFT0hj9nSwiYgJzgqwEPtMwMFpa8DQ1dQtG1rBwrBERfg1GptvNyQXzOWYzOJ40AM8nV0FmDB7Kdd+bRXhk1Jf28TY2YpoGYXl5WulexE80Z0guudrTrQAkpEeSmBnN4Q+ryJ2UwtibsomK0x145eJYrFZsMTHYYmIITU/3BaPGRjw1tXgbG/wajCwhIWT+9v8Q8fvfk1V2iIrvfYeP/r2PxtoaHM4wwDdv7vNzhGyxsXjq6nzrmNlsWulexA/UGZJLqnTrGTb9vzJSr4ilaOFVGB6T1kYXMYlh/i5NLnOm1/u5jlE1RksrpteDNTwCa3h4nwcjT0MD9gEDaKqvo+KNVSSGOBnwX//FhvdWExkdw+hJ03GGhX/2/JoarGFO38Ku+pwT6VPqDMlFa6ppp/JYE8MmpJCZH48txEp4TChet4E91KYgJH3CYrNhi43FFhv7hY5RDd6GBkzD+1nH6Guu9LqUPu3whHe6cX6wmRbDoKJkH0eTfOubNdXXcdOsOV3PtyUk4Kmu9nWI8oZji4zo9RpFxEedIblgLfUd7P37SQ7uqMBigdsWTyA6Poz25k7CozUxWgKD6fX6LtH/tGPU2oppGH0ajM7961/UvfQS7upqaqLCOXJFJtfNnsvAwVdgGF5OHColJ3cEFosFb1UltgEDcOblYQ0P//aDi8hFUxiSHmtrclH83seUbjuD4fH99cnMj2PKrKHEJuvDWwJXVzBqaMRTW4PR2gqGgSUsHGtkZK8ukWGcO0fDn/9My3vvYZomjiFDSFmyhIMle9j0t7eIT0phRtFs4hKT8VRVYk9MwpmXG7B34xa5nGiYTM7buZZO9r3/Mfs3n8HrNgBIGzaAwu8NImVwjJ+rE/l2lk8mKNsHDCA0MwNvS4svGNVU462tAdPEEh7h6xhd4mBkDQsjft48Iq6+mroVK4j94Q99E6lNk1CHg+bGOsIio3wTxBOT8NRU02G3ETZsmN9vHSByuVMYkm/V0eamZH05//rHaTwuLwADB8VQ+L0c0nPj/FydyIWx2O1fEYwa8FTX4K2r9XWMeiEYOXNzSf3d77qOmWMPI/TQKbzfvZmwcN88oV2b3qe1qZGxV44hNDUVe5z+nYn0JoUh+VbF752kZMMpABIzoyj8/iAyh8dpCQG5bHQPRpm+obTGRt+SIJ92jCIifVelXYJg9PljtKxbh725Bftrr9PQ1Er4j2azf88OvB4P8ZHRJE+bftGvJyLfTHOG5Evamlzs/8dpDK/J1f85hLYmF++9uJ/RN2aRU5CgECRBw3S7P+sY1dRgtLVhmibWSxiMTK+X5nffpfHNNxm4eDGOQYOorjjNv3dtZfLYyUQVjldnSKSXqTMkABheg4bKduLTIjnX4qZ47cdYrBbyp6YSkxjODx4c6+8SRfqcJSQEe1wc9ri4ro6R55Ng5K2pxoSLDkYWm42YoiIir78eW4RvmCzs0BHyi0sxs3Mv4bsRka+jMBTkWhs6+GjbWT7aXoG7w8Ptv51MQnokI69NJ2VwrO4YLfIJS0gI9vh47PHxmJmZeFtaugcji+WzGzxeQDD6NAiZHg+Nr7+Ot7aW9n37iL7l5kv9VkTkCzRMFoRMw6T8YD2lW85w8t+1fPo3wBkZwnfnF5Cco3Mscr7Mzs7POka1tZhtbb5g9GnHyPrVq9Z/E09NDU3vvEP0DTcQPqFQw2QivUxhKIi0N3dycMdZSreepaWuo2t76hWx5E9NZfCoJGwhPf/gFhGfrmBUX4+nru6TYGTFGhFxQcHIU1FB2JjRCkMivUzDZEHANE02rjzIkT1VGIYv+zrC7QybMJD8KWnEpei2/yKXgiU0FHtCAvaEBIzOToymJjz1DXjq6/BUVYHVijUyEmtY2AV1jESkdygMXabOtXZyaGclg0cnEh0fhomJYZgk50QzYmoaQ8YkYQ/tvbvtigQ7a2go1sRE7ImJ3YNRXa2CkUiAURi6jJimiWmYWG1WNvzhIOWldbja3EwoGszYm7K56vpMEtKj/F2mSNDpFoxcWXibmvDW1/uG0z4JRrbISCzh4bp1hYgfKAxdBlztbso+rKR061mGT06l4NoMhk9Kob3ZRXyab4XsAQM1FCYSCKwOB9akJEKSkjBcrs+CUV0d3spKsNmwRURg0SKtIn1GYaifMk2T6pMtHNh6hqN7qvB8slZY2a5KCq7NYNBViQy6KlHfMkUCWLdg1NGBt6kZb30dnvp6vJUV6F+vSN9QGOpnOjs8HN5dRenWM9Seau3aHpcaQf6UNIYVJgMoBIn0M1anE6vTSUjy54JRc5NWrRfpAwpD/URz7Tn2rSvn8IeVuD9ZLNVmtzJ4TCIjpqQxcHCMApDIZeLzwUhEep/CUABzd3qpO9PKwJwYXO0eSrecASA2OZz8KankTkjBGRni5ypFRET6N4WhANVQ2cabvy3GYoHbl04iMTOK0d/JIiMvjrShseoCiYiIXCK6uUWA8LoNDu+u5P3fH8A0TGKTwnGE2wkNs9NUcw6AiUWDSR82QEFIRETkElJnyM8aq9op3XaWQzsr6Gh1A5A7MYWs/HiK7ruKqDgnFqvCj4iISG9RGPIDr9fgREktpVvPcPpQQ9f2yAEOhk9OJSHdd2+g6IQwf5UoIiISNBSG+lBz7Tk+2naWgzsqaG/u9G20QFZ+PPlT08jKj8Nq08iliIhIX1IY6mWG18A0wBZi5YM/HeJMma8TFBYdyvCrUxg+OVUdIBERET9SGOpFpVvPsPfvJxl9YxZXTktnxNQ0LBbIn5JGzqgEbOoCiYiI+J3C0CVkGianDtYT4rSTMjgGj9ugtcHF0eJqrpyWzpAxSQwZo5uoiYiIBBKFoUugvbmTgzvO8tG2szTXdpCeO4Dv33sVwwoHEhYZwqCrEv1dooiIiHwNhaELZJomZw43UrrlDMdLajC8JgCOcDtxqRGYhokzIoSh4wf6uVIRERH5Jhc0aeX5558nOzsbp9NJYWEhu3fvPq/9Vq1ahcVioaio6EJeNiB0tLop2VDOa098yDv/958cLa7G8Jok50Rz7Zw85i6dxJRZQ3VvIBERkX6ix52h119/nYULF/Liiy9SWFjIsmXLuPHGGykrKyMp6evnw5w8eZL777+fKVOmXFTB/lRzqoW3fluM12MAEOKwMbRwIPlTUknMiPJzdSIiInIhLKZpmj3ZobCwkHHjxrF8+XIADMMgIyODu+++m4ceeugr9/F6vUydOpV58+axdetWGhsbefvtt8/7NZubm4mJiaGpqYno6OielHtR3J1eDu2ooLy0jpvvGokJ/OnRHTgjQhgxNY0rxiUT6tRIo4iISH/Wo//JOzs7KS4uZtGiRV3brFYrM2bMYOfOnV+73+LFi0lKSuLOO+9k69at3/o6LpcLl8vV9Xtzc3NPyrwopmlSX9FGfGokmLDr7WN0dng5faiBjOFx/PChcYRFhWh9MBERkctEj8JQbW0tXq+X5OTkbtuTk5M5dOjQV+6zbds2XnnlFUpKSs77dZYsWcKTTz7Zk9IuWmeHhyN7qijdepaa8hZmPzqehPRIxtycjT3ESlK2bxgsPDq0T+sSERGR3tWrYzwtLS385Cc/4eWXXyYhIeG891u0aBELFy7s+r25uZmMjIzeKJHa0y2UbjlL2e5K3B1eAGx2KzXlLSSkRzL6hqxeeV0REREJDD0KQwkJCdhsNqqqqrptr6qqYuDAL19CfuzYMU6ePMnMmTO7thmGb/Kx3W6nrKyMwYMHf2k/h8OBw+HoSWk94u70cnRvNaVbz1B14rMhuJikMEZMTSN3QgrOyJBee30REREJHD0KQ6GhoYwZM4aNGzd2XR5vGAYbN25kwYIFX3p+bm4u+/fv77bt0UcfpaWlhWeffbbXuj3f5J/ryileexJXuwcAq9XCoKsSyZ+SStqwAZoLJCIiEmR6PEy2cOFC5s6dy9ixYxk/fjzLli2jra2NO+64A4A5c+aQlpbGkiVLcDqdjBgxotv+sbGxAF/a3lcsVnC1e4iKd5I/JZXciSlExPReF0pEREQCW4/D0OzZs6mpqeGxxx6jsrKSUaNGsXbt2q5J1eXl5VitgbsAae7EFAakRJCZF6cbI4qIiEjP7zPkD/66z5CIiIhc/gK3hSMiIiLSBxSGREREJKgpDImIiEhQUxgSERGRoKYwJCIiIkFNYUhERESCmsKQiIiIBDWFIREREQlqCkMiIiIS1BSGREREJKgpDImIiEhQUxgSERGRoKYwJCIiIkFNYUhERESCmsKQiIiIBDWFIREREQlqdn8XcD5M0wSgubnZz5WIiEgwiIqKwmKx+LsM6SP9Igy1tLQAkJGR4edKREQkGDQ1NREdHe3vMqSPWMxP2y4BzDAMzp49e0mSenNzMxkZGZw6dUp/0b+BztP507k6fzpX50/n6vz1xrlSZyi49IvOkNVqJT09/ZIeMzo6Wh8w50Hn6fzpXJ0/navzp3N1/nSu5EJpArWIiIgENYUhERERCWpBF4YcDgePP/44DofD36UENJ2n86dzdf50rs6fztX507mSi9UvJlCLiIiI9Jag6wyJiIiIfJ7CkIiIiAQ1hSEREREJakEVhp5//nmys7NxOp0UFhaye/duf5cUkLZs2cLMmTNJTU3FYrHw9ttv+7ukgLRkyRLGjRtHVFQUSUlJFBUVUVZW5u+yAtKKFSsYOXJk131gJk6cyHvvvefvsvqFpUuXYrFYuPfee/1dSsB54oknsFgs3R65ubn+Lkv6oaAJQ6+//joLFy7k8ccfZ9++fRQUFHDjjTdSXV3t79ICTltbGwUFBTz//PP+LiWgbd68mfnz57Nr1y7Wr1+P2+3mhhtuoK2tzd+lBZz09HSWLl1KcXExe/fu5dprr+X73/8+paWl/i4toO3Zs4eXXnqJkSNH+ruUgJWfn09FRUXXY9u2bf4uSfqhoLmarLCwkHHjxrF8+XLAt8RHRkYGd999Nw899JCfqwtcFouF1atXU1RU5O9SAl5NTQ1JSUls3ryZqVOn+rucgBcXF8fTTz/NnXfe6e9SAlJrayujR4/mhRde4Ne//jWjRo1i2bJl/i4roDzxxBO8/fbblJSU+LsU6eeCojPU2dlJcXExM2bM6NpmtVqZMWMGO3fu9GNlcjlpamoCfP/Jy9fzer2sWrWKtrY2Jk6c6O9yAtb8+fO55ZZbun1uyZcdOXKE1NRUBg0axG233UZ5ebm/S5J+qF+sTXaxamtr8Xq9JCcnd9uenJzMoUOH/FSVXE4Mw+Dee+9l0qRJjBgxwt/lBKT9+/czceJEOjo6iIyMZPXq1QwfPtzfZQWkVatWsW/fPvbs2ePvUgJaYWEhK1euZNiwYVRUVPDkk08yZcoUDhw4QFRUlL/Lk34kKMKQSG+bP38+Bw4c0HyFbzBs2DBKSkpoamrizTffZO7cuWzevFmB6AtOnTrFPffcw/r163E6nf4uJ6DddNNNXT+PHDmSwsJCsrKyeOONNzT8Kj0SFGEoISEBm81GVVVVt+1VVVUMHDjQT1XJ5WLBggX87W9/Y8uWLaSnp/u7nIAVGhrKkCFDABgzZgx79uzh2Wef5aWXXvJzZYGluLiY6upqRo8e3bXN6/WyZcsWli9fjsvlwmaz+bHCwBUbG8vQoUM5evSov0uRfiYo5gyFhoYyZswYNm7c2LXNMAw2btyoOQtywUzTZMGCBaxevZoPPviAnJwcf5fUrxiGgcvl8ncZAee6665j//79lJSUdD3Gjh3LbbfdRklJiYLQN2htbeXYsWOkpKT4uxTpZ4KiMwSwcOFC5s6dy9ixYxk/fjzLli2jra2NO+64w9+lBZzW1tZu36xOnDhBSUkJcXFxZGZm+rGywDJ//nxee+013nnnHaKioqisrAQgJiaGsLAwP1cXWBYtWsRNN91EZmYmLS0tvPbaa2zatIn333/f36UFnKioqC/NO4uIiCA+Pl7z0b7g/vvvZ+bMmWRlZXH27Fkef/xxbDYbt956q79Lk34maMLQ7Nmzqamp4bHHHqOyspJRo0axdu3aL02qFti7dy/Tp0/v+n3hwoUAzJ07l5UrV/qpqsCzYsUKAKZNm9Zt+x/+8Aduv/32vi8ogFVXVzNnzhwqKiqIiYlh5MiRvP/++1x//fX+Lk36sdOnT3PrrbdSV1dHYmIikydPZteuXSQmJvq7NOlnguY+QyIiIiJfJSjmDImIiIh8HYUhERERCWoKQyIiIhLUFIZEREQkqCkMiYiISFBTGBIREZGgpjAkIiIiQU1hSERERIKawpCIdNm0aRMWi4XGxkZ/lyIi0mcUhkRERCSoKQyJiIhIUFMYEgkghmGwZMkScnJyCAsLo6CggDfffBP4bAhrzZo1jBw5EqfTyYQJEzhw4EC3Y7z11lvk5+fjcDjIzs7mmWee6fbnLpeLBx98kIyMDBwOB0OGDOGVV17p9pzi4mLGjh1LeHg4V199NWVlZb37xkVE/EhhSCSALFmyhFdffZUXX3yR0tJS7rvvPn784x+zefPmruf88pe/5JlnnmHPnj0kJiYyc+ZM3G434Asxs2bN4kc/+hH79+/niSee4Fe/+hUrV67s2n/OnDn8+c9/5rnnnuPgwYO89NJLREZGdqvjkUce4ZlnnmHv3r3Y7XbmzZvXJ+9fRMQftGq9SIBwuVzExcWxYcMGJk6c2LX9pz/9Ke3t7fzsZz9j+vTprFq1itmzZwNQX19Peno6K1euZNasWdx2223U1NSwbt26rv0feOAB1qxZQ2lpKYcPH2bYsGGsX7+eGTNmfKmGTZs2MX36dDZs2MB1110HwN///nduueUWzp07h9Pp7OWzICLS99QZEgkQR48epb29neuvv57IyMiux6uvvsqxY8e6nvf5oBQXF8ewYcM4ePAgAAcPHmTSpEndjjtp0iSOHDmC1+ulpKQEm83GNddc8421jBw5suvnlJQUAKqrqy/6PYqIBCK7vwsQEZ/W1lYA1qxZQ1paWrc/czgc3QLRhQoLCzuv54WEhHT9bLFYAN98JhGRy5E6QyIBYvjw4TgcDsrLyxkyZEi3R0ZGRtfzdu3a1fVzQ0MDhw8fJi8vD4C8vDy2b9/e7bjbt29n6NCh2Gw2rrzySgzD6DYHSUQk2KkzJBIgoqKiuP/++7nvvvswDIPJkyfT1NTE9u3biY6OJisrC4DFixcTHx9PcnIyjzzyCAkJCRQVFQHwi1/8gnHjxvHUU08xe/Zsdu7cyfLly3nhhRcAyM7OZu7cucybN4/nnnuOgoICPv74Y6qrq5k1a5a/3rqIiF8pDIkEkKeeeorExESWLFnC8ePHiY2NZfTo0Tz88MNdw1RLly7lnnvu4ciRI4waNYp3332X0NBQAEaPHs0bb7zBY489xlNPPUVKSgqLFy/m9ttv73qNFStW8PDDD/Pzn/+curo6MjMzefjhh/3xdkVEAoKuJhPpJz690quhoYHY2Fh/lyMictnQnCEREREJagpDIiIiEtQ0TCYiIiJBTZ0hERERCWoKQyIiIhLUFIZEREQkqCkMiYiISFBTGBIREZGgpjAkIiIiQU1hSERERIKawpCIiIgENYUhERERCWr/C3FRgYY33NszAAAAAElFTkSuQmCC", "text/plain": ["<Figure size 616.125x500 with 1 Axes>"]}, "metadata": {}, "output_type": "display_data"}], "source": ["\n", "metrics = pd.read_csv(f\"{trainer.logger.log_dir}/metrics.csv\")\n", "del metrics[\"step\"]\n", "metrics.set_index(\"epoch\", inplace=True)\n", "display(metrics.dropna(axis=1, how=\"all\").head())\n", "sn.relplot(data=metrics, kind=\"line\")"]}, {"cell_type": "markdown", "id": "91a7fb03", "metadata": {"lines_to_next_cell": 2, "papermill": {"duration": 0.00737, "end_time": "2024-07-26T12:03:48.855148", "exception": false, "start_time": "2024-07-26T12:03:48.847778", "status": "completed"}, "tags": []}, "source": ["### Bonus: Use [Stochastic Weight Averaging](https://arxiv.org/abs/1803.05407) to get a boost on performance\n", "\n", "Use SWA from torch.optim to get a quick performance boost. Also shows a couple of cool features from Lightning:\n", "- Use `training_epoch_end` to run code after the end of every epoch\n", "- Use a pretrained model directly with this wrapper for SWA"]}, {"cell_type": "code", "execution_count": 9, "id": "1ae464cf", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:03:48.871281Z", "iopub.status.busy": "2024-07-26T12:03:48.871053Z", "iopub.status.idle": "2024-07-26T12:03:48.879186Z", "shell.execute_reply": "2024-07-26T12:03:48.878168Z"}, "papermill": {"duration": 0.018015, "end_time": "2024-07-26T12:03:48.880619", "exception": false, "start_time": "2024-07-26T12:03:48.862604", "status": "completed"}, "tags": []}, "outputs": [], "source": ["class SWAResnet(LitResnet):\n", "    def __init__(self, trained_model, lr=0.01):\n", "        super().__init__()\n", "\n", "        self.save_hyperparameters(\"lr\")\n", "        self.model = trained_model\n", "        self.swa_model = AveragedModel(self.model)\n", "\n", "    def forward(self, x):\n", "        out = self.swa_model(x)\n", "        return F.log_softmax(out, dim=1)\n", "\n", "    def on_train_epoch_end(self):\n", "        self.swa_model.update_parameters(self.model)\n", "\n", "    def validation_step(self, batch, batch_idx, stage=None):\n", "        x, y = batch\n", "        logits = F.log_softmax(self.model(x), dim=1)\n", "        loss = F.nll_loss(logits, y)\n", "        preds = torch.argmax(logits, dim=1)\n", "        acc = accuracy(preds, y, task=\"multiclass\", num_classes=10)\n", "\n", "        self.log(\"val_loss\", loss, prog_bar=True)\n", "        self.log(\"val_acc\", acc, prog_bar=True)\n", "\n", "    def configure_optimizers(self):\n", "        optimizer = torch.optim.SGD(self.model.parameters(), lr=self.hparams.lr, momentum=0.9, weight_decay=5e-4)\n", "        return optimizer\n", "\n", "    # def on_train_end(self):  # todo: failing as trainer has only dataloaders, not datamodules\n", "    #     update_bn(self.trainer.datamodule.train_dataloader(), self.swa_model, device=self.device)"]}, {"cell_type": "code", "execution_count": 10, "id": "c7401b9d", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:03:48.896415Z", "iopub.status.busy": "2024-07-26T12:03:48.896218Z", "iopub.status.idle": "2024-07-26T12:56:36.344353Z", "shell.execute_reply": "2024-07-26T12:56:36.343013Z"}, "papermill": {"duration": 3167.477935, "end_time": "2024-07-26T12:56:36.365968", "exception": false, "start_time": "2024-07-26T12:03:48.888033", "status": "completed"}, "tags": []}, "outputs": [{"name": "stderr", "output_type": "stream", "text": ["/usr/local/lib/python3.10/dist-packages/pytorch_lightning/utilities/parsing.py:208: Attribute 'trained_model' is an instance of `nn.Module` and is already saved during checkpointing. It is recommended to ignore them using `self.save_hyperparameters(ignore=['trained_model'])`.\n", "/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.\n", "  warnings.warn(\n", "/usr/local/lib/python3.10/dist-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`.\n", "  warnings.warn(msg)\n"]}, {"name": "stderr", "output_type": "stream", "text": ["GPU available: True (cuda), used: True\n"]}, {"name": "stderr", "output_type": "stream", "text": ["TPU available: False, using: 0 TPU cores\n"]}, {"name": "stderr", "output_type": "stream", "text": ["HPU available: False, using: 0 HPUs\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"name": "stderr", "output_type": "stream", "text": ["\n", "  | Name      | Type          | Params | Mode \n", "----------------------------------------------------\n", "0 | model     | ResNet        | 11.2 M | train\n", "1 | swa_model | AveragedModel | 11.2 M | train\n", "----------------------------------------------------\n", "22.3 M    Trainable params\n", "0         Non-trainable params\n", "22.3 M    Total params\n", "89.392    Total estimated model params size (MB)\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "21ae213dd886424aa53cf2275d840be4", "version_major": 2, "version_minor": 0}, "text/plain": ["Sanity Checking: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "69c1f46ad5524dd9af53e18b57ed19d1", "version_major": 2, "version_minor": 0}, "text/plain": ["Training: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "c872f7e6a55940fba8d239f5f8d1d6df", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "8d7a401cc6ad4b58b09106cf04d11a44", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "d5e8d539ea424a1baefd1e856a2658a4", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "2da7351aa7c54927971f05d135369068", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "047f468d304a473fa05693c53ee7048f", "version_major": 2, "version_minor": 0}, "text/plain": ["Validation: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stderr", "output_type": "stream", "text": ["`Trainer.fit` stopped: `max_epochs=5` reached.\n"]}, {"name": "stderr", "output_type": "stream", "text": ["LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]\n"]}, {"data": {"application/vnd.jupyter.widget-view+json": {"model_id": "8ede9b6b8e084d49bc64b989a676b9c9", "version_major": 2, "version_minor": 0}, "text/plain": ["Testing: |          | 0/? [00:00<?, ?it/s]"]}, "metadata": {}, "output_type": "display_data"}, {"name": "stdout", "output_type": "stream", "text": ["\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "       Test metric             DataLoader 0\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n", "        test_acc             0.817799985408783\n", "        test_loss            0.529252290725708\n", "\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\n"]}, {"data": {"text/plain": ["[{'test_loss': 0.529252290725708, 'test_acc': 0.817799985408783}]"]}, "execution_count": 10, "metadata": {}, "output_type": "execute_result"}], "source": ["swa_model = SWAResnet(model.model, lr=0.01)\n", "\n", "swa_trainer = pl.Trainer(\n", "    max_epochs=5,\n", "    accelerator=\"auto\",\n", "    devices=1,\n", "    logger=CSVLogger(save_dir=\"logs/\"),\n", ")\n", "\n", "swa_trainer.fit(swa_model, train_dataloaders=train_dataloader, val_dataloaders=val_dataloader)\n", "swa_trainer.test(swa_model, dataloaders=test_dataloader)"]}, {"cell_type": "code", "execution_count": 11, "id": "98528363", "metadata": {"execution": {"iopub.execute_input": "2024-07-26T12:56:36.402730Z", "iopub.status.busy": "2024-07-26T12:56:36.402516Z", "iopub.status.idle": "2024-07-26T12:56:36.886384Z", "shell.execute_reply": "2024-07-26T12:56:36.885357Z"}, "papermill": {"duration": 0.503359, "end_time": "2024-07-26T12:56:36.888873", "exception": false, "start_time": "2024-07-26T12:56:36.385514", "status": "completed"}, "tags": []}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>lr-SGD</th>\n", "      <th>test_acc</th>\n", "      <th>test_loss</th>\n", "      <th>train_loss</th>\n", "      <th>val_acc</th>\n", "      <th>val_loss</th>\n", "    </tr>\n", "    <tr>\n", "      <th>epoch</th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "      <th></th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.012079</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.852811</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.034132</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>0.0</th>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>1.636740</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "    <tr>\n", "      <th>NaN</th>\n", "      <td>0.062440</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "      <td>NaN</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["         lr-SGD  test_acc  test_loss  train_loss  val_acc  val_loss\n", "epoch                                                              \n", "NaN    0.012079       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.852811      NaN       NaN\n", "NaN    0.034132       NaN        NaN         NaN      NaN       NaN\n", "0.0         NaN       NaN        NaN    1.636740      NaN       NaN\n", "NaN    0.062440       NaN        NaN         NaN      NaN       NaN"]}, "metadata": {}, "output_type": "display_data"}, {"data": {"text/plain": ["<seaborn.axisgrid.FacetGrid at 0x7f1f370ef160>"]}, "execution_count": 11, "metadata": {}, "output_type": "execute_result"}, {"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHqCAYAAAAHwkogAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjkuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/TGe4hAAAACXBIWXMAAA9hAAAPYQGoP6dpAACfG0lEQVR4nOzdd3hUZfbA8e+9d/qk91BDb1KCFIFdRUARNBYUFVgVu7u6ruuyKmtFV/25lrX3voINwS6CKCCIIEpvIQkhQHqv0+/vj0AkkEDKzATI+TzPPJK5977nTdRw5m1H0XVdRwghhBCinVLbugNCCCGEEG1JkiEhhBBCtGuSDAkhhBCiXZNkSAghhBDtmiRDQgghhGjXJBkSQgghRLsmyZAQQggh2jVJhoQQQgjRrkkyJIQQQoh2TZIhIYQQQrRrzUqGHn30UYYPH05oaChxcXFceOGF7Ny585jPffzxx/Tt2xeLxcLAgQP5+uuvW9xhIYQQQgh/alYytHz5cm6++WZ+/vlnlixZgtvt5uyzz6aqqqrRZ3766SemTZvGtddey/r167nwwgu58MIL2bJlS6s7L4QQQgjRWkprCrUWFBQQFxfH8uXLOf300xu857LLLqOqqoovv/yy7r3TTjuNIUOG8PLLL7c0tBBCCCGEX7RqzVBZWRkAUVFRjd6zevVqJkyYUO+9iRMnsnr16kafcTqdlJeX173KysooKCigFXmbEEIIIUSDWpwM+Xw+brvtNsaMGcMpp5zS6H25ubnEx8fXey8+Pp7c3NxGn3n00UcJDw+ve0VERBAXF0dFRUVLuyuEEEII0aAWJ0M333wzW7Zs4YMPPvBnfwCYPXs2ZWVlda+9e/f6PYYQQgghBIChJQ/dcsstfPnll6xYsYJOnTod9d6EhATy8vLqvZeXl0dCQkKjz5jNZsxmc0u6JoQQQgjRLM0aGdJ1nVtuuYWFCxfy/fff061bt2M+M2rUKJYuXVrvvSVLljBq1Kjm9VQIIYQQIgCaNTJ08803M2/ePD777DNCQ0Pr1v2Eh4djtVoBuPLKK+nYsSOPPvooAH/7298444wzePLJJzn33HP54IMPWLduHa+++qqfvxUhhBBCiOZr1sjQSy+9RFlZGWPHjiUxMbHu9eGHH9bdk5WVRU5OTt3Xo0ePZt68ebz66qsMHjyY+fPn8+mnnx510bUQQgghRLC06pyhYCkvLyc8PJyysjLCwsLaujtCCCGEOIlIbTIhhBBCtGuSDAkhhBCiXZNkSAghhBDtmiRDQgghhGjXJBkSQgghRLsmyZAQQggh2jVJhoQQQgjRrkkyJIQQQoh2TZIhIYQQQrRrkgwJIYQQol2TZEgIIYQQ7Vq7S4Z8Tie+qqq27oYQQgghjhPtLhnyFhZSs30H3kpJiIQQQgjRDpMhXQdPXh7OXan4HI627o4QQggh2li7S4YAFJMRT2EhzrR0dLe7rbsjhBBCiDbULpMhVBVDbBzu7P04MzLQvd627pEQQggh2kj7TIYAxWBAi47BlZWFa08Wuq63dZeEEEII0QbaXTJUU1lJ6s6tAKhmM1pEJK7dGbj272/jngkhhBCiLRjaugPB5Kyu5qNnHqG8uAhzdAw9BwxGtVrRPR5caWmoRhPG+Li27qYQQgghgqhdjQyZbTZ6DBoKwPeff0xBTu1okBYaimIw4tyViqekpC27KIQQQogga1fJEMDoc6fQqXMSHo+bbz5+l+qqSgC0iAh0jxfnzp14KyrauJdCCCGECJZ2lwypqsq4cZMIj4qhsqyUb+e/h9frAUCLjsZbVYVjZyq+6uo27qkQQgghgqHdJUMAZrOFyZddhclsxuVw4KypAUBRFAyxcXhLinHs2oXP5WrjngohhBAi0NrVAupDRcbEkTLjeqJi4zGaTHXvK6qKIS4eT14eLqMRc+/eKIZ2+2MSQgghTnrtcmTooPiOnTGaTOi6zpZ1q8nekwGAomkYYmNx7duPc/dudJ+vjXsqhBBCiEBp18nQQds3/MKKbz5l0fz3qCit3U2mGI1oUVG4Mvfg2rtXDmUUQgghTlKSDAG9ThlCTEIHPG43JUUFde+rFgtaWBiu9HQ8ublt2EMhhBBCBIoshgGMRhOTLr0Sp8NBTHxivWuq3Y7u8eDYtQvFaMQQE9NGvRRCCCFEIMjI0AGh4ZF1iVBhbjZb1q2uu6aFh4MOjtRUvKWlbdRDIYQQQgSCjAwdprykmAVvv4jH7SEkLJyk3v0BMERH4y7Ix7FrF5Z+/dFC7G3cUyGEEEL4g4wMHSYsMoq+g4cBOvsP7C47yBATi6+sDOeuVHwOR9t0UAghhBB+JSNDDRhzdgqduvWke99T6r2vKApabBye/DycaelY+vRGMRrbqJdCCCGE8AcZGWqApml1iZDb5WTdj9/j83mBA2cQxcTizt6PMyMD3etty64KIYQQopVkZOgodF3n8/deJ29/Fs6aKsacnQIcOIMoOgZXVhaK0YSpWxKKorRxb4UQQgjREjIydBSKojBk1OkAbFyzkh0bf627pprNaBGRuHZn4N6f3VZdFEIIIUQrSTJ0DD36DWTYH8cDsPyrBeTtz6q7plqtKDY7zrRduPPy26qLQgghhGgFSYaaYPgZE+jWuz9er4dvPnqXqoryumtaaChoBpy7UvGUlLRhL4UQQgjREpIMNYGiqIy/8HKiYuMxGIw4HTX1rhsiI9HdHpw7U/FWVLRRL4UQQgjRErKAuolMZjOTL5+JyWTGYjvywEUtJgZPfh6OnalYB/RHtVrboJdCCCGEaK5mjwytWLGClJQUOnTogKIofPrpp8d8Zu7cuQwePBibzUZiYiLXXHMNRUVFLelvmwqLiKpLhHZt3cjmX36qu6YoCobYOLwlxThSU/G5XG3VTSGEEEI0Q7OToaqqKgYPHswLL7zQpPtXrVrFlVdeybXXXsvWrVv5+OOPWbt2Lddff32zO3u8yNmbyZIF81j57edkpafWva+oKoa4eDx5+bjS09E9njbspRBCCCGaotnTZJMmTWLSpElNvn/16tUkJSVx6623AtCtWzduvPFGHnvsseaG9gv3/v1ULl9O5KWXtbiNhE5d6Tt4GKmb11NdWX+NkKJpGGJjce3dB0Yj5u7dUVRZmiWEEEIcrwL+t/SoUaPYu3cvX3/9Nbquk5eXx/z585k8eXKjzzidTsrLy+u9/MGdl8/eG26g7KOPcWzf3uJ2FEXhjMkXMeXqv9B38KlHXjca0aKicGdm4tq7F13XW9NtIYQQQgRQwJOhMWPGMHfuXC677DJMJhMJCQmEh4cfdZrt0UcfJTw8vO7VuXNnv/TFGB9HyLhxABS9/HKr1vVoBgNxHToBUFZcxKrFX6DrvrrrqsWCEhqGKz0DT25u6zouhBBCiIAJeDK0bds2/va3v3Hffffx66+/smjRIjIzM7npppsafWb27NmUlZXVvfbu3eu3/kTfcANqWBju/fspW7Cg1e153G4+ffdlNq5ZydplS+pd0+x2FLMZx640PIWFrY4lhBBCCP8LeDL06KOPMmbMGP75z38yaNAgJk6cyIsvvsibb75JTk5Og8+YzWbCwsLqvfxFCw0l4tKpAJQtXIhrz55WtWcwGjltXO0aqtKignqjQwBaeDjoOo5du/CWlbUqlhBCCCH8L+DJUHV1NephC4g1TQNos7U0liFDsI0YAV4vFd991+r2+gwaSsqM6zj74hkoypE/UkN0NL6amtot91VVrY4nhBBCCP9pdjJUWVnJhg0b2LBhAwC7d+9mw4YNZGXV1uyaPXs2V155Zd39KSkpLFiwgJdeeomMjAxWrVrFrbfeyogRI+jQoYN/votmUhSFqGuvJfrGG4m6+mq/tNm5ey8URcHr9bB66TfUVFXWu26IjcNXVlabEDmdfokphBBCiNZrdjK0bt06kpOTSU5OBuD2228nOTmZ++67D4CcnJy6xAhg5syZPPXUUzz//POccsopTJ06lT59+rDAD+t1WsMQHU3oWWehqCq614vXTyM2y778hPU/LePb+e/h9f5+zpCiKGixcXgKC3HuSkN3u/0STwghhBCto+gnwL7v8vJywsPDKSsra/X6Ide+/Th27sAYnwDUnjtU8PzzaCEhxP3rXyiK0qr2iwvy+OTNF3C7nAw49TTOmHxRveu6242nIB9T1yTMPXugHJgyFEIIIUTbkNMAAdfu3dSsX0/VypWtbisqNp6zpkwDFLb++jNbfv253nXFaESLjsGVtQfXniw5g0gIIYRoY+0+GTJ27EjE1NrdZc5du/zSZlKvfpw2biIAKxd9RvaejHrXVbMZLSIS1+4M3Puz/RJTCCGEEC0jVeuB8PPPx9y7N9aBA/3WZvLosRTm5bA/M73Bchyq1Yru8eBMS0MxGjHGx/ktthBCCCGaTpIhaqeuDiZCPocDT0EBplaeeq0oCmemXIKzppqQsIgG79FCQ/F4PDh37UIxGTFERrYqphBCCCGar91Pkx3KtXcv2bffTt4jj+CrqWl1e0ajqS4RykpPZdmXnxyxRsgQGYnuduPcmYq3oqKBVoQQQggRSJIMHcIQE4Ou63gLCij98EO/tVtdWcE3H73DtvVr+W3VD0dc12Ji8FZV4tiZ6pckTAghhBBNJ8nQIVSrlegbbgCg/Ouv/bag2hYSyh8nng8oDW7dVxQFQ2wc3pJiHGlprSogK4QQQojmkWToMLbkZOynnw4+H4UvvYTu8Rz7oSboP3Qkl93wN4aOObPB64qqYoiLx5OTiys93W9xhRBCCHF0kgw1IGrmzNrK9llZlH/9td/ajY5PBGqnzZYs/ABHTXW964qmYYiNxbV3H87MTHSfr6FmhBBCCOFHspusAVpYGFFXX41z+3ZCx4/3a9u6rvPt/PfI2ZtJTXUl5027GlX9/RRqxWhEi4rCnZmJYjJh7tLFr/GFEEIIUZ+MDDUi5I9/JPqGG1Dtdr+2qygKfzznAgxGI7rPh6eBGmWqxYISGoYrLR13To5f4wshhBCiPhkZOgZfVRXF772HuXt3Qs86yy9txiR04KKr/kx0fEK9UaFDaXY7Xo8Hx67aQxkNMTF+iS2EEEKI+mRk6BgqV66kcskSiv/3PzxFRX5rNzaxI6qq4fP5WPPDt+TtzzriHi08HHQdx65deMvK/BZbCCGEEL+TZOgYQidMwNSrF3p1NeVffOH39jesXs6vK7/nm4/epaqi/IjrhuhofDU1OFJT8VVV+T2+EEII0d5JMnQMiqYR8+c/EzFtGpF/+pPf2z9l2GiiYuOprqxg0cfv4vEcuYbIEBuHr6wMx65d+JxOv/dBCCGEaM8kGWoCU5cuRFx8MYrBgK7r6A0sem5x22Yzky69CrPFSt7+vSz/auERJTsURUGLjcNTUIhzV5pf4wshhBDtnSRDzeApKCD/kUcoev11v7YbHhXN2RfPQFFUdm76lU1rVh5xj6JpGGJicGfvx5mxG93r9WsfhBBCiPZKkqFm8BQUULN+PZVLl1KzebNf2+7cvRejzzoXk9lMeHTDO8cUoxEtOgZXVhauPVlHjCAJIYQQovkkGWoGS//+hJ59NgBFr7zi9/U7g0aMYdqfZ5HUq1+j96hmM1pEBK7dGXiys/0aXwghhGiPJBlqpsgZM9CiovDk5lL68cd+bVtRFOyhYQDkZe/l87mv43I6jrhPtVpRbHYcu9Jw5+f7tQ9CCCFEeyPJUDOpdjvR118PQPnnn+PMyPB7DJ/Py5IF77MvYxffffohun5kjTItNBQ0DWfqLjwlJX7vgxBCCNFeSDLUArbhw7GNGoWpRw8Uk8nv7auqxllTpqFpBsIjoxpdG2SIjER3u3GmpuKtrPR7P4QQQoj2QNFPgFW45eXlhIeHU1ZWRlhYWKvacu3bj2PnDozxCa1qx1dTg2IyoWgNl9Pwh/KSYsIio456j67rePJyMURGYunfH9VqDVh/hBBCiJORjAy1kGq1omgaus9HxeLFuHNz/R7jYCLkdNTw7fz3KMjZf8Q9iqJgiIvHU1yMIy0N3eXyez+EEEKIk5kkQ61U8t57FL36KkWvvBKwre4/f7+I9O2b+ebjd6muOnI6TFHV2oQoJxdnejq6xxOQfgghhBAnI0mGWin0rLNQTCYcmzdTtXx5QGKMPHMi4VExWG12fI0ctqhoGobYWFz79uHMzET3HbnoWgghhBBHMrR1B050xsREIi69FGdaGpbBgwMSw2K1kTLjWmz2UAxGY6P3KUYjWmQU7sxMFJMJc5cuAemPEEIIcTKRZMgPwi64AEVRAhsjonb9kK7rbFqzEoPJxIChI4+4T7VY0EPDcKWlo5pMGBNat1BcCCGEONlJMuQHBxMhn8tF2fz5mHv3xjZsWEBi7dm1nVVLvkRVVSKjY+nQtfsR92h2O16PB0fqLhSjEUN0dED6IoQQQpwMZM2QH5V/9RVlCxZQ9Npr+KqrAxKja69+9Ow/CJ/Px6L571FR2vCBi1p4OOg6jtRUvGVlAemLEEIIcTKQZMiPwiZPxpCQgLeoiJJ58wISQ1EUzjx/KjEJHXBUV/HNR+/ibmQ7vSE6Gl9NDY7UVHxVVQHpjxBCCHGik2TIj1SzmegbbwSg4ttvcezYEZA4RqOJSZdeidUeQmFeNt9/8XHjp1THxuErK8Oxa5ffC8sKIYQQJwNJhvzMOnAgIePGga5T9PLL6G53QOKEhkdyziV/wmgyk9SrX6MLuBVFQYuNw1NQiHNXWsD6I4QQQpyoJBkKgMgrrkCNiMBbXo57/5GnRvtLYpduXHHrXfQZNBSg0dEhRdMwxMTgzt6PM2O3nEEkhBBCHKLd7SZTjEbw6ehud+2fA0ALDSXujjswJibWVpcPIIvVBkBJYT7fffoh4y+4lKjY+CPuU4xGtOgYXFlZKEYjpm5JAT8OQAghhDgRtLuRIUNMNMbERLxFhQGNY+nduy4RcmZkoDdycrS/rF76DQU5+/jmo3dw1DS8k001m9HCw3Fl7saTnR3Q/gghhBAninaXDCmahimpK4rVGpQt5yXz5pFz551UfPttQOOced7FhIZHEt+xCwZD4yNeqs2GYrXh2JWGOz8/oH0SQgghTgTtLhkC0EJCMCcl4auuDviCYi06GnSdknnz8BQUBCyO1R7CxdfczPgLLsNgNB61aKwWGgqahjN1F56Shs8pEkIIIdqLZidDK1asICUlhQ4dOqAoCp9++ukxn3E6ndx999107doVs9lMUlISb775Zkv66zeGhISgTJeFnnUW5r59a8/8CfBZP7aQUBRFweN2s/Szj9ix8ddG7zVERqK73ThTU/FWVga0X0IIIcTxrNkLqKuqqhg8eDDXXHMNU6ZMadIzl156KXl5ebzxxhv07NmTnJwcfG28o+ngdJm3rBRvWVntic2BiKOqxP7jH6h2O6rJFJAYh9uxcR2pm38jfdsmImNiie/YcMFWLSYGT14uzp07sfTvj2q1BqV/QgghxPGk2cnQpEmTmDRpUpPvX7RoEcuXLycjI4OoqNpio0lJSc0NGxAHp8tqtm2vXUsToN1lhshIoHbre/WaNVj690cLCwtILIABp44kKz2VksJ8TGZLo/cpioIhLh5Pbi6OtDSsffqgBClhE0IIIY4XAV8z9PnnnzNs2DD+85//0LFjR3r37s2sWbOoqakJdOgmCdZ0GUDJ//5HwRNPUPzOOwGNoygqEy68nEuuvYXImLij36uqGOLi8OTk4kxPD/iuNyGEEOJ4E/BkKCMjg5UrV7JlyxYWLlzI008/zfz58/nLX/7S6DNOp5Py8vJ6r0AJ5u4y22mngaJQtXw5NRs2BDSWyWzGbKmd9tq56TeWfbWg8UMZDQa0mBhc+/bhzMyUQxmFEEK0KwFPhnw+H4qiMHfuXEaMGMHkyZN56qmneOeddxodHXr00UcJDw+ve3Xu3DmgfQzW7jJL796EHphiLHr1VXwOR8BiHVRWXMj3n3/Mtt/WsGnNykbvU00mtIhI3Lt349q3L+D9EkIIIY4XAU+GEhMT6dixI+GHLFDu168fuq6zr5G/dGfPnk1ZWVnda+/evYHuZtCmyyKnTatduJyfT+mHHwY0FkB4VAyjzzoXgJ+++4q9GamN3qtarSihYbjS0nHn5ga8b0IIIcTxIODJ0JgxY8jOzqbykO3bqampqKpKp06dGnzGbDYTFhZW7xVowZouU61Wom+4AYDyb77BU1wcsFgHDRoxhr6DT0XXdRZ/Mo+y4sYTPs1uRzGbcaTuwlNUFPC+CSGEEG2t2clQZWUlGzZsYMOBNS+7d+9mw4YNZGVlAbWjOldeeWXd/dOnTyc6Opqrr76abdu2sWLFCv75z39yzTXXYD3OtnIHa7rMNnQoEZddRuIjj2A4sMMukBRF4YzJU4jv2AWno4avP3wHt9vV6P1aeDjoOo7UVLwBXK8lhBBCHA+anQytW7eO5ORkkpOTAbj99ttJTk7mvvvuAyAnJ6cuMQIICQlhyZIllJaWMmzYMGbMmEFKSgrPPvusn74F/wrWdFnE1KmYu3cHCPgp2ACawcA5U68gJDyC/skjjlqyA6g7JNKVtfeop1kLIYQQJzpFPwH+pisvLyc8PJyysrKgTJl5Kyup2bgRUAJ2GCPUnjtUuWwZpe+/T8IDD2Ds0CFgsQ5yu10YjbVnCfl8PlS18XzY53Tiq6jANjQ5oOciCSGEEG2pXdYmO5Zg1i6rWrUKb3ExhS+/HJQt7QcTocryUj558wXStm5s9F7VbEb3uKWgqxBCiJOaJEONCMZ0maIoRN9wA4rZjCsjA/f+/QGLdbht63+hIGcf33/xMYV5OY3ep4aE4snLw3ecHJIphBBC+Fuzy3G0F8GqXWaMiyP2ttswdeuGISYmIDEaMuyP48jbtwdF1QgNj2j0PtVux5OTjaeoGFOnjkHrnxBCCBEssmboGNz791OzbTuGmJiA1S47lKewMGhJkdvlRDMY69YN6boPRTlysNBbWopiNmEbMiQoPwMhhBAimGSa7BiCWbusdOFC9t1yC1U//xzwWABGkxlVVfH5vKxc/AUrvvmswfvU0FC8pWV4SkqC0i8hhBAimCQZOoZg1i7THQ7weCh+4w28VVUBjXWovP172bRmFVt//Zmtvx6ZiCmahmIw4M7NlW32QgghTjqSDDVBsHaXhV98MYYOHfCWlFDy3nsBi3O4xM5JjDxzIvbQMGISGl4XpIaH4y0qwltaGrR+CSGEEMEgyVATBWO6TDWZiLnpJgAqlyzBsXVrwGIdbuiYsVx2w23Ed6wtinv4CJBqMoHXiye/IGh9EkIIIYJBkqEmCtZ0maV/f0LPPhuAwpdfxudqvGyGPymKgsVmByBz13Y++9+rR5TsUMPC8RTk4wviFJ4QQggRaJIMNYMWEoK5W7eAT5dFzpiBsWtXIi6+OOi7t9wuF8u+/ITsPRn88PnH9UaIVJsNX00NbingKoQQ4iQiyVAzGeLjAz9dZrfT4fHHCRk7FkVRAhanIUaTibMvnoGqaqRt28SmtSvr981mx5OdjR6kESshhBAi0CQZaqZgTZcpB87+cWZkUPjCC+heb8BiHa5Dl26MOfs8ANZ8/y1lJb+PBKmhoXgrKvAUFwetP0IIIUQgSTLUAsGaLvM5neT9+99U/vAD5V9/HbA4DTll2Cg6dO2Ox+Nm+VcL6qbLFFVFMZlx5+QEpZaaEEIIEWiSDLVQUKbLzGYip08HoPSDD/BWVAQs1uEUReHM8y7GaDIRk9AR3yGJjxYWhrekRLbZCyGEOClIOY5W8FZWUrNxI6AErHaZrusUvfgi9tNPxzpwYEBiHI2juqpul9mh3Hl5mDokYunXL+h9EkIIIfxJRoZaIRjTZYqiEHPzzXWJULBz14OJUHVVJZvWrqp7XwsLw11QgLeyMqj9EUIIIfxNkqFWCsZ02UHV69aR/c9/BrwsyOHcLicfvvJfVn77Obt31h4EqVqt6E6nHMIohBDihCfJUCvV7i5LCvjuMt3rpeSDD3BnZlL81lsBi9MQo8lM38HDANixYV3d+2pIKO68XHxOZ1D7I4QQQviTJEN+oIXYAz9dpmm1pTpUlaqVK6n+9deAxGnM8NMncMbki5g49Yq699SQEHyVlXjlEEYhhBAnMEmG/CQY02Xmnj0JO/dcAIpeew1fTU3AYh3OYDQy4NTTUFUVXdepqihHURQUixVXdk5Qz0ESQggh/EmSIT+pmy6z2QI6XRZx2WUY4uLwFhZSMm9ewOI0prK8lM/+9yqfvvsKHrcbLTQUX2kJ3pKSoPdFCCGE8AdJhvxIC7FjTkoK6HSZarEQfeONoKoomhb03WVGk5nSogLKigv5deX3KAYDuqrhzs0Lel+EEEIIf5BzhvxM93pxbN+BJzcHQ0JiwOK4c3MxJiQErP2jydixlW3r13LG5AsJDY/E53Tiq6jAljwkYOctCSGEEIEiyVAAeCurqNm0EXQCnhx4Kypwbt+ObcSIgMY5nK7r9YrIunNzMCUlYenZM6j9EEIIIVpLpskCIBjTZQCeoiL2/+1v5D/1FK69ewMWpyGKouD1elj341I2rvkRNTQMT15eUBd1CyGEEP4gyVCABGN3mRYVhblXL/B4KHrppaAXTt29cxtrly3m5+8XUeGoxldVhadIqtkLIYQ4sUgyFCDB2F2mKArR11+PGhGB7bTTIMgznj36DaRTt554PR6Wf70QxWrDnb0/oKNhQgghhL9JMhRAwZguM8TE0OmFFwg//3wUTQtIjMYoisIZ507BYDCyPzOdnRk78ZaV4ymWbfZCCCFOHJIMBVgwpstUsxkAd04OJR9+GNQt7uGR0YwYezYAq5d+Q7XTgTs3J+hTdkIIIURLSTIUYME6jNFXVUX2nXdS9vHHVP/0U8DiNGTQyDHEJnZCURTK3U68xcVBLyYrhBBCtJQkQ0EQlMMY7XbCzzsPgKI33sBbURGQOA3GVjXOumga0/78Dzr36gs+n1SzF0IIccKQZChIgjFdFn7RRRg7dcJXXk7Ju+8GLE5DIqJjsIWEAlBcXUVl1h68lVVB7YMQQgjREpIMBUlQdpcZjUT/+c+gKFT+8AM1mzYFJM7RbFq7ik/mvs7PP36HJ4CJnxBCCOEvkgwFUTCmyyx9+hB6zjkAVC5bFpAYRxOT0AFd97Fz51byt2zC53IFvQ9CCCFEcxjaugPtjSE+HmNxSUBrl0VOn46pWzdCxo4NSPtH06FLN4afcRaxCR0JN1nwFhejtlENNSGEEKIppDZZGwhm7TLd68VbXo4hMjKgcRriKSpCsduwJycH/QwkIYQQoqlkmqwNBKt2mTs3l5y77yb/4YfRPZ6AxWlMdlEe77/yNNmb1gc9thBCCNFUkgy1EUNCQuAPY7Ra8eTm4srMpPyLLwIWpzE7tmygvLyUJW+9grcNkjEhhBCiKSQZaiOKqgZ8d5kWHk7UzJlA7ShRsP1h4vlYbXY6JnbCUy6HMAohhDg+NTsZWrFiBSkpKXTo0AFFUfj000+b/OyqVaswGAwMGTKkuWFPSsGYLrOfcQYJDz9MzJ//HJD2j8ZmD2HGLXcwcvgYKC0PenwhhBCiKZqdDFVVVTF48GBeeOGFZj1XWlrKlVdeyfjx45sb8qQW6OkyRVGw9OkDgM/hwJGaGpA4jTGZLaj2EMoz0lj94XtSs0wIIcRxp9lb6ydNmsSkSZOaHeimm25i+vTpaJrWrNGkk93B6TJveRnesrKA7S5z5+WRN2cO3spKOj7zTFB3l+lWCwtee4bKqgpsUdEMPqv5//0IIYQQgRKUNUNvvfUWGRkZ3H///cEId8IJxnSZISYGNTQUvbqa4jfeCEiMRmMbjAxMHgHAirlvUVEsJ1MLIYQ4fgQ8Gdq1axd33XUX7733HgZD0wainE4n5eXl9V4nu4PTZZ7CwBQ4VTStdt2QqlL9889UrVkTkDiNGfSHM4mLS8BVU83SN17iBDjeSgghRDsR0GTI6/Uyffp05syZQ+/evZv83KOPPkp4eHjdq3PnzgHs5fHh4HSZarcHbHeZKSmJ8AsuAKD49dfxVgWvkKpmNHL62Imoqkr6ujWk/rwqaLGFEEKIowloMlRRUcG6deu45ZZbMBgMGAwGHnzwQTZu3IjBYOD7779v8LnZs2dTVlZW99q7d28gu3ncCMZ0Wfgll2BITMRbUkLZJ58EJEZjYpJ6MOTAdNnGJV8HNbYQQgjRmIDWJgsLC2Pz5s313nvxxRf5/vvvmT9/Pt26dWvwObPZjNlsDmTXjluGhASMxSW4c7IxJnbwe/uq2UzMTTdRuXIlERdf7Pf2jxU7efAwbPEJnDr9qqDGFkIIIRrT7GSosrKStLS0uq93797Nhg0biIqKokuXLsyePZv9+/fz7rvvoqoqp5xySr3n4+LisFgsR7wvagVjd5llwAAsAwbUfa3rOoqi+D1OQwwRUQywh6K63egGAzXlZdjCI4ISWwghhGhIs6fJ1q1bR3JyMsnJyQDcfvvtJCcnc9999wGQk5NDVlaWf3vZzgSrdpm3qorCV16h9IMPAhbjcKrNhq+6mrLM3Xz6+EPMvfsfuB2OoMUXQgghDidV649Tus+Hc/t2XNmBmS4DqF67lvz//Ac0jQ6PPYYpKSkgcQ7nLSvDrXv5eN4bVBQVcup5FzH2imuDElsIIYQ4nNQmO04pqoqxa2B3l9lGjMA2ciR4vZR9+WVAYjREDQlBq3Fy5tQ/0bHvAAaNnxi02EIIIcThZGToOOfOzqZm6zYMMTEoRqPf2/cUF1O1fDlhKSkoTTwHyi9xCwvRIiKwDDwFVdOCFlcIIYQ4nIwMHecMCQmYOgTuMEZDVBThF12EYjCg6zq+mpqAxDmcFh6Ot7gYX3k5Pp+X3775nHVfLgxKbCGEEOJQwRsKEC1ycLrMUxbY2mWeggKKXnkFHYi/++6A7y5TjEZ0nxdPfj7Zu9P44e1X0QwGuiUPI7rjyX/IphBCiOOHjAydAIKxu0x3u6nZuhXHhg1U/fhjQGIcTguPwJ2fT5de/eg25FQMZjNl+blBiS2EEEIcJGuGThDB2F1WumABpfPmoYaG0vHppwM2CnUod04O5t69cIeGoKgq9ojIgMcUQgghDiUjQyeIYOwuCz//fIxdu+KrqKD47bcDEuNwqt2OOzsbW0hoXSKUn5lBRZFUthdCCBEckgydQAI9XaYYDHWV7at+/JHq337ze4zDqSEh+Cor8RYVAbD5+8W8N/s2vnv9BalsL4QQIigkGTrBBHp3mblnT8LOPRdz794YYmMDEuNQiqqimMy4c3LQvV469O6Lqqpk/PYLO39aEfD4QgghhCRDJ5hgTJdFTp9OwkMPYeocnF1dWng43tJSvKWlRHfqwsiLLgPg+7dfpaaiPCh9EEII0X5JMnQCCvh0mdGIomnoPh8VS5bgTE/3e4x68QwGdMCTm4uu64y48BJiOnelpryMZe+8FtDYQgghhCRDJ6i66bIALjQu++QTil55pfb8Ia83YHEAtLBw3IWF+Cor0QxGzr7xVlAUtv34A7npuwIaWwghRPsmydAJqm66zGYL2HRZ6FlnodrtuDIyqFi0KCAxDlItFnSXC09B7VqoxF59GD11Oufddifx3XsGNLYQQoj2Tc4ZOsEFunZZxZIl1GzeTNTVV2OIDOwZQN6KCtB92IYORbVY6l3TfT4UVXJ3IYQQ/id/u5zgAj1dFjJhAnG33x7wRAiO3GZ/UHbqdt6981ayU3cEvA9CCHGiGzt2LLfddltbd+OEIsnQCS7Q02UHa5T5nE5K3n+fqrVr/R7j0FiK1YYrJxfd46l7f+OSbyjMymTxK8/i9QSmHIkQQrRny5cvZ9y4cURFRWGz2ejVqxdXXXUVLper7h5d13nttdcYNWoUYWFhhISEMGDAAP72t7+RlpZWd98DDzxQ+/tcUTAYDMTExHD66afz9NNP43Q62+LbOyZJhk4CWogdc7duAa1dVvHNN5R98gnFr7+Or7o6IDEAtLAwfKUleEtK6t4be+V12MIj6NinP95DkiQhhBDNc2hyc9C2bds455xzGDZsGCtWrGDz5s0899xzmEwmvAc2z+i6zvTp07n11luZPHkyixcvZtu2bbzxxhtYLBb+/e9/12tzwIAB5OTkkJWVxQ8//MDUqVN59NFHGT16NBUVFUH5XptDqtafJAzx8ZiKi3Hl5GBMSPR7+6GTJlHx3Xd4cnMpef99oq+91u8xABRNA82AKzcXLSYGRVGwhoZx9VMvYwkJCUhMIYQ4WSUlJXHttdeya9cuPv30U6ZMmcLbh5VbWrx4MQkJCfznP/+pe69Hjx6cc845dV9/+OGHfPDBB3z22Wecf/75de936dKF00477YiKAQaDgYSEBAA6dOjAwIEDOeussxg8eDCPPfbYEclTW5ORoZNEoKfLVLOZ6BtuAKBi0SKchwyJ+j1WWBjeoiJ8h3wfBxMhZ3UVaz+bj88X2K3+QghxOF3XqXZ5gv5q7T6nJ554gsGDB7N+/XruvffeI64nJCSQk5PDihWNn/r//vvv06dPn3qJ0KEOLqk4mr59+zJp0iQWLFjQ9M4HiYwMnUQOTpc5tm5Ft9n8vrvMOmgQ9tNPp2rFCopefpnExx6rHcnxM9VsxlfiwV1QgBYRUfe+z+dl3j2zKN6/F6PZTPI5KX6PLYQQjalxe+l/37dBj7vtwYnYTC3/63rcuHH84x//aPT61KlT+fbbbznjjDNISEjgtNNOY/z48Vx55ZV1O7hTU1Pp06dPveduu+02Xn/9dQAiIiLYt2/fMfvSt29fFi9e3OLvJVBkZOgkY4iPx5gYuN1lUVddhRoSgqe4GHd2dkBiAKihYXjy8uqtT1JVjeSJ5wGw7ccf0H2+gMUXQoiTxbBhw+r+fNNNNxESElL3AtA0jbfeeot9+/bxn//8h44dO/LII4/UrftpzN13382GDRu47777qKysbFJfdF1v0ihSsMnI0Enm4HSZp6wMb1kZWni4X9vXwsOJu+MOjJ07o4WG+rXtQ6l2O+7sMtxFRZhttrr3B581CVXT6H/GeDl3SAgRVFajxrYHJ7ZJ3Naw2+11f37wwQeZNWtWg/d17NiRK664giuuuIKHHnqI3r178/LLLzNnzhx69erFzp07690fGxtLbGwscXFxTe7L9u3b6datW8u+kQCSZOgkFOjpMkv//nV/du3fj7FDh4Bk+qrdjic7G1N8PIrJBNQme4Mm1C7q03WdyuIiQqNj/B5bCCEOpyhKq6arjgdxcXFNSl4iIyNJTEykqqoKgGnTpjF9+nQ+++wzLrjgghbF3rFjB4sWLWL27Nktej6QTux/q6JRhvh4jAHcXQZQ/M47lH/5JbH/+Af2007ze/tqSAie/Hw8JSUY4+PrXXNUVrLopafZv3MbVz/1ErYw/46ACSFEe/HKK6+wYcMGLrroInr06IHD4eDdd99l69atPPfccwBcfvnlLFiwgMsvv5zZs2czceJE4uPj2bNnDx9++CHaYetHPR4Pubm5+Hw+ioqKWLZsGf/+978ZMmQI//znP9vi2zwqmWc4SQWjdpliNoOuU/zGG/gOfHrwa/uahmI04s7JPWJ9kNFioTw/F0dFuVS2F0KIVhgxYgSVlZXcdNNNDBgwgDPOOIOff/6ZTz/9lDPOOAOoHRX78MMPefrpp/n6668ZP348ffr04ZprrqFz586sXLmyXptbt24lMTGRLl26MHbsWD766CNmz57Njz/+WLdW6XgitclOcu6cHBxbt6JF+792mc/lIvv221E0jdh//hNTp05+bR9Ad7vxlhRjTU4+oiRIbloq8+6Zha77mHLXA3RLHtZIK0IIIUTjZGToJBfI3WWqyUT83XfT4YknApIIAShGI7qu48nLO+JaQs/eDJ1ce+bFktdewFUTuJOxhRBCnLwkGTrJ1U2X2e0BmS4zJibWJSzV69fXqynmL1pYOO78ArwNbN0cc+mfCI+Lp6KogJUf/M/vsYUQQpz8JBlqB7QQO+akJPSawNUuK3rxRfIffpjyr77ye9uq1YrudOApPHJ0y2ixcNb1fyWuWw8GnDHe77GFEEKc/CQZaicCfRijuV8/AEo/+gh3fr7f21dDQnHn5OBroMhg10FD+NMj/yW+e0+/xxVCCHHyk2SonQj0dFnImWdi7t8f3emk+PXXW11L53Cq3Y6vshJvUVGD1xVVRdd1tiz7jl++OP7q3gghhDh+STLUjgRyukxRFKJvvBEMBmp++43q1av9276qopgtuPZno3sbLtK6d+tmvn3paVa+/y6FWZl+jS+EEOLkJclQOxPI6TJTx46EX3QRUHsgo78TLi0sDF9ZKd6Skgavdx4wkB7DTkM1aBTt3+vX2EIIIU5ecgJ1O1NXu6y8PCC1y8Ivugj3/v2EX3ih3881UgwGdBTceXlo0dFHlABRFIUJ1/0Fr9tFeFyCX2MLIYQ4ecmhi+1UIA9jPJS/KxT7nE58lRXYkpPRjvHfQnH2fgxGI2GxTS8iKIQQov2RabJ2KtC7y3Rdp+KHH8ibM8evZw+pZjO6293gNvtD7Vi1nHfvuIXFrz7n98XcQgghTi6SDLVTiqpiSgrc7jJfVRUl//sfji1bKP/iC7+2XbfNvqam0XviutVus9+zaT17Nq33a3whhDiejR07lttuu81v7c2cOZMLL7zQb+0djyQZasdUe+B2l2khIURdeSUAZV9+ic/p9Fvbqt2Or6oKT1Fxo/dEdejI2Cuu49xb/0nXQcl+iy2EEOLkI8lQOxfI6TL7GWcQPnUqHR57DNVs9lu7iqKgWG24c7KPOgU3ZOK59B1zBoqi4GtkO74QQpxMZs6cyfLly3nmmWdqf1cqCpmZmWzZsoVJkyYREhJCfHw8V1xxBYWHLDeYP38+AwcOxGq1Eh0dzYQJE6iqquKBBx7gnXfe4bPPPqtrb9myZcfsx5133knv3r2x2Wx0796de++9F/dhH7q/+OILhg8fjsViISYmhosO7EYGcDqd3HnnnXTu3Bmz2UzPnj154403/PZzOlyzk6EVK1aQkpJChw4dUBSFTz/99Kj3L1iwgLPOOovY2FjCwsIYNWoU3377bUv7K/wskNNliqIQedllGGJiAPw6+lS7zb4MT3Hjo0MHZafu4N07/kraujV+iy+EaMdcVUd/eQ/5kOZxHf1e9yHT/bp+5PVmeuaZZxg1ahTXX389OTk55OTkEBoayrhx40hOTmbdunUsWrSIvLw8Lr30UgBycnKYNm0a11xzDdu3b2fZsmVMmTIFXdeZNWsWl156Keecc05de6NHjz5mP0JDQ3n77bfZtm0bzzzzDK+99hr//e9/665/9dVXXHTRRUyePJn169ezdOlSRowYUXf9yiuv5P333+fZZ59l+/btvPLKK4SEhDT759FUzd5N9s0337Bq1SpOPfVUpkyZwsKFC486l3jbbbfRoUMHzjzzTCIiInjrrbd44oknWLNmDcnJTZu+kN1kgRfI3WW6203ZwoVUfP89HZ54As1P/0F7CgrQoqOwDhx41B1ry997k3VfLCAkKpqZT76I2Wb3S3whRDv1wDGOJJn6Ngw4MMqx+B746bnG7+2QDDcsq/1zVSE83uOwWM3/kDp27FiGDBnC008/DcC///1vfvzxx3oDEfv27aNz587s3LmTyspKTj31VDIzM+natesR7c2cOZPS0tJjDn4czRNPPMEHH3zAunXrABg9ejTdu3fnvffeO+Le1NRU+vTpw5IlS5gwYUKLYzZHs88ZmjRpEpMmTWry/Qf/ZRz0yCOP8Nlnn/HFF180ORkSgWeIj8dYXIwrJwdDfIJft8MDVK1ahbewkJK5c4m58Ua/tKmGh+MtKsJXVoYWEdHofaOnTidt7WpK83L4cd7bTLjuZr/EF0KIE8HGjRv54YcfGhxZSU9P5+yzz2b8+PEMHDiQiRMncvbZZ3PJJZcQGRnZ4pgffvghzz77LOnp6VRWVuLxeOoNZmzYsIHrr7++wWc3bNiApmmcccYZLY7fXEE/dNHn81FRUUFUVFSj9zidTpyHLLgtLy8PRtfatYPTZZ7ycnzl5X49jFExGom+8UZy77uPyiVLCDnjDCx9+7a6XdVkwuf14s7LP2oyZDRbOOuGv/LxQ/9i45Jv6DvmDDr1O6XV8YUQ7dS/so9+XTtkjeS4+2Ds7MbvVQ5ZrWKLPnbbLVBZWUlKSgqPPfbYEdcSExPRNI0lS5bw008/sXjxYp577jnuvvtu1qxZQ7du3Zodb/Xq1cyYMYM5c+YwceJEwsPD+eCDD3jyySfr7rFarY0+f7RrgRL0BdRPPPEElZWVdXOVDXn00UcJDw+ve3Xu3DmIPWy/Arm7zNK/PyHjxgFQ9MorfmtfDQ3DU5CPr+roc+tdThnEwHFnA7D4lefwuFx+iS+EaIdM9qO/tEPGGQymo99rPOQvfkU58npLumcy4T1k08jQoUPZunUrSUlJ9OzZs97LbrcfCK0wZswY5syZw/r16zGZTCxcuLDB9o7lp59+omvXrtx9990MGzaMXr16sWfPnnr3DBo0iKVLlzb4/MCBA/H5fCxfvry533qLBTUZmjdvHnPmzOGjjz4iLq7xU4Fnz55NWVlZ3WvvXqkzFSyH7i7z92GFkVdcgRoWhnvvXsr8dPaQarfjq3HgbqSa/aFO/9M12CMiiUvqLsmQEOKklZSUxJo1a8jMzKSwsJCbb76Z4uJipk2bxi+//EJ6ejrffvstV199NV6vlzVr1vDII4+wbt06srKyWLBgAQUFBfTr16+uvU2bNrFz504KCwuP2BV2uF69epGVlcUHH3xAeno6zz77bF1iddD999/P+++/z/3338/27dvZvHlz3chVUlISV111Fddccw2ffvopu3fvZtmyZXz00UeB+YERxGTogw8+4LrrruOjjz465oIos9lMWFhYvZcIjkN3l/n8PD2phYYSNXMmamho3Q4zf1BtNjw5OejHSHAs9hCu/M9znHfbnVgCuCtBCCHa0qxZs9A0jf79+xMbG4vL5WLVqlV4vV7OPvtsBg4cyG233UZERASqqhIWFsaKFSuYPHkyvXv35p577uHJJ5+sWx98/fXX06dPH4YNG0ZsbCyrVq06avzzzz+fv//979xyyy0MGTKEn376iXvvvbfePWPHjuXjjz/m888/Z8iQIYwbN461a9fWXX/ppZe45JJL+Mtf/kLfvn25/vrrqTrGDEBrtKo2maIox9xNBvD+++9zzTXX8MEHH3DBBRc0O47sJgu+QO0u03UdX1WV33aUAeg+H568XKyDBmGMj2/SM26ng03ffUvyOeehaprf+iKEEOLE0+wF1JWVlaSlpdV9vXv3bjZs2EBUVBRdunRh9uzZ7N+/n3fffReonRq76qqreOaZZxg5ciS5ublA7QKpcD9XTBf+U7e7bH82hoQEFNU/g4iKotQlQs6MDLxlZdhauatQUVUUkxl3djaG2Nhj9lXXdT58YDZ5GbvQfV6GpUxpVXwhhBAntmb/Dbdu3TqSk5PrtsXffvvtJCcnc9999wG1hzdlZWXV3f/qq6/i8Xi4+eabSUxMrHv97W9/89O3IAJBUVVM3bujRUUdsyhqS9Rs3EjOXXdR+PzzeCsqWt2eFhaGt6QEb2npMe9VFIXBZ9UO/27+YYmcTi2EEM3wyCOPEBIS0uCrOUfvHE9aNU0WLDJN1nY8JSU4tm4FRfXrdnvd7Sb7n//EvW8fIePHE/PnP7e6TXdeLqYOHbAcWPR31Pi6zvpFX3LKmRMwWYK/jVMIIU5UxcXFFDdy+r/VaqVjx45B7lHrSTIkjsmdk4Nj+3bU0DBUP57/4Ni2jcKXXyb6+uuxDhzY6vZ8NTX4amqwDU1u9pqkqtIS7BEtP2BMCCHEiUsKtYpjMiQkYEpKwlta4tfzhyz9+9Pxv//1SyIEoFqt6E4HnoKCJj/jctTwzfNP8vbtf6aqtMQv/RBCCHFikWRIHJOiKJi6dMGY2AFPYYFfzx9SDuzkql63jnI/FPBVQ0Jx5+biO+QE86MxGE0U7svCUVXJ92+/2ur4QgghTjySDIkmUQwGzD26o0VE4PXzgmrH1q3k/9//Ufz227hzclrVlhoSgq+iEm8TDmEEUDWNiTf9jYQevRhx/sWtii2EEOLEJMmQaDLVasXcsycYNLxlza+k3Bhz//5YBg0Ct5ui115r1ciToigoFguu7Bz0Ju4Si0vqzvSHnyK+e88WxxVCCHHikmRINIshMhJLz57ojtrFyv6gKArRN9yAYjLh2LSJqh9/bFV7WlgYvrJSvCVNXwOkKAq6rrN1+VJWzHu7VfGFEEKcWCQZEs1mSEjAmJSEt6QY3ePxS5vGhATCL7kEgOK3327V2UOKwYCuqLhz85o1ylSwZzeLXvwvv3w2n73bNrc4vhBCtGeZmZkoisKGDRvauitNJsmQaDZFUTB36YKxQ0c8Bfl+W1AdnpKCsXNnfBUV1Gzc2Kq2tPBwPIWF+JqRVMUldWfQhHMAWPzKs7hdTVuELYQQx5OxY8dy2223+a29mTNnHrPs1olOkiHRIorRiLl7N78uqFaMRmJuvpnERx4h5A9/aFVbqtmM7nHjzs9v1nOnz7iakMgoSnNzWD3//Vb1QQghxIlBkiHRYqrN9vuCaj9VuDf37Im5Vy8AvBUVrTrXSA0JxZOX16y1TWabnfHX/gWAdV8sIC8j7RhPCCHE8WPmzJksX76cZ555pnZDiaKQmZnJli1bmDRpEiEhIcTHx3PFFVdQeMgH2fnz5zNw4ECsVivR0dFMmDCBqqoqHnjgAd555x0+++yzuvaWLVvW7H4tX76cESNGYDabSUxM5K677sJzyDKLxuIDLFu2jBEjRmC324mIiGDMmDHs2bOn1T+rQ0kyJFrFEBmJpUcP9Jpqvy2oBqj6+Wf2/+1vlH36aYvbUO12fFVVeIoaPja+MT2Hn0bv0/6Aoqjk78locXwhxMmp2l1Ntbu6bolAjaeGanc1Xl/tDlan10m1uxq3r/bDnNvrptpdjcvrAsDj81DtrsbhcQDg0311bR4eo7meeeYZRo0axfXXX09OTg45OTmEhoYybtw4kpOTWbduHYsWLSIvL49LL70UqK0pOm3aNK655hq2b9/OsmXLmDJlCrquM2vWLC699FLOOeecuvZGjx7drD7t37+fyZMnM3z4cDZu3MhLL73EG2+8wb///e9jxvd4PFx44YWcccYZbNq0idWrV3PDDTegKEqzfzZH0+yq9UIczpCYiLG6GldGBooxHsXQ+v+sdI8HX3k5pQsWYB8zBmOHDs1uQ1EUVJsdd/Z+jPFxKEZjk58dd/WNjJ46nehOXZodVwhxchs5byQAyy9bTpQlimlfTiO9LJ03J77J8IThzP5xNkv2LOFfI//FtL7TeG3za7y08SUu63MZ95x2D0uzljJr+SyGxQ/jrXPeIqM0g4s+v4hIcyQrLl9RL8bmq5q3mSM8PByTyYTNZiMhIQGAf//73yQnJ/PII4/U3ffmm2/SuXNnUlNTqaysxOPxMGXKFLp27QrAwEMqA1itVpxOZ117zfXiiy/SuXNnnn/+eRRFoW/fvmRnZ3PnnXdy3333kZOT02j84uJiysrKOO+88+jRowcA/ZpQf7K5ZGRItJqiKJi7dsWQmOi3BdX2MWOwDBmCoqq4WjEcqoaG4i0rx9OMbfYA9ojIukSovLCAsvy8FvdBCCHa0saNG/nhhx/qVZfv27cvAOnp6QwePJjx48czcOBApk6dymuvvUZJM39nHs327dsZNWpUvdGcMWPGUFlZyb59+44aPyoqipkzZzJx4kRSUlJ45plnyGnl4bwNkUKtwm981dXUbN2Kr7IKQ2xsq9vzFNSW/jDGxbW6HS0qEuugQc0eWk3/dS1fP/c48d16MvW+R/w+NCuEOPEcnL6yGqwoikKNpwZd1zFrZjRVw+l14vV5MWpGjKoRt9eN2+fGoBowaSY8Pg8urwtVUbEYLPh0X92Umc1oqxfj4NfNMXbsWIYMGcLTTz8NwKRJk7DZbDz22GNH3JuYmIjdbkfXdX766ScWL17MwoULyc3NZc2aNXTr1o2ZM2dSWlrKp01ctpCZmUm3bt1Yv349Q4YMYcqUKYSHh/PWW2/V3bNx40aGDBnCnj176NKly1HjA6xfv55FixbxxRdfsHnzZpYsWcJpp53W7J9NY2RkSPiNvxdUG2Jj6xIhd25ui88eUsPD8RYX4y0tbfaz0Z264PP52LttM2nrfm5RfCHEycVmtGEz2uo+HFkNVmxGG5paW2vRrJmxGW0Y1dqpeaNmxGa0YdJMABhUAzajDYvBAoCqqHVtHh6jJUwmE95DTuAfOnQoW7duJSkpiZ49e9Z72e12oHaEf8yYMcyZM4f169djMplYuHBhg+01V79+/Vi9enW9WYNVq1YRGhpKp06djhkfIDk5mdmzZ/PTTz9xyimnMG/evBb3pyGSDAm/qreg2uHwS5sVP/xA9u23U/Luuy16XjWZwOfDk9/0avYHRcQnMPaKa5lw3c30PHVki+ILIUQwJSUlsWbNGjIzMyksLOTmm2+muLiYadOm8csvv5Cens63337L1VdfjdfrZc2aNTzyyCOsW7eOrKwsFixYQEFBQd3anKSkJDZt2sTOnTspLCzE3cxdvn/5y1/Yu3cvf/3rX9mxYwefffYZ999/P7fffjuqqh41/u7du5k9ezarV69mz549LF68mF27dvl93ZAkQ8LvDImJGLt2xVtc5JcTqo0dOqC7XFT+8AM1W7a0qA01NAx3fh6+A1s1m2PwWZMZfNYkFFVF9/laFF8IIYJl1qxZaJpG//79iY2NxeVysWrVKrxeL2effTYDBw7ktttuIyIiAlVVCQsLY8WKFUyePJnevXtzzz338OSTTzJp0iQArr/+evr06cOwYcOIjY1l1apVzepPx44d+frrr1m7di2DBw/mpptu4tprr+Wee+4BOGp8m83Gjh07uPjii+nduzc33HADN998MzfeeKNff2ayZkgEhO52U7NjB568PAzxCa1ea1P06qtULF6MoUMHOj75ZLN2hh3kzsnG3Ls35gO7FZqrICuTxa88y4jzL6HXyOZtLRVCCHH8kpEhERCK0YilRw+0sDC/nFAdMWMGWkQEnuxsyg6ZR24O1WbHk5OD7nK16PnUn1eSm5bK0jdfwlFZ2aI2hBBCHH8kGRIBo9pstadJa61fUK3Z7URdcw0ApQsW4M5r/lZ3NTQUb0UFnuLmHcJ40MiLLiOqQyc69h2Az9fyxYRCCHEie+SRR+pt0z/0dXBq7UQj02Qi4NzZ2Ti2bUONiES1WFrcjq7rFD7zDJYBAwgZPx5FbX4u7ykqQgsLxTp4cIued1RVYrGHNPs5IYQ4WRQXF1PcyIdKq9VKx44dg9yj1pNkSAScrus409Jw7d6NIc4/J1S3uC9uN96SYqxDhmCIimpxO26Xk9+++oyhk8/HaG55gieEEKLtyTSZCDhFUTAnJdWeUF1Y4JcTql2ZmeQ98gjesrLm9cVoRNfBk5vbqvifPjaHlR+8y08f+/esCyGEEMEnyZAICsVoxNK9u18WVOu6TuGLL1Lz228U/+9/zX5eCwvDXVjY4kMcAU499yIAfv3yU6lsL4QQJzhJhkTQqHb77wuqW5GIKIpC9HXXgaJQtWwZrqys5vXDakV3OvEUtDwp6z50OH3HnIGu+/j25Wfw+uE8JSGEEG1DkiERVLUnVHdHr6ps1QnV5t69ibj8cuLvuQdTl+ZXlldDQnHn5eJzOlvchzOvuh5LSCgFe3az7osFLW5HCCFE25JkSASdoUMHv5xQHXHxxViHDAFo9snQakgIvspKvEVFLY5vC4/gzKuuB2DT0kV4mnlEvRBCiOND223rEe3WwQXVPofDLydUV69fT/FbbxF3xx2YDhT9a0ofFIsVV3YOhri4Fu9w6/fHM6kuL2PA2AkYWnAqthBCiLYnI0OiTdRbUN2K0RmAikWL8GRnU/TKK80aIdLCwvCVluAtKWlxbEVRGHbeRVhDQgHITUv1y245IYQ4HiQlJfH000/7pa1ly5ahKAqlpaV+ac+fJBkSbUa12zH37Amq2qoF1dHXXYdiNuPcvp3KH35o8nOKpqGrGu68fL8kMCs/eJe5d9/OxiXftLotIYRoqbFjx3Lbbbf5pa1ffvmFG264wS9tHc8kGRJtyhAV9fuC6hYuZjbExhJx2WUAlPzvf806e0gLD8dTWIivleVCAMwHTqZe8d6bVJc37/wjIYQIFl3X8TRxvWZsbCw2my3APWp7kgyJNle3oLqoEN3bsppfYeeeiykpCV9lJcXvvNPk51SzGTxu3AUFLYp7qGHnXcTgs8/l4rsfwhYW3ur2hBCiuWbOnMny5ct55plnatdGKgpvv/02iqLwzTffcOqpp2I2m1m5ciXp6elccMEFxMfHExISwvDhw/nuu+/qtXf4NJmiKLz++utcdNFF2Gw2evXqxeeff97i/n7yyScMGDAAs9lMUlISTz75ZL3rL774Ir169cJisRAfH88ll1xSd23+/PkMHDgQq9VKdHQ0EyZMoKqqqkX9kGRItLm6E6oTEvAWtGzKStE0om+6CVQV1WJpVlKlhIbhyc3DV1PT7Lj12lEUJlz7Zzr26QdARXGhFHQV4iTkq65u8HXw947u89V7/yDd7W742UN+9/hcrt/fd7ma3bdnnnmGUaNGcf3115OTk0NOTg6dO3cG4K677uL//u//2L59O4MGDaKyspLJkyezdOlS1q9fzznnnENKSgpZxzi7bc6cOVx66aVs2rSJyZMnM2PGjEZrlR3Nr7/+yqWXXsrll1/O5s2beeCBB7j33nt5++23AVi3bh233norDz74IDt37mTRokWcfvrpAOTk5DBt2jSuueYatm/fzrJly5gyZUqLlzzIbjJxXFCMRiw9elBTU4O3qAhDTEyz2zD37EmnF17AEBvbrOdUmw1Pbg6eoqIm70Y7lt0bfuXrZx8neVIKo6fO8EubQojjw86hpzb4fpd33sE+cgTurCzSzzlQvd1goN+WzQCUfPQReQ/9+4jnTD170OPLLwHIf+IJSt6tPVk/8sorSPjXv5rVt/DwcEwmEzabjYSEBAB27NgBwIMPPshZZ51Vd29UVBSDBw+u+/qhhx5i4cKFfP7559xyyy2Nxpg5cybTpk0DaivYP/vss6xdu5ZzzjmnWX196qmnGD9+PPfeey8AvXv3Ztu2bTz++OPMnDmTrKws7HY75513HqGhoXTt2pXk5GSgNhnyeDxMmTKFrl27AjBw4MBmxT+UjAyJ40bdCdWq0uIF1QcTIW9VFdW//NKkZxRFQbXacGdno/vprKCainIcVZWs/uQDctJ2+qVNIYRojWHDhtX7urKyklmzZtGvXz8iIiIICQlh+/btxxwZGjRoUN2f7XY7YWFh5OfnN7s/27dvZ8yYMfXeGzNmDLt27cLr9XLWWWfRtWtXunfvzhVXXMHcuXOpPjDSNnjwYMaPH8/AgQOZOnUqr732GiWt2BksI0PiuGKIisLcvQfOnTvwmUy1a3qayVNSQvY//4mvspIOjz+O6cAQ8dGooaF48vPxFJdgjI9rSdfr6f/HM8nZtZOQqGgSuvdqdXtCiONHn99+bfB95cDvK2OXLg3eE3nppURcdFEDD/5+zlrcrFnEHdwJ1sLzzxpjt9vrfT1r1iyWLFnCE088Qc+ePbFarVxyySW4jjE9ZzzsTDVFUfA18+DbpggNDeW3335j2bJlLF68mPvuu48HHniAX375hYiICJYsWcJPP/3E4sWLee6557j77rtZs2YN3bp1a3YsGRkSxx1jh0SMXbq0eEG1FhFRu2Xf42ny2UOKpqEYjbhzc5p9mnVjxl19IyMvnIqiqng9HjmhWoiThGqzNfhSNA0ARVXrvX+QYjQ2/KzV+nvbJtPv75tMLeqfyWTC24TfnatWrWLmzJlcdNFFDBw4kISEBDIzM1sUsyX69evHqlWrjuhT79690Q78LA0GAxMmTOA///kPmzZtIjMzk++//x6oTcLGjBnDnDlzWL9+PSaTiYULF7aoLzIyJI47iqpi7toVX3U13oJ8tGaeUK0oCtHXXkt2airWoUOhiQvqtPBwvEXFeMvKMERGtrT79foBtQupv3z6P8R07sJZ1zc+Dy+EEP6QlJTEmjVryMzMJCQkpNFRm169erFgwQJSUlJQFIV77703ICM8jfnHP/7B8OHDeeihh7jssstYvXo1zz//PC+++CIAX375JRkZGZx++ulERkby9ddf4/P56NOnD2vWrGHp0qWcffbZxMXFsWbNGgoKCujXr1+L+iIjQ+K4pJhMWHr2RA0NbdEJ1YbYWDq99BIRU6bUfVo7ZkyjEd3nxdOCue+jKdq3l+zU7Wz6bhFbly/1a9tCCHG4WbNmoWka/fv3JzY2ttE1QE899RSRkZGMHj2alJQUJk6cyNChQ4PWz6FDh/LRRx/xwQcfcMopp3Dffffx4IMPMnPmTAAiIiJYsGAB48aNo1+/frz88su8//77DBgwgLCwMFasWMHkyZPp3bs399xzD08++SSTJk1qUV8UvZn70FasWMHjjz/Or7/+Sk5ODgsXLuTCCy886jPLli3j9ttvZ+vWrXTu3Jl77rmn7pttivLycsLDwykrKyMsLKw53RUnOE9RETVbt6IYTWihoS1qw52fT/WaNYSnpBzzXl91NT6nA1vyULQQ+zHvb6rV89/np4/nYjCamPbvJ4hL6u63toUQQrROs0eGqqqqGDx4MC+88EKT7t+9ezfnnnsuZ555Jhs2bOC2227juuuu49tvv212Z0X7Y4iOxty9R4tPqPZWVJD9j39Q8s471GzceMz7VZsN3eHEU1TYku426rQpl9FtyKl43C6++O+jOKtbdjCYEEII/2t2MjRp0iT+/e9/c1FDK+Ib8PLLL9OtWzeefPJJ+vXrxy233MIll1zCf//732Z3VrRPrVlQrYWGEjJuHABFr77apIRKtdvx5OS06MCzxiiqyqRb/kFoTCyluTn88M5rfmtbCCGOBzfddBMhISENvm666aa27t5RBXwB9erVq5kwYUK99yZOnHjUInJOpxPnIX9plfuhbpQ4cSmqijkpCV9NTYsWVEdefjnVq1fjycuj7JNPiJw+/aj3qyEhePJy8RYXox44tMwfrKFhnP/32ayY+xZjLv2T39oVQojjwYMPPsisWbMavHa8L3EJeDKUm5tLfHx8vffi4+MpLy+npqYG6yFbCg969NFHmTNnTqC7Jk4gismEuUdPHA4H3uJiDNHRTX5WtVqJuu46Cv7zH8o++wz7H/6AqUuXxmOpKorJjDs7G0NsbJMXYDdFQs/eTL3vkbpkzu1wYLRY/Na+EEK0lbi4OOLiWn9OW1s4LneTzZ49m7KysrrX3r1727pL4jighdhrzw9Cb/YJ1fYRI7AOHw5eLxVNWK+mhYXhLS3FW1rass4ehaIo6LrO2s/m8+ZtN1BZ3PzdckIIIfwn4MlQQkICeXl59d7Ly8sjLCyswVEhALPZTFhYWL2XEFC7oNrUo2ULqqOvvZao664j6pprjnmvYjSi6+DJzW1pV4/K43axY+UyKkuK+fKZ/7S4uKAQQojWC3gyNGrUKJYurX+2ypIlSxg1alSgQ4uTlKlDB4ydm7+g2hATQ9g556BoWm1V6WNUqdfCw3EXFbW4TtrRGE1mUm6fTVhsHMPPv7hZa6CEEEL4V7OTocrKSjZs2MCGDRuA2q3zGzZsqDvUafbs2Vx55ZV19990001kZGRwxx13sGPHDl588UU++ugj/v73v/vnOxDtjqKqmLslYYiPx1uQ3+xRFff+/eTedx9FL7981PtUiwXd6cRT4N9t9gdFJnbkmqdfpcepIwD8VgZECCFE8zQ7GVq3bh3JyckkJycDcPvtt5OcnMx9990HQE5OTr3TLrt168ZXX33FkiVLGDx4ME8++SSvv/46EydO9NO3INqjgwuq1ZBQvMXFzXrW53TiTE2latUqqtevP+q9akgo7twcfA5Ha7rbKO1AIcbs1B28PetmivbL+jghhAi2Zp9A3RbkBGrRGE9RETVbtqCYzM06obr47bcp//JLQs89l+irr270Pl3X8eRkYx0wAGPHjv7ocoPmP3wvezatJ7pTF6Y//CQmS8Pr6YQQItCSkpK47bbbjnoEzsnmuNxNJkRTGaKjMXXv3uwF1RGXXUbcv/511EQIand+KVYbrpxcdI+ntd1t1KSbb8ceGUXS4GQ0gzFgcYQQQhxJqtaLE56pY0f06hpcmZkoCQlNOhdItVqxHShI6HO58FVUNHp2kRYWhrewAG9JCYbYWL/2/SB7RCRXPfEC1pCW1V8TQgjRcjIyJE54rVlQ7czIIPv22yl48slGFzArmgaqhis3N6Bb4A8mQo7KSj5/8hGyU3cELJYQ4uT06quv0qFDB3yH/T674IILuOaaa0hPT+eCCy4gPj6ekJAQhg8fznfffdfieE899RQDBw7EbrfTuXNn/vKXv1BZWVnvnlWrVjF27FhsNhuRkZFMnDiRkpISAHw+H//5z3/o2bMnZrOZLl268PDDD7e4Py0lyZA4KSgmE+aezV9QrYWH4y0rw5maSsWSJY3ep4aF4S0qwldW5o/uHtVPH89l19qf+OLp/6O6PPDxhBDN43Z6m/TyemsTEq/HV/u1u/Zrn9fX5Daaa+rUqRQVFfHDDz/UvVdcXMyiRYuYMWMGlZWVTJ48maVLl7J+/XrOOeccUlJS6m18ag5VVXn22WfZunUr77zzDt9//z133HFH3fUNGzYwfvx4+vfvz+rVq1m5ciUpKSl4DxyLMnv2bP7v//6Pe++9l23btjFv3rwjqlYEgyygFicVT2EhNVu3opgtaCEhTXqm/OuvKX7zTRSbjY7PPIMhMrLhtnNzMHbtiqVXL392+QjO6mrm3n07Jdn76DJwCBf/aw6q6r+SIEKI1nnhpu+bdN/pl/dm4NhOrP0ig1++yuSUMzpyxrQ+pP2az7evbWlSGze/PK7Z/bvwwguJjo7mjTfeAGpHi+bMmcPevXtR1SPHQE455RRuuukmbrnlFqB1C6jnz5/PTTfdRGFh7ZEk06dPJysri5UrVx5xb0VFBbGxsTz//PNcd911zY7lTzIyJE4qhpgYTN2746uoaPKC6tCJEzH17IleXU3xW281ep8SGoYnLx9fdbW/utsgs83G+bfPxmA2k7V5A6s/nhfQeEKIk8uMGTP45JNP6gqez507l8svvxxVVamsrGTWrFn069ePiIgIQkJC2L59e4tHhr777jvGjx9Px44dCQ0N5YorrqCoqIjqA78nD44MNWT79u04nc5GrweTLKAWJ526BdV79qDExx9zQbWiaUTfeCM5d95J9U8/UT12bN3i6kOpNhuenBzcRUWYbbZAdR+AmM5dOfuGv/L1c0/w84IPSezVl+5Dhwc0phCiaW545owm3acaak+WP3VSEslnd0VVa7/uPiSmyW20REpKCrqu89VXXzF8+HB+/PFH/vvf/wIwa9YslixZwhNPPEHPnj2xWq1ccskluFyuZsfJzMzkvPPO489//jMPP/wwUVFRrFy5kmuvvRaXy4XNZmu07BZw1GvBJsmQOOkcXFDtq6nBW5CPFp9wzHIX5m7dCDvvPHxVVZgbmQZTFAXVbseTnY0pIQHFGNgt8P3+MJbs1O1kbdlEeFxCQGMJIZrOaG7etLVmUNEO+dtW1VQCOfNtsViYMmUKc+fOJS0tjT59+jD0wAe8VatWMXPmTC666CKgtqpEZmZmi+L8+uuv+Hw+nnzyybrpt48++qjePYMGDWLp0qXMmTPniOd79eqF1Wpl6dKlbT5NJsmQOCnVLqjugcNRg7e4uNFt84eKvOKKYyZNakgInvx8PMXFGIOwyG/sldfh9XjkEEYhRLPMmDGD8847j61bt/KnP/2p7v1evXqxYMECUlJSUBSFe++994idZ03Vs2dP3G43zz33HCkpKaxatYqXDytzNHv2bAYOHMhf/vIXbrrpJkwmEz/88ANTp04lJiaGO++8kzvuuAOTycSYMWMoKChg69atXHvtta36/ptL1gyJk5YWEoK5Z0/QdbyHbfVsyMFEyFddTdGbb+LcvfvIezQNxWjEnZMblFpimsFYlwht+WEJS988ej01IYQAGDduHFFRUezcuZPp06fXvf/UU08RGRnJ6NGjSUlJYeLEiXWjRs01ePBgnnrqKR577DFOOeUU5s6dy6OPPlrvnt69e7N48WI2btzIiBEjGDVqFJ999hmGA6WI7r33Xv7xj39w33330a9fPy677DLy8/Nb/o23kOwmEyc95969OHfsRIuKQjWbj3l/4SuvULlkCaaePUl8+OEj1hzpbjfekhKsyUMa3Xnmb0X7snhn1i3ouo+zb7qVgWeeHZS4QgjRHsjIkDjpmTp2xNSlM96iInTvsc/tiJg6FcVqxZWWRuXy5UdcV4xGdN2HJy8vEN1tUHSnLoy+dAYGowlNk9ltIYTwJxkZEu2Cz+XCsW073sKCJi2orliyBG9pKeEXXtjgQmlfTQ2+mhpsQ4eihdgD1e16dJ+P0rwcIhMDVzBWCCEOmjt3LjfeeGOD17p27crWrVuD3KPAkWRItBveykpqNm9Gd7mbtKD6WNw5OZh79cSclNT6zjVT0b4sNi39lrFXXIvSwCFqQgjRWhUVFeQ1MgJuNBrp2rVrkHsUODLeLtoNLSQES69e1GzZireyskknVHsKCyl64w1Cx4/HNmxYvWuq3Y47Jwdjhw6oJlOgun0El6OGDx64C0dFObbwCEZeODVosYUQ7UdoaCihoe2jeLR8pBTtSu0J1d2afEJ1xbffUvPLLxS9/jq+mpp619SQEHyVlXiLigLV3QaZLFb+OO0qAEqy9we0eKwQQrQHMjIk2h1Tp07oNTW49mQd84Tq8IsvpmrVKjz5+ZR+9BFRV11Vd01RVRSzBXdODoa4uGOedO1PA8edTUR8Ap0HDDrm+ichhBBHJyNDot1RVBVTt24Y4mLxFhYcdWRFtViIOnAyavlXX+HMyKh3XQsLw1tSgre0NJBdPoKiKHQ5ZTCKouB2Oliz8CO8HndQ+yCEECcLSYZEu6SaTJh79kSx2fCWlBz1XtvQodhGjwafj6JXX623PV8xGNAVBU9ubptMV+m6zsL/m8PKD95lxXuNF5kVQgjROEmGRLulhYRg6dkTfD68VVVHvTfq6qtRbLbae8vL67cTFo67sBBvURE+lyuoSZGiKAw990IAfvvmc3b8tCJosYUQ4mQhyZBo1wyxsbULqsvL8R2larMhMpLEBx8k8dFHjzh1WrVYwOulZvNmqtf+QvWvv+LYvh3X3r248/PxlpXhczgCliT1HDaSEQd2lC1++VmK9u0NSBwhRPuQlJTE008/3aR7FUXh008/DWh/gkEWUIt2r6kLqk0HzhPSdR3H5s1YBw2qu2aIi0f3eNDdbnSnC3dFJXiz0dFRVA3FZEQxmVBDQtBCQlDMZlSzGeXgq5VnBY259E/kpu0ka8smPn/yYWY88hQmq61VbQohRHshyZBo9w4uqPZVV+MpyMeYkNjovbrPR97DD+PYuJG4O+/ENnz47+0YDCgGA1jrV5jXvV50lwvd7caTX4AnO7v2gqqC0YhqNKHabaihoagWS/1EqYk71FRN49xb7+B/d96K2+mkoqiI6E6SDAkhRFPINJkQHFhQ3asXqt2Op7i40fsOJk5Ag2cPNfiMpqFarWhhYRhiYjAkJGJISESLjkG12tB1HU9xCc60NBxbtlDz629UrfuV6l9+oXrjRpwZGbhzcvAUF+OtrEL3eBqMYwuP4KK7HuBP//c00Z06t+wHIYQ4ob366qt06NABn89X7/0LLriAa665hvT0dC644ALi4+MJCQlh+PDhfPfdd36Lv3nzZsaNG4fVaiU6OpobbriBysrKuuvLli1jxIgR2O12IiIiGDNmDHv27AFg48aNnHnmmYSGhhIWFsapp57KunXr/Na3o5GRISEOOLigumbrVrxVVWj2hmuORUydSvVPP2Hs0gXd5TpiJKipFE2rHfmxWOq9r/t8tdNtLhe+snI8hUWg+1AAjAem26zW2ik3qxXl4GiSyURcUve6dtLWrcEWFkaH3v1a1D8hRMPcDkeD72smI6qqoft8eA6sQVQNGprBWO85RVUxHDi13u1ygu/I9YSHPtccU6dO5a9//Ss//PAD48ePB6C4uJhFixbx9ddfU1lZyeTJk3n44Ycxm828++67pKSksHPnTrp06dLseIeqqqpi4sSJjBo1il9++YX8/Hyuu+46brnlFt5++208Hg8XXngh119/Pe+//z4ul4u1a9fWnZU2Y8YMkpOTeemll9A0jQ0bNmBsoDZkIEgyJMQhahdUd8e5MxXFaGywzIZqNpP46KOoYWEBOfCw9jBHM5jN9d7Xdb0uSfJWVOIpKv49STIYUUxGVIsFNSSE9NTtLPrfa4RERjHjoSewx8TK4YxC+MmzV13S4PuX3vcInQcMojQvhzdvqy1wevqMqxl+/sUAvPLnq3BWV9F75BhSbp8NwKf/eYiszRuOaGvkRZfyh8uvbHbfIiMjmTRpEvPmzatLhubPn09MTAxnnnkmqqoyePDguvsfeughFi5cyOeff84tt9zS7HiHmjdvHg6Hg3fffRf7gQ+Tzz//PCkpKTz22GMYjUbKyso477zz6NGjBwD9+v3+YS0rK4t//vOf9O3bF4BevXq1qj/NIdNkQhzG1KkTps6d8BYV1jtT6FBaeDiKoqC73ZR/+22j9/mToiioJhNaSAiGyEiM8fEYExLR4hNq+6MZ8FZV49q3nwTNSER4JFWlJWR89QXVv/6GY8cOXPv2/b7DzemUUh5CnIRmzJjBJ598gvNAyaG5c+dy+eWXo6oqlZWVzJo1i379+hEREUFISAjbt28nKyur1XG3b9/O4MGD6xIhgDFjxuDz+di5cydRUVHMnDmTiRMnkpKSwjPPPENOTk7dvbfffjvXXXcdEyZM4P/+7/9IT09vdZ+aSkaGhDiMoqqYunfHV1Nz1AXVuq6Te//9OFNTweMh7Nxzg9zTWoqi1E6fGY2oB34JGYFzpl1NTXkZiYmd0J1O3BUV6N7a9Ua1O9xMKGYTqt1+YIebBdVs8tsONyFOVre+M7/B9zVT7ZRORHxi3T2q4fdNEDe+9A5Avf+3Lrzj3kanyVoqJSUFXdf56quvGD58OD/++CP//e9/AZg1axZLlizhiSeeoGfPnlitVi655BJcRzlaxJ/eeustbr31VhYtWsSHH37IPffcw5IlSzjttNN44IEHmD59Ol999RXffPMN999/Px988AEXXXRRwPslyZAQDTh4QrXP4cBTXIwhKuqIexRFIWTsWJypqZS8/z7mPn0w9+zZBr1tWFRsPMTGA1BRVkp5VTkdk2qHput2uLlceKpqd7jpHPglfWB6ULWHoIbYW7zDTYiTlfGwdX6HU1S1wXsafM9kPuK91rJYLEyZMoW5c+eSlpZGnz59GDp0KACrVq1i5syZdQlGZWUlmZmZfonbr18/3n77baqqqupGh1atWoWqqvTp06fuvuTkZJKTk5k9ezajRo1i3rx5nHbaaQD07t2b3r178/e//51p06bx1ltvBSUZko9+QjRCCw3F3KMH+LyNnlAdMmEC5r590R0Ocu66i/ynnsJ9yLDv8aA4P5ePX3uGbz56l7LiIuCQHW7h4XU73IyH7nDz+vAUFdXucNu8mZrfft/hVrN5M86M3XU73HxVje9wE0K0jRkzZvDVV1/x5ptvMmPGjLr3e/XqxYIFC9iwYQMbN25k+vTpR+w8a01Mi8XCVVddxZYtW/jhhx/461//yhVXXEF8fDy7d+9m9uzZrF69mj179rB48WJ27dpFv379qKmp4ZZbbmHZsmXs2bOHVatW8csvv9RbUxRIMjIkxFEY4+Lw1dTgTN3V4IJqRVWJmzWL4nffperHH6n+6Se0sDCiDxR3PR6ER8cQHh1D3r4stqz7iTFnpzR6b1N2uHmKS9Dz8gG9dvG2yVT7szlwfMDBkaS60aQg7QYRQvxu3LhxREVFsXPnTqZPn173/lNPPcU111zD6NGjiYmJ4c4776T8sBJDLWWz2fj222/529/+xvDhw7HZbFx88cU89dRTddd37NjBO++8Q1FREYmJidx8883ceOONeDweioqKuPLKK8nLyyMmJoYpU6YwZ84cv/TtWBT9BFhBWV5eTnh4OGVlZYSFhbV1d0Q7o3u9OFNTce3bhyGu8ROqXZmZlH78MdHXX48WEYG3ooLyL78kLCUFLSQkyL2ur7K8lF1bNjJk1B9RFP8NCOu6Xneg5MFkCd8hxwCYTahmc+0xAHb770mS3S5rkoQQxw1JhoRoAp/LhWPrVjzFxRjjE5r0TPH//kf5Z5+h2u1EXH45YZMmBbiXTePzeSnI2U98x9adKXI0uq6Dx1NbuPZAsoTXAygoRiPGzp0wd+smCZEQ4rggv4mEaIKDC6pVmw1PSUmTnrEMGICxSxd8VVX1Tqpuy88fLqeDz//3Gp++8woFOfsDFkdRapMezW6vPQYgLg5jYgeMiYmodjuujN24srJka78Qx7G5c+cSEhLS4GvAgAFt3T2/kpEhIZrBnZ+PY+tWVJu9bhv70eheL1WrVmEbORLVbMadm0v+Y48RMXUqttNOC/rIiK77+ObDd8nctZ3QiEimXncrljYo6OqrrsZXUY6pd2/MnaV0iBDHo4qKCvLy8hq8ZjQa6dq1a5B7FDiSDAnRTM49e3Cm7kKLjm7whOqjKXzlFSqXLAHA1L07kTNmYBk0KKinQztqqpn/xnOUlxTTtVdfJl92lV/XETWVt7ISvboaS7++GBMbL44rhBCBJtNkQjSTqVMnTJ06HvWE6sZEXXklEZddhmKx4MrIIO+hh8ibMwdnEE9atVhtTLz4T2iagT27dvDrymVBi30oLSQExWLBkZqKOy+/TfpwPKoud5G5qZA1n2fgcsiRBUIEgyRDQjSTommYunfHEBODp7CgWc+qVisRU6fS6YUXak+sNhhwbNmCyw9H4TdHbGJHTp98IQCb167E6ag5+gMBooWFgarh3JWKp6ioTfrQllwOD9m7SigvrP35//RJGm/dsZKvXtzEuq8zKdxb0cY9FKJ9aFEy9MILL5CUlITFYmHkyJGsXbv2qPc//fTT9OnTB6vVSufOnfn73/+Oo5Gqv0KcCFSzuXZBtdXa5AXVh9LCw4m6+mo6Pfcc4RddRMjppwPgTE2l8KWX8BQW+rvLR+g3ZDinjZvEJdf+FbPFGvB4jTFERqJ7fTh27mzRz/JE4fX6KNhbwdYf91OaVw3Asrk7WfjkelJ/qV2XERFvAwUiE+30HZWA0SJHwQkRDM3+P+3DDz/k9ttv5+WXX2bkyJE8/fTTTJw4kZ07dxIXF3fE/fPmzeOuu+7izTffZPTo0aSmpjJz5kwURak7iEmIE5EWGoq5Z08cW7fiq6pq0oLqwxliY4k85HTYknnzcGzZQuWKFURddRVh55zjzy4fYeiYsXV/zs/eR3R8ApoW/L+ADdHReAoKcO5MRenfr3bE6ASm6zrlhQ7yM8vJyywnP7OcgqwKPO7ak37/MLUXEfE24pPCyEkr5eCSsZ7D4uh5ahwmqyRBQgRTsxdQjxw5kuHDh/P8888D4PP56Ny5M3/961+56667jrj/lltuYfv27SxdurTuvX/84x+sWbOGlStXNimmLKAWx7PaBdWptaUsmrmg+nCOnTspmTsX57ZtxN93H9ZBg2oPNnQ6UY9RD6k1tvz6Mz9+8xmnDDuNP55zQcDiHI2u63jy89HCQrH0648W0vzksq2t+yaTnLQy8jPLcVS5j7hushqI6xpK/z90oNeweHw+HVUN3uJ5IUTDmvXxw+Vy8euvvzJ79uy691RVZcKECaxevbrBZ0aPHs17773H2rVrGTFiBBkZGXz99ddcccUVreu5EMcJU6dO6NXVuPbtg4hIVGvLp5wsffqQMGcOztRULAcKG1avWUPR668TcfHFhE6YEJDyFiGh4ei6j82//ES/IcOJSejg9xjHoigKhrg4vHm5OFN3YunXr1U/y0DxuLwYTBq6T2fJm1vJ3V3O1LuGYQ01sXtDAfl7atf5qAaF2M6hxCWFEd+19p8RcTaUQ5IfSYSEOD40KxkqLCzE6/USHx9f7/34+Hh27NjR4DPTp0+nsLCQP/zhD7Wf/DwebrrpJv71r381GsfpdOJ0Ouu+9lfdFCECQdE0zL16oZgtuDIz8TkcGCIjW96eotQlQgCV33+Pr7SU4jfeoPzLL4m4/HLsY8b49YyipN79OG3cOUREx7VJInSQoihocfF48nJxpKZi6dsX1ez/qt5N5fP6KMquqjfdVZJbzbVP/hGTxUDhvkoqihzkZZaTNDCGQWd2wuXwEt8tjOiOIWgG2aMixIkg4BPTy5Yt45FHHuHFF19k5MiRpKWl8be//Y2HHnqIe++9t8FnHn300aAVZxPCHxSDAVO3JFS7HWd6Gu68XAwxsY3WMWuOuH/+k4qlSymdPx9PXh6FzzxD2WefEXPDDZh79/ZD72sNHXNm3Z8d1VWomgFTGyQiiqpiiIvHk5+HUzNg6d0LpZXTj01xrHU+hyrcV0mHnhGMntITg0klLql2+r7PaXJekhAnomatGXK5XNhsNubPn8+FF15Y9/5VV11FaWkpn3322RHP/PGPf+S0007j8ccfr3vvvffe44YbbqCyshK1gU+3DY0Mde7cWdYMiROCt7wcZ3o6nsJCtKhov41s+BwOyr/6irLPPkOvqaHD449jSkpC13W/HtqYn7OPRR//j/gOnTn74hlBPRDyULrHgyc/D1PnzrUjbwb/fnZz1XjITivF7fDSa3g8BVkVfPTIL0fcZ7JotVNdSWF1/7RHtN1olRDC/5r128VkMnHqqaeydOnSumTI5/OxdOlSbrnllgafqa6uPiLh0Q58Wm4sDzObzZjbcGhciNbQwsKwDBiAa/duXFl70UND/VK1XrVYatcNnX02NRs3YkpKAqBi0SJqNm4kcvp0TF1aX3zV5/VSXVFB+vbN7Nqygd4Dk1vdZksoBgOG2LjatViqhrlnjxaPtLmdXgr2VpCfWY5mUBk4thOF+yr56oVN2CPM9BoeT1RHOyaroW6XV3xSw+t8hBAnn2Z/1Lr99tu56qqrGDZsGCNGjODpp5+mqqqKq6++GoArr7ySjh078uijjwKQkpLCU089RXJyct002b333ktKSkpdUiTEyUY1mWpHM2w2XBkZeJxOtKgov4yyaKGhhPzhD0Bt7bOyhQvxFhdT8+uvxNx8MyFjx7aq/YROXRlz9nmUFhXQo//AVve3NRSjES0qGlfWHhSjAVNS0jHXSvm8PopzqsjbXTvVlbenguLsKnRf7YeviHgbA8d2IrZLKJGJduK6huJ1+9CMKtc+8QdUTdb5CNHeNDsZuuyyyygoKOC+++4jNzeXIUOGsGjRorpF1VlZWfVGgu655x4UReGee+5h//79xMbGkpKSwsMPP+y/70KI45Ciqpg7d0az2XCmpeE5uI7Ij9M9iqYRf//9lL7/PjXr12MZNAgAX1UVuseDFh7eonYHDh9d92dd13G7XG2yfghqD7gkIhJXRgZoGqYuXeqSSl3X8Xl1NINK2q/5bPphLwV7Gl7nYws31Y74dAtD13WMZo3p94+sH0sSISHaJSnUKkQQ+KqqcGRk4MnJQYuMCsiWcU9JSd0utpK5cyn/5hvCzz+fsJSUFsdzOmr4/vOPcTpqOP9P16GqbTea66uqorq4EnPPHoT16sr6xVn8tngPg87sxPBzu7FtVTY//K92V6vJohHbNezAdFftWp+QSJl6F0I0TI45FSIIVLsda9++OK1W3FlZ6C5Xi0dtGnMwEdJ1HcfOnegOB6UffUT5okV1a42ae0ZRdWUl+3bvwu1yseaHxYwaP8mvfT4aj1unqNBNQV7tqzDPQ0U5DBuSztAQE6pBwVHprjvXp3O/KMbP7Ee8rPMRQjSTjAwJEUS6ruPJy8OZlo7P5aydNvPjeUF1cXw+qn/+mZL338eTkwOAFhtL3B13YO7WrVltpW3bxOJP5gJwztQr6d53gN/7C1BS5KlLfAry3JQUeWjot1O/vhrDk8HbsSdOLZSYTiFoRpneEkK0nIwMCRFEiqJgTEhAtVhwpKX/vo7Iz6dKK6qKffRobCNGUPnDD5R+/DG604kxIQEAn9OJYjI1aUF3z/6DyNu3h41rVvL95x8SHXcr4VExre5jZpqD/Dw3A5PtWG0qP35fRmGep949VptKbLyR2HgjMfEGYuKMmM1q7ZRg7m5C+vWTREgI0WoyMiREG/E5HLXb7/ftQw0LR2tBodcmx3I6ce/bh7lHDwAKX3gBd3Y2kTNmYOnf/5jPe71ePvvfq+TuzSS+UxemzPxLs3bGeTw6+/Y42ZvpZPTYMDRNYcG8QkqLvUw4N4Iu3cys+6mCgjw3MQeSn9h4Iza72mgcT1ERismItV8/tIiIJvdFCCEOJ8mQEG1I93px7duHa/duUDW0yMiAH3Lorahg35//jO5wABD3r39hGzr0mM9VVZSzZOH7nH7OBUTFJRzzfrfLx949LvakO9i7x4XHXfur5qyUCDp3NbNhXSXVVT5697MSE9eykTF3fj6a3Yalf3+00NAWtSGEEJIMCXEc8BQU4EhLQ6+qQouN80sZj6PGKy6mbP58HDt20OHxx1E0Dff+/WAwYDys9mBjXE4HJrOl/nsuH3t3O8lMd7JvjxOv9/dr9lCVpB4W+g6wEh7pnxn62kr3eWjhEVj79UUN4OiaEOLkJcmQEMcJb2VlbRmPvDy06JigFCjV3e669Uq5Dz6IY9s2QidMIOKSS4469bRz02+s/PZzUmZcR1yHTui6zg+Lysja7cR3yBE/oeEaST3MdOthITrOEJBRL93nw5ufhxYdXVvY9TisdC+EOL7JAmohjhNaSAjWfv1w2my49+xBt9nRApz8H0yEfA4HqCp4PFQsWkTlsmWEnXsu4eeff8Roi67rZOzYgtNRw6fvvsPU6/5OZIwNr1fH54PwCI2knhaSepiJiglMAlTve1BVtNg4PPl5x0WleyHEiUdGhoQ4zui6jicnB0d6Oni8aNHRAdl+35CaLVsomTsX165dAKghIXR4/HEMsbFUV3nZk+GkW08LiuLk3WefR9eSGT1+FKcMsVNU4EZVFSKitDYp7qp7vXjy8zAmdghapXshxMlBkiEhjlOekhKcaWl4S0oxxPp/+31jdF2neu1aSt9/H2dEIjUX3kJmhpO8bDcAfxgXRu/+VtJTq6gsh269zISEqkcUZG4LutuNpyA/YJXuhRAnJ0mGhDiO+WpqcKZn4M7JRguPQLXZAh6zotxLZrqDzDQHBYed+xNes59TTjHQ+5yBdaM/JYUFfPvJe4yeMJkuPfoEvH/H4nO58BYWYkrqirlHyyvdCyHaD/nYJMRxTLVasfTtg2qz4crMxOd01pXd8LcdW6rZubWGooL6CVB8opHOMQ4s7z2GqWQ/rAH3Kf/F1LkzAFt+XU1xfi7fLfyAqdffSmh4YPrXVKrJBNHRuPbsQTE0rdK9EKJ9k2RIiOOcYjBg6paEarfjTE/DffDU6laOeJSWeMhMc9C5m5noGCNFBR6KCjwoCiR0MJLU00LX7mZs9to4vmGPUPbFF3hLS+sSoerffmNo977k7s0kIioWizXwI1dNcbRK90IIcThJhoQ4ASiKgjE+DtVmxZmWdmD7fXSzdk3puk5xkQerRcUWorF+bSW7dzlxuXSiY4z0GWAlJs5Al+4WrNYjR1JUu53Iyy+v+9rndFL00kt4S0oYPeo0YiefgdF0/OziUq1W8PlwpaejaAZMnTq2dZeEEMcpSYaEOIFooaFYBgyoLeORtRc9JOSoJy/ruk5Rvqd2DVC6k/IyL0NH2hkyPITuvSx4XDpxCbULs2PijM06CVp3OrEMHEjVjz/iXv0z2WvWYh13Jltjw+jYqx99Bh37VOtAU+12dJ8P565UFINWV5tNCCEOJQuohTgB6T4frv37a8t4+PTa7fcHpoF0Xacg101mupPMdAeVFb+fgqhp0H+QjeFj/Fe6wpWZScm8edT89ht7osPY2ikWg8HIxdfcTHR8ot/itIa3rAzd68Harx+G2Ni27o4Q4jgjyZAQJzBPcXHt9vvyckr1SNJ3uchMd1Jd9XsCZDBApyQzST0sdO5qwmgKzGJix7ZtFM99j58jLOQ6qgiPiiHl9ImE9O5zXByC6CkpQVEULP37YYiKauvuCCGOI5IMCXGC8nl97N9ViknxEOrK49fvc9m0vXaxs9Go0LmbmaQeZjp1MWMwBmfxsK7r1JSXMf/tF6ksLyOhooZhpQ4ip04l5Mwz2/zcH09hIYrZJJXuhRD1yH5TIU4gXo8PR1Xt4YdrvtjN509vYNOqAqx9+9JrdGd6JMG4sUamXRvL2LPDSephCVoiBLULvW3hEUy85ApUVSU31Eqa5qVk3jx0pzNo/WiMISYGn8OBIzUVb0VFW3dHCHGckGRIiOOcx+1l96ZClr69jbfuWMmazzMA6DYoBovdiDXUhGI0Ej+sD+Nn9qdzJxW9OB/90IqpQRbfsTN/mHg+9pBQup45gcgZM+pqnJV9+inOtLQ265shJhZvRQWOnan4qqrarB9CiOOHTJMJcRxyu7xkbS0i/bcCMjcX4nZ4665Fdwrh8ntGoPt0dF1H1ep/pvGWleHYlYa3pKR2+30b1ejSdR2X04HZ8nsVedf+/WT//e8AhJ13HhGXXdYm64nqVbrv1w/VYgl6H4QQxw9JhoQ4TrgcHvZsKSL9t3z2bCnC4/p9ZMceYaZHciw9hsaS0CMCVT361JfP6cSVkYFr337UsDC0wyrPB9ueXTvYtn4t4yecR9m771K1ciUAhoQEom+6CesppwS9TwcLuxri42sr3UthVyHaLUmGhGhDzhoPNeUuIuJtbP1xP8vm7qy7FhplocfQWHoMjSM+KQzlGAnQ4XSvF9e+fbh2Z4KioEVFtckpzE5HDf979v9wOR0MGXU6oyecS/W6dRS9+ire4mIAwi++mMhp04Let3qV7vv0DloxXCHE8UUOXRQiyHSfjqIqpP+Wz+I3t5LYI4IL/55M9yGxbPhuL92H1I4AxXYJbVXyomga5q5d0ez22u33eblosXFBL1xqtlg5M2Uqiz+Zi8VaO0JlGzYMS79+FL/3HpVLlmDq1i2ofTpI0TQMMbG4s/ejaKpUuheinZKRISGCoLrcxe6NBaSvL8Bk0TjnhoGUF9bwv3tWE9XBzqX/Go5mCNx+Bm9lFc70A2U8oqLbZI1MWXER4VHRABQX5BEZE4uiqLj27MHUtSsAjh07qPj2W6JmzkQLDw9a3+oq3XdLqq10L4VdhWhX5COQEAFSVeYkY30B6evzyU4t5eDHDs2o4nZ5CYuxMuPB04iIC3xxUy3EjrVfP5w2G+49e9BtdrQgf7A4mAjVVFex4K0XCI+KYcxZ59Gha3egdlFz0Suv4N67l5qNG4m5+WZsp54alL7VVbrP3FNbx6xbkhR2FaIdkWRICD+qKHbUJUA56WVwyLhrbJfQ2jVAyXEYTbVTVcFIhA5STCbMPXui2e040tPxFBTUlvEI8ihIYe5+dB0KcvZTXJBXlwwpqkrMzTdT+OKLuPfuRT1KzbVAqK10H4ErIx0MGqbOnSUhEqKdkGkyIVpJ13UURSF7VwkLn1xf71p8tzB6DI2jR3IsYTHWRloIPk9JCc70DLwlxRhiYoO+cLimqpLN61Zz6h/GoWkahXk5bPx5BSPGnk2ILQTH1q1YhwwBoOrnn/FVVBAyYUJQkhNfVRW+6iosvXtj7CiV7oVoD2RkSIgWctZ4WP/tHvKzKkj562Dik8Ix2wxEdbDXJUAhkcfn+TWGyEjUAf1rt99nZ6OFR6DagjdKZbWHMOKMs+q+/vn7b8hK20na1k0MHDGaoWPOBMBbUUHRq6/iKy+natUqom+8EWNiYIu/Hqx079i1CzSpdC9EeyAjQ0I0k9frQ9NUqsqcvHfPajxuHxf+PZmOfSJxOTyYLCfOZwzd48G1dy+uzEwwGDFERrZJP/Ky97L6u6/J3lN7urbZYmXoH87klKEjqV7yHaXvv4/udKKYTERcfjlh554b8F1xtZXuvVj79ZVK90Kc5CQZEqKJ3E4vm5ftY8PSvUyZNZSIOBubfthHSKSZboNjTuj1Je68fJwZ6fiqqjC0wfZ7qJ1uzErbyeql31BckAvA5MuuIql3f9x5eRS9/DKOzZsBMPfpQ8KDDwa8n57iYhRVxTKgf5slikKIwJNkSIhj8Li9bF2Rza+LMqmpqC2SOuSsLoy5uGcb98y/vBUVONPS8BQU1pbxaIMyGQA+n4+dm34lKz2Vs6dMR1EUcvZm4nI6iczcS8m77xI2aVLQDmmsq3Tfv39Qt/sLIYJHkiEhGuH1+Nj+Uw7rvs6kqrS24npYjIXh53Wj9/D4I2qCnQx8Lheu3btxZe1FDQlBC/KOrobouo+PX3+OwtxsOnfvxcSJF2IMD0cxGvGUlFDw5JNEXXkl5t69A9YHd34eWkgIlv790UJCAhZHCNE2TpzFDUIEic/rY+eaXH75KpOKIgcAIZFmhk1Oou/oRLSTMAk6SDWZak9htttxZWTgKawdJWrLKUCvx0vHpB4UF+RhDwvHFBMDgMfjpvT993Hu2EHO3XcTfsklRF52WUD6YIiNw5OXi2PHTqz9+wV1sbkQIvAkGRLiEAVZFXz7+hbK8msAsIWZOHVSV/r/oQMGY/DX0bQFRVUxd+qEZrPVTpvl5dZuv2+jMhUGo5ExZ53HwOGjMRhqjwBwOR28/9KTdO/Zl25/GINn5SoMUVEB64OiKBji4msTop07pdK9ECcZSYZEu6frOvl7KohPCiMk0kx1mQtLiJGhZ3fllLEd6w5IbG8MUVGop5xSe0Bjbi5aRCSqte3OSgqL+D3ZSdu2iaqKcjavX0voWefS95xJmPv0AcCVlUX5N98Q+ac/odntfouvqGptQpSfh2PXLix9+kileyFOErJmSLRrbpeXhU/8RsHeCqbdN5KoRDv7d5YQ2zX0hNoiH0i6x4MrKwtXZiaKyYwWEdHWXQIgKz2VLb/8xNmXzMBgMFJaVEj2ngwi5i/ElboLLSqK6OuvxzZ8uF/j1la6z8fUIRFzb6l0L8TJQH7bi3ZH13X27SghPikMk9VAaJSF0rxqirOriEq007GPbKE+lGIwYOrWDdVmw5mWjjsvD0NsbJsXM+3Sozddevy+aPrn778hY8cWIuLC6e3sSPSe/eQ/9hi20aOJvvZav+0Eq610H4Nr/34wGGoLu0qleyFOaDIyJNqV7F2lrPk8g+xdpYxI6cbwc7tRUezAYFKxhsiUx7F4y8pq1xEVF6NFxxw300S6rrNxzY/8+uP3OB21671iLXZ6bdlFRFUNamgoiY89hjEuzm8xfS4X3qJCTElS6V6IE12L/u994YUXSEpKwmKxMHLkSNauXXvU+0tLS7n55ptJTEzEbDbTu3dvvv766xZ1WIiWyMss54tnN7Dwyd/I3lWKalDweWs/B4RGWSQRaiItPBzLKadg6tQJb1ER3qqqtu4SULvAechppzPjljtIHnUGmmagwFHFTz07UNYjCXPPnnWnSPvr859qMqFF1Va6d2Xu8Vu7Qojga/bI0IcffsiVV17Jyy+/zMiRI3n66af5+OOP2blzJ3ENfOpyuVyMGTOGuLg4/vWvf9GxY0f27NlDREQEgwcPblJMGRkSLVW4r4I1n+8mc1MhAKqq0G9MIqdOSiI0SnYDtZTu9eLavx9Xxm5QFLSoqOPqBO6KslJ+Wb6YovxcLr7qJnSHkwqXA6NmoPyJJ7H/8Y+EnnWWX0ZzfDU1+MpKMfXuLZXuhThBNTsZGjlyJMOHD+f5558Hak+L7dy5M3/961+56667jrj/5Zdf5vHHH2fHjh0YW7jQUJIh0VzFOVWs/WI36b/lA6Ao0Oe0BIZN7kZ47PFTPf5E5yksxJmWjq+yAq2NyngcjdfjQTMY0HWdhW+/RGH2PrrtL6BnfgnWAQOIv+cevyyA9lZVoVdVYunTRyrdC3ECatbHIpfLxa+//sqECRN+b0BVmTBhAqtXr27wmc8//5xRo0Zx8803Ex8fzymnnMIjjzyC1+ttNI7T6aS8vLzeS4imqixx8uFDa2sTIQV6DYtj2v0jGX9Vf0mE/MwQE4PllFPQYmPx5OXiczjaukv1aAcWNjtrqvF6vXh8Xlz9+6CazRg6dPDbTjDNbkex2nDsSsOdl+eXNoUQwdOsLRCFhYV4vV7i4+PrvR8fH8+OHTsafCYjI4Pvv/+eGTNm8PXXX5OWlsZf/vIX3G43999/f4PPPProo8yZM6c5XRPtXEWxg/Xf7mHE+d0JiTTTY2gsXo/OiJRuRHeU8gmBpIXYsfbrh9Nmw52Vhe60Hnc1vCw2O5dcezNp2zYT16ETtqlX4DOb+ex/rzJg4KmEfLOYqGnTMCUltTiGFhr6/+3deXRU9f3/8ecsyUz2kJXsCSAkBAmyBWQRFLVqaXO+3xbq1xYUe3qOBb8qtSpqXbCn0J/H/tCDosd6Su33Z9HqD62lIotlB4HQtBAh7IYl+76Qyczc+/1jNBpXAiQzYV6Pc+ac5DL3znvugeE178/n3g9er5eOssNdV5yJSP/Qo2Gys2fPkpaWxo4dO5g4cWLX9gceeIDNmzfz4YcffmmfoUOH0tHRwYkTJ7B90kL/3e9+x9NPP01FRcVXvo7L5cLlcnX93tzcTEZGhobJ5Gv9Zckeqj9uYcx3sphQNBiv17isl80IRKZp4qmooOPYMUy3B3tCQkBfYfXPnZvZucF3IceIU9VkNrUTU1RE7A9+cFEdI099PRabFedwrXQv0l/06JMqISEBm81G1RfawFVVVQwcOPAr90lJSWHo0KFdQQggLy+PyspKOjs7v3Ifh8NBdHR0t4fI551r6WT7m0c4WuybEzTmpmzShg0ge6Tv27iCUN+zWCyEpKYSNmIEtuhoPFWVmG63v8v6WvmjCxkz+VqiomMZMjgXvF6q3nmbsgcfoKOs7IKPa4+Lw+x003HoEN6mpktYsYj0lh4Nk4WGhjJmzBg2btxIUVER4JtAvXHjRhYsWPCV+0yaNInXXnsNwzCwfvIt8fDhw6SkpBAaIPcokf6jo81Nyfpy/vWP03hcXmKT6xg0KoGcggQGjUr0d3kC2AcMwDoin85jx+g8cxZbTAzWS7gsxqUS6nBSOP1Gxk6dgc1mo23XLjasXsXZiBDSVyxjwn/+iMQp11zQse2Jibirq3zrmGmle5GA1+OvzwsXLuTll1/mj3/8IwcPHuSuu+6ira2NO+64A4A5c+awaNGiruffdddd1NfXc88993D48GHWrFnDb37zG+bPn3/p3oVc9jrPediz5gR/enQnxWs/xuPykpgZxeRZV2CxWnQ5c4CxOp04cnNxDL0Co70NT0ODv0v6Wp92rcPGjyekYCSmxcKp+GhWb1/P7k3rcLW3X9Bx7YlJGC0tdBwqw7jAY4hI37igO1AvX76cp59+msrKSkaNGsVzzz1HYWEhANOmTSM7O5uVK1d2PX/nzp3cd999lJSUkJaWxp133smDDz7Ybejsm+jS+uDldnnZv+k0+9Z9jKvNA0B8WgTjZw4ipyBBIagfcFdX4zp2DKOtDXsAXn7/RRXlJ9ix7l2qKs4A4LBYmRadTPa8n/a4w2MaBp7qKt9Vd7m5WuleJEBpOQ4JSIbXYP+mMxSvPcm5Ft+8k9jkcMbPzGHI6CQsVoWg/sTb0oLr2DE81TXY4uOxOhz+LukbmabJ8UMH2LnuXbzVNUwpO0VIbCwDHn2EiKzsHoVw38KuVdgHDtRK9yIBSmFIAorXY2CxgMVq4c2le6n+uIXoBCfjvpvD0HHJWDUxut8yOjvpPHES96lyCAnFGhkZ8KHI6/VS/89iXK/+D7bISPYMz6HT5WLijJtJyxp03scxPR7fSvdpqVrpXiQAKQxJwDiyt4qdq48x7pZs8q5O5UxZA43V7eRenaKrwy4TpmHgqarCXVmJt7kZs9ONxeHAGhER0MHI6Oyk6cxp/vL6H/C4O0mxhnD9pBlEXHPNeXeJTLcbT001oVlZOIYMCfjhQpFgojAkfmUaJh3tbsIiQ/nnunJ2/P+jJOdE84MHx/q7NOlFpmlitLXhbWzCU1ONt6kZ0x34wai9tYUdr/+J5A+2EuVyE1JQwImCPEZNm0FkdOy37m+4XHjr6wjNycExaFBA34dJJJgoDIlfmKbJiZJaPnz3OJGxDmb+9yjcnV4+2nqW4VNSCQnVt+ZgYZomRmsr3qZmPNVVeJtbfMHI6fQFowCbY2N6PDT99a80/uUvnIgJ52BaAjaLle/MnkPWFXnfur/R0YG3oQHHkMGEZvds/pGI9I4e3WdI5GKZpsnHB+rY/e4JaspbAGhrdNHW6CIi1kHBdRl+rlD6msViwRYVhS0qipC01E+CUROe6mq8zc14AywYWex2Yv/jPwgvLKTtxeepbG2l1RmKY9tOuCIPV8c57PaQrnXRvsjqdEJMDJ3Hj4PdTmh6ugKRiJ+pMyR95vShej7863Eqj/sW3g1x2Ci4LoNRMzJwhGtCqXRnGoYvGDU3466swmj9tGMUhi0yMiAmIZuGQfPatVS8s5rBTz5FyMCBbPrbW5w6cYTCaTdyxYgCLJavHgrzrXTfhjN3GCGpqX1cuYh8nsKQ9LqzRxvZ/dfjnDncCIA9xMqV09K56sZMwiL9/01fAt+nwcjT2IinugajpRnT4wmYYGS4XFgdDjxuN//zzFO0u31rKyYOTGPijJtJzxnylfv5JpF34szLIyQ5qS9LFpHPURiSXrXxjx9xaGclAFa7hRFT0hj9nSwiYgJzgqwEPtMwMFpa8DQ1dQtG1rBwrBERfg1GptvNyQXzOWYzOJ40AM8nV0FmDB7Kdd+bRXhk1Jf28TY2YpoGYXl5WulexE80Z0guudrTrQAkpEeSmBnN4Q+ryJ2UwtibsomK0x145eJYrFZsMTHYYmIITU/3BaPGRjw1tXgbG/wajCwhIWT+9v8Q8fvfk1V2iIrvfYeP/r2PxtoaHM4wwDdv7vNzhGyxsXjq6nzrmNlsWulexA/UGZJLqnTrGTb9vzJSr4ilaOFVGB6T1kYXMYlh/i5NLnOm1/u5jlE1RksrpteDNTwCa3h4nwcjT0MD9gEDaKqvo+KNVSSGOBnwX//FhvdWExkdw+hJ03GGhX/2/JoarGFO38Ku+pwT6VPqDMlFa6ppp/JYE8MmpJCZH48txEp4TChet4E91KYgJH3CYrNhi43FFhv7hY5RDd6GBkzD+1nH6Guu9LqUPu3whHe6cX6wmRbDoKJkH0eTfOubNdXXcdOsOV3PtyUk4Kmu9nWI8oZji4zo9RpFxEedIblgLfUd7P37SQ7uqMBigdsWTyA6Poz25k7CozUxWgKD6fX6LtH/tGPU2oppGH0ajM7961/UvfQS7upqaqLCOXJFJtfNnsvAwVdgGF5OHColJ3cEFosFb1UltgEDcOblYQ0P//aDi8hFUxiSHmtrclH83seUbjuD4fH99cnMj2PKrKHEJuvDWwJXVzBqaMRTW4PR2gqGgSUsHGtkZK8ukWGcO0fDn/9My3vvYZomjiFDSFmyhIMle9j0t7eIT0phRtFs4hKT8VRVYk9MwpmXG7B34xa5nGiYTM7buZZO9r3/Mfs3n8HrNgBIGzaAwu8NImVwjJ+rE/l2lk8mKNsHDCA0MwNvS4svGNVU462tAdPEEh7h6xhd4mBkDQsjft48Iq6+mroVK4j94Q99E6lNk1CHg+bGOsIio3wTxBOT8NRU02G3ETZsmN9vHSByuVMYkm/V0eamZH05//rHaTwuLwADB8VQ+L0c0nPj/FydyIWx2O1fEYwa8FTX4K2r9XWMeiEYOXNzSf3d77qOmWMPI/TQKbzfvZmwcN88oV2b3qe1qZGxV44hNDUVe5z+nYn0JoUh+VbF752kZMMpABIzoyj8/iAyh8dpCQG5bHQPRpm+obTGRt+SIJ92jCIifVelXYJg9PljtKxbh725Bftrr9PQ1Er4j2azf88OvB4P8ZHRJE+bftGvJyLfTHOG5Evamlzs/8dpDK/J1f85hLYmF++9uJ/RN2aRU5CgECRBw3S7P+sY1dRgtLVhmibWSxiMTK+X5nffpfHNNxm4eDGOQYOorjjNv3dtZfLYyUQVjldnSKSXqTMkABheg4bKduLTIjnX4qZ47cdYrBbyp6YSkxjODx4c6+8SRfqcJSQEe1wc9ri4ro6R55Ng5K2pxoSLDkYWm42YoiIir78eW4RvmCzs0BHyi0sxs3Mv4bsRka+jMBTkWhs6+GjbWT7aXoG7w8Ptv51MQnokI69NJ2VwrO4YLfIJS0gI9vh47PHxmJmZeFtaugcji+WzGzxeQDD6NAiZHg+Nr7+Ot7aW9n37iL7l5kv9VkTkCzRMFoRMw6T8YD2lW85w8t+1fPo3wBkZwnfnF5Cco3Mscr7Mzs7POka1tZhtbb5g9GnHyPrVq9Z/E09NDU3vvEP0DTcQPqFQw2QivUxhKIi0N3dycMdZSreepaWuo2t76hWx5E9NZfCoJGwhPf/gFhGfrmBUX4+nru6TYGTFGhFxQcHIU1FB2JjRCkMivUzDZEHANE02rjzIkT1VGIYv+zrC7QybMJD8KWnEpei2/yKXgiU0FHtCAvaEBIzOToymJjz1DXjq6/BUVYHVijUyEmtY2AV1jESkdygMXabOtXZyaGclg0cnEh0fhomJYZgk50QzYmoaQ8YkYQ/tvbvtigQ7a2go1sRE7ImJ3YNRXa2CkUiAURi6jJimiWmYWG1WNvzhIOWldbja3EwoGszYm7K56vpMEtKj/F2mSNDpFoxcWXibmvDW1/uG0z4JRrbISCzh4bp1hYgfKAxdBlztbso+rKR061mGT06l4NoMhk9Kob3ZRXyab4XsAQM1FCYSCKwOB9akJEKSkjBcrs+CUV0d3spKsNmwRURg0SKtIn1GYaifMk2T6pMtHNh6hqN7qvB8slZY2a5KCq7NYNBViQy6KlHfMkUCWLdg1NGBt6kZb30dnvp6vJUV6F+vSN9QGOpnOjs8HN5dRenWM9Seau3aHpcaQf6UNIYVJgMoBIn0M1anE6vTSUjy54JRc5NWrRfpAwpD/URz7Tn2rSvn8IeVuD9ZLNVmtzJ4TCIjpqQxcHCMApDIZeLzwUhEep/CUABzd3qpO9PKwJwYXO0eSrecASA2OZz8KankTkjBGRni5ypFRET6N4WhANVQ2cabvy3GYoHbl04iMTOK0d/JIiMvjrShseoCiYiIXCK6uUWA8LoNDu+u5P3fH8A0TGKTwnGE2wkNs9NUcw6AiUWDSR82QEFIRETkElJnyM8aq9op3XaWQzsr6Gh1A5A7MYWs/HiK7ruKqDgnFqvCj4iISG9RGPIDr9fgREktpVvPcPpQQ9f2yAEOhk9OJSHdd2+g6IQwf5UoIiISNBSG+lBz7Tk+2naWgzsqaG/u9G20QFZ+PPlT08jKj8Nq08iliIhIX1IY6mWG18A0wBZi5YM/HeJMma8TFBYdyvCrUxg+OVUdIBERET9SGOpFpVvPsPfvJxl9YxZXTktnxNQ0LBbIn5JGzqgEbOoCiYiI+J3C0CVkGianDtYT4rSTMjgGj9ugtcHF0eJqrpyWzpAxSQwZo5uoiYiIBBKFoUugvbmTgzvO8tG2szTXdpCeO4Dv33sVwwoHEhYZwqCrEv1dooiIiHwNhaELZJomZw43UrrlDMdLajC8JgCOcDtxqRGYhokzIoSh4wf6uVIRERH5Jhc0aeX5558nOzsbp9NJYWEhu3fvPq/9Vq1ahcVioaio6EJeNiB0tLop2VDOa098yDv/958cLa7G8Jok50Rz7Zw85i6dxJRZQ3VvIBERkX6ix52h119/nYULF/Liiy9SWFjIsmXLuPHGGykrKyMp6evnw5w8eZL777+fKVOmXFTB/lRzqoW3fluM12MAEOKwMbRwIPlTUknMiPJzdSIiInIhLKZpmj3ZobCwkHHjxrF8+XIADMMgIyODu+++m4ceeugr9/F6vUydOpV58+axdetWGhsbefvtt8/7NZubm4mJiaGpqYno6OielHtR3J1eDu2ooLy0jpvvGokJ/OnRHTgjQhgxNY0rxiUT6tRIo4iISH/Wo//JOzs7KS4uZtGiRV3brFYrM2bMYOfOnV+73+LFi0lKSuLOO+9k69at3/o6LpcLl8vV9Xtzc3NPyrwopmlSX9FGfGokmLDr7WN0dng5faiBjOFx/PChcYRFhWh9MBERkctEj8JQbW0tXq+X5OTkbtuTk5M5dOjQV+6zbds2XnnlFUpKSs77dZYsWcKTTz7Zk9IuWmeHhyN7qijdepaa8hZmPzqehPRIxtycjT3ESlK2bxgsPDq0T+sSERGR3tWrYzwtLS385Cc/4eWXXyYhIeG891u0aBELFy7s+r25uZmMjIzeKJHa0y2UbjlL2e5K3B1eAGx2KzXlLSSkRzL6hqxeeV0REREJDD0KQwkJCdhsNqqqqrptr6qqYuDAL19CfuzYMU6ePMnMmTO7thmGb/Kx3W6nrKyMwYMHf2k/h8OBw+HoSWk94u70cnRvNaVbz1B14rMhuJikMEZMTSN3QgrOyJBee30REREJHD0KQ6GhoYwZM4aNGzd2XR5vGAYbN25kwYIFX3p+bm4u+/fv77bt0UcfpaWlhWeffbbXuj3f5J/ryileexJXuwcAq9XCoKsSyZ+SStqwAZoLJCIiEmR6PEy2cOFC5s6dy9ixYxk/fjzLli2jra2NO+64A4A5c+aQlpbGkiVLcDqdjBgxotv+sbGxAF/a3lcsVnC1e4iKd5I/JZXciSlExPReF0pEREQCW4/D0OzZs6mpqeGxxx6jsrKSUaNGsXbt2q5J1eXl5VitgbsAae7EFAakRJCZF6cbI4qIiEjP7zPkD/66z5CIiIhc/gK3hSMiIiLSBxSGREREJKgpDImIiEhQUxgSERGRoKYwJCIiIkFNYUhERESCmsKQiIiIBDWFIREREQlqCkMiIiIS1BSGREREJKgpDImIiEhQUxgSERGRoKYwJCIiIkFNYUhERESCmsKQiIiIBDWFIREREQlqdn8XcD5M0wSgubnZz5WIiEgwiIqKwmKx+LsM6SP9Igy1tLQAkJGR4edKREQkGDQ1NREdHe3vMqSPWMxP2y4BzDAMzp49e0mSenNzMxkZGZw6dUp/0b+BztP507k6fzpX50/n6vz1xrlSZyi49IvOkNVqJT09/ZIeMzo6Wh8w50Hn6fzpXJ0/navzp3N1/nSu5EJpArWIiIgENYUhERERCWpBF4YcDgePP/44DofD36UENJ2n86dzdf50rs6fztX507mSi9UvJlCLiIiI9Jag6wyJiIiIfJ7CkIiIiAQ1hSEREREJakEVhp5//nmys7NxOp0UFhaye/duf5cUkLZs2cLMmTNJTU3FYrHw9ttv+7ukgLRkyRLGjRtHVFQUSUlJFBUVUVZW5u+yAtKKFSsYOXJk131gJk6cyHvvvefvsvqFpUuXYrFYuPfee/1dSsB54oknsFgs3R65ubn+Lkv6oaAJQ6+//joLFy7k8ccfZ9++fRQUFHDjjTdSXV3t79ICTltbGwUFBTz//PP+LiWgbd68mfnz57Nr1y7Wr1+P2+3mhhtuoK2tzd+lBZz09HSWLl1KcXExe/fu5dprr+X73/8+paWl/i4toO3Zs4eXXnqJkSNH+ruUgJWfn09FRUXXY9u2bf4uSfqhoLmarLCwkHHjxrF8+XLAt8RHRkYGd999Nw899JCfqwtcFouF1atXU1RU5O9SAl5NTQ1JSUls3ryZqVOn+rucgBcXF8fTTz/NnXfe6e9SAlJrayujR4/mhRde4Ne//jWjRo1i2bJl/i4roDzxxBO8/fbblJSU+LsU6eeCojPU2dlJcXExM2bM6NpmtVqZMWMGO3fu9GNlcjlpamoCfP/Jy9fzer2sWrWKtrY2Jk6c6O9yAtb8+fO55ZZbun1uyZcdOXKE1NRUBg0axG233UZ5ebm/S5J+qF+sTXaxamtr8Xq9JCcnd9uenJzMoUOH/FSVXE4Mw+Dee+9l0qRJjBgxwt/lBKT9+/czceJEOjo6iIyMZPXq1QwfPtzfZQWkVatWsW/fPvbs2ePvUgJaYWEhK1euZNiwYVRUVPDkk08yZcoUDhw4QFRUlL/Lk34kKMKQSG+bP38+Bw4c0HyFbzBs2DBKSkpoamrizTffZO7cuWzevFmB6AtOnTrFPffcw/r163E6nf4uJ6DddNNNXT+PHDmSwsJCsrKyeOONNzT8Kj0SFGEoISEBm81GVVVVt+1VVVUMHDjQT1XJ5WLBggX87W9/Y8uWLaSnp/u7nIAVGhrKkCFDABgzZgx79uzh2Wef5aWXXvJzZYGluLiY6upqRo8e3bXN6/WyZcsWli9fjsvlwmaz+bHCwBUbG8vQoUM5evSov0uRfiYo5gyFhoYyZswYNm7c2LXNMAw2btyoOQtywUzTZMGCBaxevZoPPviAnJwcf5fUrxiGgcvl8ncZAee6665j//79lJSUdD3Gjh3LbbfdRklJiYLQN2htbeXYsWOkpKT4uxTpZ4KiMwSwcOFC5s6dy9ixYxk/fjzLli2jra2NO+64w9+lBZzW1tZu36xOnDhBSUkJcXFxZGZm+rGywDJ//nxee+013nnnHaKioqisrAQgJiaGsLAwP1cXWBYtWsRNN91EZmYmLS0tvPbaa2zatIn333/f36UFnKioqC/NO4uIiCA+Pl7z0b7g/vvvZ+bMmWRlZXH27Fkef/xxbDYbt956q79Lk34maMLQ7Nmzqamp4bHHHqOyspJRo0axdu3aL02qFti7dy/Tp0/v+n3hwoUAzJ07l5UrV/qpqsCzYsUKAKZNm9Zt+x/+8Aduv/32vi8ogFVXVzNnzhwqKiqIiYlh5MiRvP/++1x//fX+Lk36sdOnT3PrrbdSV1dHYmIikydPZteuXSQmJvq7NOlnguY+QyIiIiJfJSjmDImIiIh8HYUhERERCWoKQyIiIhLUFIZEREQkqCkMiYiISFBTGBIREZGgpjAkIiIiQU1hSERERIKawpCIdNm0aRMWi4XGxkZ/lyIi0mcUhkRERCSoKQyJiIhIUFMYEgkghmGwZMkScnJyCAsLo6CggDfffBP4bAhrzZo1jBw5EqfTyYQJEzhw4EC3Y7z11lvk5+fjcDjIzs7mmWee6fbnLpeLBx98kIyMDBwOB0OGDOGVV17p9pzi4mLGjh1LeHg4V199NWVlZb37xkVE/EhhSCSALFmyhFdffZUXX3yR0tJS7rvvPn784x+zefPmruf88pe/5JlnnmHPnj0kJiYyc+ZM3G434Asxs2bN4kc/+hH79+/niSee4Fe/+hUrV67s2n/OnDn8+c9/5rnnnuPgwYO89NJLREZGdqvjkUce4ZlnnmHv3r3Y7XbmzZvXJ+9fRMQftGq9SIBwuVzExcWxYcMGJk6c2LX9pz/9Ke3t7fzsZz9j+vTprFq1itmzZwNQX19Peno6K1euZNasWdx2223U1NSwbt26rv0feOAB1qxZQ2lpKYcPH2bYsGGsX7+eGTNmfKmGTZs2MX36dDZs2MB1110HwN///nduueUWzp07h9Pp7OWzICLS99QZEgkQR48epb29neuvv57IyMiux6uvvsqxY8e6nvf5oBQXF8ewYcM4ePAgAAcPHmTSpEndjjtp0iSOHDmC1+ulpKQEm83GNddc8421jBw5suvnlJQUAKqrqy/6PYqIBCK7vwsQEZ/W1lYA1qxZQ1paWrc/czgc3QLRhQoLCzuv54WEhHT9bLFYAN98JhGRy5E6QyIBYvjw4TgcDsrLyxkyZEi3R0ZGRtfzdu3a1fVzQ0MDhw8fJi8vD4C8vDy2b9/e7bjbt29n6NCh2Gw2rrzySgzD6DYHSUQk2KkzJBIgoqKiuP/++7nvvvswDIPJkyfT1NTE9u3biY6OJisrC4DFixcTHx9PcnIyjzzyCAkJCRQVFQHwi1/8gnHjxvHUU08xe/Zsdu7cyfLly3nhhRcAyM7OZu7cucybN4/nnnuOgoICPv74Y6qrq5k1a5a/3rqIiF8pDIkEkKeeeorExESWLFnC8ePHiY2NZfTo0Tz88MNdw1RLly7lnnvu4ciRI4waNYp3332X0NBQAEaPHs0bb7zBY489xlNPPUVKSgqLFy/m9ttv73qNFStW8PDDD/Pzn/+curo6MjMzefjhh/3xdkVEAoKuJhPpJz690quhoYHY2Fh/lyMictnQnCEREREJagpDIiIiEtQ0TCYiIiJBTZ0hERERCWoKQyIiIhLUFIZEREQkqCkMiYiISFBTGBIREZGgpjAkIiIiQU1hSERERIKawpCIiIgENYUhERERCWr/C3FRgYY33NszAAAAAElFTkSuQmCC", "text/plain": ["<Figure size 616.125x500 with 1 Axes>"]}, "metadata": {}, "output_type": "display_data"}], "source": ["\n", "metrics = pd.read_csv(f\"{trainer.logger.log_dir}/metrics.csv\")\n", "del metrics[\"step\"]\n", "metrics.set_index(\"epoch\", inplace=True)\n", "display(metrics.dropna(axis=1, how=\"all\").head())\n", "sn.relplot(data=metrics, kind=\"line\")"]}, {"cell_type": "markdown", "id": "89e00493", "metadata": {"papermill": {"duration": 0.021349, "end_time": "2024-07-26T12:56:36.932548", "exception": false, "start_time": "2024-07-26T12:56:36.911199", "status": "completed"}, "tags": []}, "source": ["## Congratulations - Time to Join the Community!\n", "\n", "Congratulations on completing this notebook tutorial! If you enjoyed this and would like to join the Lightning\n", "movement, you can do so in the following ways!\n", "\n", "### Star [Lightning](https://github.com/Lightning-AI/lightning) on GitHub\n", "The easiest way to help our community is just by starring the GitHub repos! This helps raise awareness of the cool\n", "tools we're building.\n", "\n", "### Join our [Discord](https://discord.com/invite/tfXFetEZxv)!\n", "The best way to keep up to date on the latest advancements is to join our community! Make sure to introduce yourself\n", "and share your interests in `#general` channel\n", "\n", "\n", "### Contributions !\n", "The best way to contribute to our community is to become a code contributor! At any time you can go to\n", "[Lightning](https://github.com/Lightning-AI/lightning) or [Bolt](https://github.com/Lightning-AI/lightning-bolts)\n", "GitHub Issues page and filter for \"good first issue\".\n", "\n", "* [Lightning good first issue](https://github.com/Lightning-AI/lightning/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22)\n", "* [Bolt good first issue](https://github.com/Lightning-AI/lightning-bolts/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22)\n", "* You can also contribute your own notebooks with useful examples !\n", "\n", "### Great thanks from the entire Pytorch Lightning Team for your interest !\n", "\n", "[![Pytorch Lightning](data:image/png;base64,NDA0OiBOb3QgRm91bmQ=){height=\"60px\" width=\"240px\"}](https://pytorchlightning.ai)"]}, {"cell_type": "raw", "metadata": {"raw_mimetype": "text/restructuredtext"}, "source": [".. customcarditem::\n", "   :header: PyTorch Lightning CIFAR10 ~94% Baseline Tutorial\n", "   :card_description: Train a Resnet to 94% accuracy on Cifar10!\n", "   :tags: Image,GPU/TPU,Lightning-Examples"]}], "metadata": {"jupytext": {"cell_metadata_filter": "colab_type,id,colab,-all", "formats": "ipynb,py:percent", "main_language": "python"}, "language_info": {"codemirror_mode": {"name": "ipython", "version": 3}, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.12"}, "papermill": {"default_parameters": {}, "duration": 3253.339474, "end_time": "2024-07-26T12:56:39.278497", "environment_variables": {}, "exception": null, "input_path": "lightning_examples/cifar10-baseline/baseline.ipynb", "output_path": ".notebooks/lightning_examples/cifar10-baseline.ipynb", "parameters": {}, "start_time": "2024-07-26T12:02:25.939023", "version": "2.6.0"}, "widgets": {"application/vnd.jupyter.widget-state+json": {"state": {"03082ae135614e53bfa950ce7181f15a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_0ca1c51a6dfb4d48b283704a0f4773b3", "placeholder": "\u200b", "style": "IPY_MODEL_ab5e9d4d3a6f4083a84c01c00bd07f19", "tabbable": null, "tooltip": null, "value": "Sanity\u2007Checking\u2007DataLoader\u20070:\u2007100%"}}, "034d4270f7dc44cd815f56f829a4100f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "03bd376a32084961bb495b34c1060660": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "047f468d304a473fa05693c53ee7048f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_3a2efbd0622340d4b2e6dc98c379d66b", "IPY_MODEL_0663150d03fb4d2caea996c09f5f41b8", "IPY_MODEL_a5223bfe289e44cc8c530263f0ca89ff"], "layout": "IPY_MODEL_1e490ed4c0534cf598792abf04704a64", "tabbable": null, "tooltip": null}}, "04a01663319747b5892b8a74e3e25352": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_c816add18db64f5eac30289cb766ad64", "placeholder": "\u200b", "style": "IPY_MODEL_c5b574e19eec42b2a8bb6108878002df", "tabbable": null, "tooltip": null, "value": "\u20072/2\u2007[00:00&lt;00:00,\u2007\u20074.39it/s]"}}, "04d8e9bc75ee490c90d812d061b9f41e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "05592d0b539f4694b0130d0c9186268f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "0663150d03fb4d2caea996c09f5f41b8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_561eabd355244ff19e249ae9758992dc", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_9fac2dae9b6b4f93aea77eb37afe3685", "tabbable": null, "tooltip": null, "value": 40.0}}, "06ba39e88e9b49ee9b7ce74f20432f80": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_bf1c209555a04d318154f875d75388df", "placeholder": "\u200b", "style": "IPY_MODEL_78142b75deaa404c8771322653359db1", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "07326c0f26804d5296a34027dbe89007": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_504e9878c9a74e7b874bb31dea13841c", "placeholder": "\u200b", "style": "IPY_MODEL_bfdd7fb6ec194c56b85512420c753235", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200753.76it/s]"}}, "0c3167c03e564a098af652381f20706f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_9152ae17647f48ce8050292036a0f280", "placeholder": "\u200b", "style": "IPY_MODEL_03bd376a32084961bb495b34c1060660", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "0c8f556c34ec4bcabbc8109fca7ba8e9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "0ca1c51a6dfb4d48b283704a0f4773b3": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "0cc2589fb2f34211918862be163ef31d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_23f5141080e645e8aa9880677aa5148e", "placeholder": "\u200b", "style": "IPY_MODEL_05592d0b539f4694b0130d0c9186268f", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200752.53it/s]"}}, "0da36565bc0f48edb95b449e8c5e5c2b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "0fa79e9e572648a6be950ce91498c68c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "12d66edaca8240a39d2efbeaf04a6740": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_76fd1f199b02479dbd808776ffd20e6d", "placeholder": "\u200b", "style": "IPY_MODEL_81ca0fb763504e439ca58870da2830f1", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200749.61it/s]"}}, "132a6bdc00cf493191470589a2e9da95": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "143bf4aef1f244c9bf2f26e4a444e96a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_6e98fca87f67408bbfbdb52f66b37763", "placeholder": "\u200b", "style": "IPY_MODEL_462fc552a741453aa20b1a1258548cc5", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "165d268c04274cedaf65b412aa8ba7af": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_b909dd9cdb034fa1bcb49b49848f3e4b", "placeholder": "\u200b", "style": "IPY_MODEL_dcdeda19fa9f4f73ae817dc7a88c0416", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "16a9784663cd463493af046e04df08d0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "16d10a4429b74c29a009e5d6abfb31d8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "18963d9054e9467293300d7e4c39dba2": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "18c7c33df15443f198e9d36f8ae3e591": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "1904dd68c0cc4ff998d80873016945d3": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "1d4d1b1f0e7e47e9b3f5ed5565fc24e4": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "1daed6795a834524bc551aac17af7364": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_03082ae135614e53bfa950ce7181f15a", "IPY_MODEL_b393c8ff6bcf46dbb417d191c6f2463b", "IPY_MODEL_04a01663319747b5892b8a74e3e25352"], "layout": "IPY_MODEL_c3512771379a4931adca51c9b840f929", "tabbable": null, "tooltip": null}}, "1e490ed4c0534cf598792abf04704a64": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "1ea9ddd8829a4f9485dbf8454c04034f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "1f45bbb27ef9457d8992a657b0b51b65": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_faf37b3cbf6849a598616998aebf96d9", "IPY_MODEL_7ae6e762b3504722b3beac30d83a58b9", "IPY_MODEL_0cc2589fb2f34211918862be163ef31d"], "layout": "IPY_MODEL_8bc0f189846542eb8a20029804a0ecdb", "tabbable": null, "tooltip": null}}, "21ae213dd886424aa53cf2275d840be4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_2cba31076c2449c8a0b0d006cf90effe", "IPY_MODEL_d49a1cb815024a83919f66f67633e6a4", "IPY_MODEL_e50a4bb255f345bbbe68ed0599b70452"], "layout": "IPY_MODEL_cc90b78e2bcb441caaa3ae948653a5a2", "tabbable": null, "tooltip": null}}, "2285239914df4652afe0d3eb947fa00d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "23f5141080e645e8aa9880677aa5148e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "24b773f4a4e9492e9f61d71fbbdd8eea": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "24d3a73fa98b4cef9bc319585079dc1c": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "264ed645760b4809b20d48838416b280": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "2a70f339d18c469d84861d7e83997fd9": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "2ad7b401702f4026a7902575122de93f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "2caed33e83cd4ebbb033af015c8b09ac": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_cfc6c164a7104481a12463908bcde7da", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_452bccd1ec9647f98d7f93a7fec85b4a", "tabbable": null, "tooltip": null, "value": 40.0}}, "2cba31076c2449c8a0b0d006cf90effe": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_0da36565bc0f48edb95b449e8c5e5c2b", "placeholder": "\u200b", "style": "IPY_MODEL_8130be743e4a4ceeaa35440fd2354995", "tabbable": null, "tooltip": null, "value": "Sanity\u2007Checking\u2007DataLoader\u20070:\u2007100%"}}, "2da7351aa7c54927971f05d135369068": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_e9fb13e003474c7a9cb5c566b6565c63", "IPY_MODEL_a1b0178eb1254b6793c49b9e2124c97e", "IPY_MODEL_ae9c6ddad1f645eb9c5fe58940fe3fbe"], "layout": "IPY_MODEL_04d8e9bc75ee490c90d812d061b9f41e", "tabbable": null, "tooltip": null}}, "303d30d6c30d48d6880a1dcad86ea931": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_671f542c9a4147ce939de4dc9f0af215", "IPY_MODEL_a3a0bf1112ff4e23b8ea346ee58a15c1", "IPY_MODEL_7c1c71fdda294e24b68721cc75134225"], "layout": "IPY_MODEL_e96405288a2c4c05bbbfab7cf581b415", "tabbable": null, "tooltip": null}}, "30ce4657bb1147799c1a236a79b99279": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "321690e08b1749eeb4cea8a3ebb1999e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_3d3b316057c24b62b082f5de5ad39349", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_e1155795aee74027b43aaa56cf4e93ff", "tabbable": null, "tooltip": null, "value": 40.0}}, "35a373973f574d20a8b324debd9f49a6": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_06ba39e88e9b49ee9b7ce74f20432f80", "IPY_MODEL_489db9e91da344eba4895a1bfe67e8be", "IPY_MODEL_c2529610166b4f3082534cbe25cbbeb5"], "layout": "IPY_MODEL_366bd78332884ba9b1a92e5b72a3e91e", "tabbable": null, "tooltip": null}}, "35ce7427f7be43908448f63cfbe4de4f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "35f73e04bfd74c338abaa1a9e5f4db93": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_c988f23e885a4b179b9c167683cb46b5", "placeholder": "\u200b", "style": "IPY_MODEL_b8d3c8eb91e14a3e9f18eae0a560f0f0", "tabbable": null, "tooltip": null, "value": "Epoch\u20074:\u2007100%"}}, "366bd78332884ba9b1a92e5b72a3e91e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "37d8d4c91c9e4608aec28ff8cddb2f3b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "3886c741c9d14cb5b8a95e1b941d2cf9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "3a2efbd0622340d4b2e6dc98c379d66b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_eec05b979b1046e783b39ccdfb315f43", "placeholder": "\u200b", "style": "IPY_MODEL_c34edd6adfa04a8080acb13bc4983151", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "3ba035da04cc47c6a2cf95f874bed53c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "3bd8b1b3f3d442918a218a4f5127eceb": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "3c3a433c19d94c46805476a7516cb8fb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_2a70f339d18c469d84861d7e83997fd9", "placeholder": "\u200b", "style": "IPY_MODEL_7c3805ef0dac4607ba79af7afe62142b", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200752.38it/s]"}}, "3d3b316057c24b62b082f5de5ad39349": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "3f17988eaa5a4da3abea3738ddf84789": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "3f705a27827b477dbd3bf45c9ad56100": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "40c9a79300e742de80460efa9fa9d0df": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_c20306ee642147648dad35dc6defe3b0", "placeholder": "\u200b", "style": "IPY_MODEL_034d4270f7dc44cd815f56f829a4100f", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "44aa97e3b56b4e75922cdb7e1cd2a8c0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_143bf4aef1f244c9bf2f26e4a444e96a", "IPY_MODEL_321690e08b1749eeb4cea8a3ebb1999e", "IPY_MODEL_3c3a433c19d94c46805476a7516cb8fb"], "layout": "IPY_MODEL_63acddeea26a446685760601ac8a35b5", "tabbable": null, "tooltip": null}}, "452bccd1ec9647f98d7f93a7fec85b4a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "462fc552a741453aa20b1a1258548cc5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "47dff206eb1d4a84a9fcc4764599767e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "489db9e91da344eba4895a1bfe67e8be": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e4c335716e434501999c315d058e3148", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_df8027cfcea2404cb638eace31d015ae", "tabbable": null, "tooltip": null, "value": 40.0}}, "4c4667c0ceda482da729162d6bd83ff7": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "4fb6c9a4fa0744b3a17c85b792df8ad0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "4fe4919b47ed437680af2cd34e821b44": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "504e9878c9a74e7b874bb31dea13841c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "50eeede5688243be9e92966a002ce26a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_8da45c922b924bc1b2ff5a7f7a99eb6c", "placeholder": "\u200b", "style": "IPY_MODEL_f565a5d498c24604aa112830eb2ba744", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[01:37&lt;00:00,\u2007\u20070.41it/s]"}}, "54cba128a8544929be8391b19aab5436": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e93513e6b4f744999ea87fb076721657", "placeholder": "\u200b", "style": "IPY_MODEL_30ce4657bb1147799c1a236a79b99279", "tabbable": null, "tooltip": null, "value": "\u2007157/157\u2007[00:12&lt;00:00,\u200712.23it/s,\u2007v_num=0,\u2007val_loss=0.510,\u2007val_acc=0.822]"}}, "5552e00396b5469782fcd4cd6553de10": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "561eabd355244ff19e249ae9758992dc": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "57f7eb36cbfb4ce5a19a0a987b1c73cb": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "5843d54ed8b846258a0a6de1b6fa0ac7": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "5b2cd737d2c04c568c03d0d2deb2a2dd": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "5e209f8669684089af7dc93609167eb9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "606b8a7c8e654fbea13acca4d351fa9b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_4c4667c0ceda482da729162d6bd83ff7", "placeholder": "\u200b", "style": "IPY_MODEL_3886c741c9d14cb5b8a95e1b941d2cf9", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200750.21it/s]"}}, "63a37fdedd204b6eae8a03995c8af0b8": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_7d17e7a584604e82985766ca9acf097c", "placeholder": "\u200b", "style": "IPY_MODEL_16a9784663cd463493af046e04df08d0", "tabbable": null, "tooltip": null, "value": "\u2007157/157\u2007[08:16&lt;00:00,\u2007\u20070.32it/s,\u2007v_num=1,\u2007val_loss=0.510,\u2007val_acc=0.822]"}}, "63acddeea26a446685760601ac8a35b5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "671f542c9a4147ce939de4dc9f0af215": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_37d8d4c91c9e4608aec28ff8cddb2f3b", "placeholder": "\u200b", "style": "IPY_MODEL_132a6bdc00cf493191470589a2e9da95", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "69c1f46ad5524dd9af53e18b57ed19d1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_35f73e04bfd74c338abaa1a9e5f4db93", "IPY_MODEL_8955d589d4e34b4e9e299c72e71afff5", "IPY_MODEL_63a37fdedd204b6eae8a03995c8af0b8"], "layout": "IPY_MODEL_3bd8b1b3f3d442918a218a4f5127eceb", "tabbable": null, "tooltip": null}}, "6e98fca87f67408bbfbdb52f66b37763": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "719919f1b9c7475ea86ce82493ed372e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "73a4c2de15aa41249bcfab1c4ce98a39": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "75edc5acfd0d45ce8da06a7f52a54a8a": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_c606a468311b4c1fb04a7f97eda63bfd", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_5843d54ed8b846258a0a6de1b6fa0ac7", "tabbable": null, "tooltip": null, "value": 40.0}}, "76fd1f199b02479dbd808776ffd20e6d": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "7769b9125b1c44afa9c0ac053f0615a1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "78142b75deaa404c8771322653359db1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "7926cea56c2a4194b0605d586e8896f3": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "7ae6e762b3504722b3beac30d83a58b9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_57f7eb36cbfb4ce5a19a0a987b1c73cb", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_5b2cd737d2c04c568c03d0d2deb2a2dd", "tabbable": null, "tooltip": null, "value": 40.0}}, "7c1c71fdda294e24b68721cc75134225": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_bf8cceb9fd9d432ca20c7dd62d7d2b9e", "placeholder": "\u200b", "style": "IPY_MODEL_5e209f8669684089af7dc93609167eb9", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200750.92it/s]"}}, "7c3805ef0dac4607ba79af7afe62142b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "7d17e7a584604e82985766ca9acf097c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "8130be743e4a4ceeaa35440fd2354995": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "81ca0fb763504e439ca58870da2830f1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "828e065b78ba4837a7c791d1a78e7be5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_7926cea56c2a4194b0605d586e8896f3", "placeholder": "\u200b", "style": "IPY_MODEL_24d3a73fa98b4cef9bc319585079dc1c", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "84da2ed7d1d642b7964d20bee1d114fa": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "8955d589d4e34b4e9e299c72e71afff5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_719919f1b9c7475ea86ce82493ed372e", "max": 157.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_95645a3a34c4426eb126d56b93e3acfe", "tabbable": null, "tooltip": null, "value": 157.0}}, "8a22f89049bb4314b2d187f34d894327": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "8bc0f189846542eb8a20029804a0ecdb": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "8cdf89eec04e44aaa545bdf401de4064": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "8d57edc23628484ebc18ba428d5057b7": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_ba0cdacee4b847179bd5f5b44ac18754", "IPY_MODEL_2caed33e83cd4ebbb033af015c8b09ac", "IPY_MODEL_12d66edaca8240a39d2efbeaf04a6740"], "layout": "IPY_MODEL_18963d9054e9467293300d7e4c39dba2", "tabbable": null, "tooltip": null}}, "8d7a401cc6ad4b58b09106cf04d11a44": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_40c9a79300e742de80460efa9fa9d0df", "IPY_MODEL_db98b217589b40739d834c2a776b639d", "IPY_MODEL_07326c0f26804d5296a34027dbe89007"], "layout": "IPY_MODEL_d012b519e90545a2b99c9856be6decb3", "tabbable": null, "tooltip": null}}, "8da45c922b924bc1b2ff5a7f7a99eb6c": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "8e3b8f8ea1644f4f8232031e6bb14f6e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "8ede9b6b8e084d49bc64b989a676b9c9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_c62d81a838024bb3a0e58e5b34184da9", "IPY_MODEL_a5d124070783451685b91ab963b34e9b", "IPY_MODEL_50eeede5688243be9e92966a002ce26a"], "layout": "IPY_MODEL_bbb938f242e649c1a608a813718a8d39", "tabbable": null, "tooltip": null}}, "8fc732a5c3cc4cdea60e9969fb18d978": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "90f96c8762fa48fa8a941b1f5aefbc00": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "9152ae17647f48ce8050292036a0f280": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "91e0d2b3afaa4c4e9f0de1191ccc8ec3": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "928b8e5d20bc46a6a61bd2a45e89e271": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_1ea9ddd8829a4f9485dbf8454c04034f", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_a3585cdb1c3f4c8c8f39f47c812974be", "tabbable": null, "tooltip": null, "value": 40.0}}, "95645a3a34c4426eb126d56b93e3acfe": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "981d669482f346cf938b84144278ffa2": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "9fac2dae9b6b4f93aea77eb37afe3685": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "a1b0178eb1254b6793c49b9e2124c97e": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_d69693c975044374a88f5c8a4fe6552f", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_e4d5c94b505748c5bde5da1a11f63647", "tabbable": null, "tooltip": null, "value": 40.0}}, "a3585cdb1c3f4c8c8f39f47c812974be": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "a3a0bf1112ff4e23b8ea346ee58a15c1": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e93841c9e6e84e5ebcba85cd97d60049", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_35ce7427f7be43908448f63cfbe4de4f", "tabbable": null, "tooltip": null, "value": 40.0}}, "a3dde8170a7d42ac96c42923f353f721": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_18c7c33df15443f198e9d36f8ae3e591", "max": 157.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_16d10a4429b74c29a009e5d6abfb31d8", "tabbable": null, "tooltip": null, "value": 157.0}}, "a5223bfe289e44cc8c530263f0ca89ff": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e5dafde475bb46068adaf7f82468afe4", "placeholder": "\u200b", "style": "IPY_MODEL_8cdf89eec04e44aaa545bdf401de4064", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200753.81it/s]"}}, "a5d124070783451685b91ab963b34e9b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_91e0d2b3afaa4c4e9f0de1191ccc8ec3", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_b6080afec6d648bc9504093aa451f5c9", "tabbable": null, "tooltip": null, "value": 40.0}}, "aa956cc47c8143409881ad4f24fbefdb": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_264ed645760b4809b20d48838416b280", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_7769b9125b1c44afa9c0ac053f0615a1", "tabbable": null, "tooltip": null, "value": 40.0}}, "ab5e9d4d3a6f4083a84c01c00bd07f19": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "ae9c6ddad1f645eb9c5fe58940fe3fbe": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_8e3b8f8ea1644f4f8232031e6bb14f6e", "placeholder": "\u200b", "style": "IPY_MODEL_dab43bb5615f4c8eb67ad2c3cbf722b5", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.59it/s]"}}, "af4287e9a5134eca956acf8d5cde1740": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_3ba035da04cc47c6a2cf95f874bed53c", "placeholder": "\u200b", "style": "IPY_MODEL_0c8f556c34ec4bcabbc8109fca7ba8e9", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200753.42it/s]"}}, "b393c8ff6bcf46dbb417d191c6f2463b": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_ce397d8b1e3b48dd83ada11545c3fda5", "max": 2.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_1904dd68c0cc4ff998d80873016945d3", "tabbable": null, "tooltip": null, "value": 2.0}}, "b6080afec6d648bc9504093aa451f5c9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "b8d3c8eb91e14a3e9f18eae0a560f0f0": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "b909dd9cdb034fa1bcb49b49848f3e4b": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "ba0cdacee4b847179bd5f5b44ac18754": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_47dff206eb1d4a84a9fcc4764599767e", "placeholder": "\u200b", "style": "IPY_MODEL_f4e8ae2733504470ac3585b7589dfede", "tabbable": null, "tooltip": null, "value": "Testing\u2007DataLoader\u20070:\u2007100%"}}, "bbb938f242e649c1a608a813718a8d39": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "100%"}}, "bf1c209555a04d318154f875d75388df": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "bf8cceb9fd9d432ca20c7dd62d7d2b9e": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "bfdd7fb6ec194c56b85512420c753235": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "c20306ee642147648dad35dc6defe3b0": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "c2529610166b4f3082534cbe25cbbeb5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_d98ea6c35edd4e9486ba16ba4365fa24", "placeholder": "\u200b", "style": "IPY_MODEL_4fb6c9a4fa0744b3a17c85b792df8ad0", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.59it/s]"}}, "c34edd6adfa04a8080acb13bc4983151": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "c3512771379a4931adca51c9b840f929": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "c5b574e19eec42b2a8bb6108878002df": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "c606a468311b4c1fb04a7f97eda63bfd": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "c62d81a838024bb3a0e58e5b34184da9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_4fe4919b47ed437680af2cd34e821b44", "placeholder": "\u200b", "style": "IPY_MODEL_2285239914df4652afe0d3eb947fa00d", "tabbable": null, "tooltip": null, "value": "Testing\u2007DataLoader\u20070:\u2007100%"}}, "c70d168c418f4694bd736b1b96b55221": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "c816add18db64f5eac30289cb766ad64": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "c872f7e6a55940fba8d239f5f8d1d6df": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_828e065b78ba4837a7c791d1a78e7be5", "IPY_MODEL_75edc5acfd0d45ce8da06a7f52a54a8a", "IPY_MODEL_edac1028c88f4a23820a7a78ed49d39f"], "layout": "IPY_MODEL_84da2ed7d1d642b7964d20bee1d114fa", "tabbable": null, "tooltip": null}}, "c988f23e885a4b179b9c167683cb46b5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "cc90b78e2bcb441caaa3ae948653a5a2": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "ce397d8b1e3b48dd83ada11545c3fda5": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "cfc6c164a7104481a12463908bcde7da": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "d012b519e90545a2b99c9856be6decb3": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "d49a1cb815024a83919f66f67633e6a4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_f32d109b02914ebbbc4ac2a07c4c62e1", "max": 2.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_0fa79e9e572648a6be950ce91498c68c", "tabbable": null, "tooltip": null, "value": 2.0}}, "d5e8d539ea424a1baefd1e856a2658a4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_165d268c04274cedaf65b412aa8ba7af", "IPY_MODEL_aa956cc47c8143409881ad4f24fbefdb", "IPY_MODEL_af4287e9a5134eca956acf8d5cde1740"], "layout": "IPY_MODEL_1d4d1b1f0e7e47e9b3f5ed5565fc24e4", "tabbable": null, "tooltip": null}}, "d69693c975044374a88f5c8a4fe6552f": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "d98ea6c35edd4e9486ba16ba4365fa24": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "dab43bb5615f4c8eb67ad2c3cbf722b5": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "db98b217589b40739d834c2a776b639d": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "ProgressView", "bar_style": "", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_90f96c8762fa48fa8a941b1f5aefbc00", "max": 40.0, "min": 0.0, "orientation": "horizontal", "style": "IPY_MODEL_24b773f4a4e9492e9f61d71fbbdd8eea", "tabbable": null, "tooltip": null, "value": 40.0}}, "dcdeda19fa9f4f73ae817dc7a88c0416": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "df8027cfcea2404cb638eace31d015ae": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "dfe90f30b6314d42927f09521c987485": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_5552e00396b5469782fcd4cd6553de10", "placeholder": "\u200b", "style": "IPY_MODEL_3f705a27827b477dbd3bf45c9ad56100", "tabbable": null, "tooltip": null, "value": "Epoch\u20074:\u2007100%"}}, "e1155795aee74027b43aaa56cf4e93ff": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "e49f3f0f600b447681837035e944f0c3": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_0c3167c03e564a098af652381f20706f", "IPY_MODEL_928b8e5d20bc46a6a61bd2a45e89e271", "IPY_MODEL_606b8a7c8e654fbea13acca4d351fa9b"], "layout": "IPY_MODEL_c70d168c418f4694bd736b1b96b55221", "tabbable": null, "tooltip": null}}, "e4c335716e434501999c315d058e3148": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e4d5c94b505748c5bde5da1a11f63647": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "bar_color": null, "description_width": ""}}, "e50a4bb255f345bbbe68ed0599b70452": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_e959c1fb31a24e48abc1fd27a86571ed", "placeholder": "\u200b", "style": "IPY_MODEL_73a4c2de15aa41249bcfab1c4ce98a39", "tabbable": null, "tooltip": null, "value": "\u20072/2\u2007[00:00&lt;00:00,\u200728.31it/s]"}}, "e5dafde475bb46068adaf7f82468afe4": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e93513e6b4f744999ea87fb076721657": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e93841c9e6e84e5ebcba85cd97d60049": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e959c1fb31a24e48abc1fd27a86571ed": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "e96405288a2c4c05bbbfab7cf581b415": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": "inline-flex", "flex": null, "flex_flow": "row wrap", "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": "hidden", "width": "100%"}}, "e9fb13e003474c7a9cb5c566b6565c63": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_981d669482f346cf938b84144278ffa2", "placeholder": "\u200b", "style": "IPY_MODEL_f4ea713509c64767af464cac30f2a070", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}, "edac1028c88f4a23820a7a78ed49d39f": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_f7412cbb45404e269e4657ba9e9c4558", "placeholder": "\u200b", "style": "IPY_MODEL_2ad7b401702f4026a7902575122de93f", "tabbable": null, "tooltip": null, "value": "\u200740/40\u2007[00:00&lt;00:00,\u200751.89it/s]"}}, "eec05b979b1046e783b39ccdfb315f43": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "f2ca7ee12a4349dab5e0b60a481e1eb4": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HBoxView", "box_style": "", "children": ["IPY_MODEL_dfe90f30b6314d42927f09521c987485", "IPY_MODEL_a3dde8170a7d42ac96c42923f353f721", "IPY_MODEL_54cba128a8544929be8391b19aab5436"], "layout": "IPY_MODEL_8a22f89049bb4314b2d187f34d894327", "tabbable": null, "tooltip": null}}, "f32d109b02914ebbbc4ac2a07c4c62e1": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": "2", "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "f4e8ae2733504470ac3585b7589dfede": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f4ea713509c64767af464cac30f2a070": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f565a5d498c24604aa112830eb2ba744": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": {"_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "StyleView", "background": null, "description_width": "", "font_size": null, "text_color": null}}, "f7412cbb45404e269e4657ba9e9c4558": {"model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {"_model_module": "@jupyter-widgets/base", "_model_module_version": "2.0.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "2.0.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border_bottom": null, "border_left": null, "border_right": null, "border_top": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null}}, "faf37b3cbf6849a598616998aebf96d9": {"model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": {"_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "2.0.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "2.0.0", "_view_name": "HTMLView", "description": "", "description_allow_html": false, "layout": "IPY_MODEL_8fc732a5c3cc4cdea60e9969fb18d978", "placeholder": "\u200b", "style": "IPY_MODEL_3f17988eaa5a4da3abea3738ddf84789", "tabbable": null, "tooltip": null, "value": "Validation\u2007DataLoader\u20070:\u2007100%"}}}, "version_major": 2, "version_minor": 0}}}, "nbformat": 4, "nbformat_minor": 5}