U ʹj{'@sddlZddlZddlmZmZmZmZmZmZm Z ddl m Z ddl m Z mZddlmZddd d d d gZd ddddddZdddddddZGdddeZdS)N)AnyCallableDictListOptionalTupleUnion)Image)download_and_extract_archiveverify_str_arg) VisionDatasetZkingdomZphylumclassorderfamilyZgenuszRhttps://ml-inat-competition-datasets.s3.amazonaws.com/2017/train_val_images.tar.gzzOhttps://ml-inat-competition-datasets.s3.amazonaws.com/2018/train_val2018.tar.gzzOhttps://ml-inat-competition-datasets.s3.amazonaws.com/2019/train_val2019.tar.gzzGhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/train.tar.gzzLhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/train_mini.tar.gzzEhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/val.tar.gz)2017Z2018Z2019 2021_trainZ2021_train_miniZ 2021_validZ 7c784ea5e424efaec655bd392f87301fZ b1c6952ce38f31868cc50ea72d066cc3Z c60a6e2962c9b8ccbd458d12c8582644Z e0526d53c7f7b2e3167b2b43bb2690edZ db6ed8330e634445efc8fec83ae81442Z f6f6e0e242e3d4c9569ba56400938afcc seZdZdZdeeeeeefeeeee ddfdd Z dd d d Z dd d d Z e eeefdddZe d ddZee edddZe d ddZdd ddZZS) INaturalistaF`iNaturalist `_ Dataset. Args: root (string): Root directory of dataset where the image files are stored. This class does not require/use annotation files. version (string, optional): Which version of the dataset to download/use. One of '2017', '2018', '2019', '2021_train', '2021_train_mini', '2021_valid'. Default: `2021_train`. target_type (string or list, optional): Type of target to use, for 2021 versions, one of: - ``full``: the full category (species) - ``kingdom``: e.g. "Animalia" - ``phylum``: e.g. "Arthropoda" - ``class``: e.g. "Insecta" - ``order``: e.g. "Coleoptera" - ``family``: e.g. "Cleridae" - ``genus``: e.g. "Trichodes" for 2017-2019 versions, one of: - ``full``: the full (numeric) category - ``super``: the super category, e.g. "Amphibians" Can also be a list to output a tuple with all specified target types. Defaults to ``full``. transform (callable, optional): A function/transform that takes in an PIL image and returns a transformed version. E.g, ``transforms.RandomCrop`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. download (bool, optional): If true, downloads the dataset from the internet and puts it in root directory. If dataset is already downloaded, it is not downloaded again. rfullNF)rootversion target_type transformtarget_transformdownloadreturnc s t|dt|_tjtj||||dtj |dd|rH| | sXt dg|_ i|_g|_t|tsz|g}|jdddkrdd |D|_|nd d |D|_|g|_t|j D]8\}}ttj|j|} | D]} |j|| fqqdS) Nr)rrT)exist_okzHDataset not found or corrupted. You can use download=True to download itZ2021cSsg|]}t|ddtqS)rr)r)r CATEGORIES_2021.0tr"_/var/www/html/bwave/python/venv/lib/python3.8/site-packages/torchvision/datasets/inaturalist.py asz(INaturalist.__init__..cSsg|]}t|ddqS)r)rsuper)r rr"r"r#r$ds)r DATASET_URLSkeysrr%__init__ospathjoinmakedirsr_check_integrity RuntimeErrorall_categoriescategories_indexcategories_map isinstancelistr _init_2021 _init_pre2021index enumeratelistdirrappend) selfrrrrrr dir_indexdir_namefilesfname __class__r"r#r(Bs,   zINaturalist.__init__)rcCstt|j|_ddtD|_t|jD]\}}|d}t |dkrZt d|d|d|dkrt d |dd |di}t t|d d D]J\}}||j|kr|j||}nt |j|}||j||<|||<q|j |q,d S)zInitialize based on 2021 layoutcSsi|] }|iqSr"r")r kr"r"r# usz*INaturalist._init_2021.._zUnexpected category name z, wrong number of piecesrZ05dzUnexpected category id z , expecting r N)sortedr)r8rr/rr0r7splitlenr.zipr1r9)r:r;r<piecesZcat_mapcatnamecat_idr"r"r#r4os    zINaturalist._init_2021c Csbdii|_d}tt|j}t|D] \}}||jd|<tttj|j|}|D]}|jdkrx|}|d7}n0z t |}Wn"t k rt d|YnX|t |j krt |j }|j ig||d|jdg||d|j |rt d|d|i|j |<tj|||j|<q\q&t|j D]\} } | s>t d| q>d S) z$Initialize based on 2017-2019 layoutr%rrr z!Unexpected non-numeric dir name: zDuplicate category zMissing category N)r0rFr)r8rr7r*r+rint ValueErrorr.rHr1extendr/) r:Z cat_indexZsuper_categoriesZsindexZscatZ subcategoriesZsubcatZsubcat_iZold_lenZcindexcr"r"r#r5s2      zINaturalist._init_pre2021)r6rcCs|j|\}}ttj|j|j||}g}|jD],}|dkrN| |q6| |j ||q6t |dkrxt |n|d}|j dk r| |}|jdk r||}||fS)z Args: index (int): Index Returns: tuple: (image, target) where the type of target specified by target_type. rr rN)r6r openr)r*r+rr/rr9r1rHtuplerr)r:r6rMr>Zimgtargetr!r"r"r# __getitem__s       zINaturalist.__getitem__cCs t|jS)N)rHr6r:r"r"r#__len__szINaturalist.__len__) category_type category_idrcCsn|dkr|j|S||jkr.td|dn<|j|D]\}}||kr<|Sqs*$