U
ʹjA @ sl d dl Zd dlmZmZmZmZmZ d dlZ d dl
m Z ddl m
Z
mZmZ ddlmZ G dd deZdS ) N)AnyCallablecastOptionalTuple)Image )check_integrity download_and_extract_archiveverify_str_arg)
VisionDatasetc s& e Zd ZdZdZdZdZdZdZdZ dd gd
d gd d
ggZ
ddgddggZ dZ d-e
e
ee ee ee edd fdd
Zee ee dddZeeeef d d d Zed d d!Zd.e
ee
eejeej f d"d#d$Zed d%d&Zdd d'd(Z e
d d)d*Z ee ddd+d,Z Z S )/STL10a `STL10 `_ Dataset.
Args:
root (string): Root directory of dataset where directory
``stl10_binary`` exists.
split (string): One of {'train', 'test', 'unlabeled', 'train+unlabeled'}.
Accordingly, dataset is selected.
folds (int, optional): One of {0-9} or None.
For training, loads one of the 10 pre-defined folds of 1k samples for the
standard evaluation procedure. If no value is passed, loads the 5k samples.
transform (callable, optional): A function/transform that takes in an PIL image
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
download (bool, optional): If true, downloads the dataset from the internet and
puts it in root directory. If dataset is already downloaded, it is not
downloaded again.
Z stl10_binaryz9http://ai.stanford.edu/~acoates/stl10/stl10_binary.tar.gzzstl10_binary.tar.gzZ 91f7769df0f17e558f3565bffb0c7dfbzclass_names.txtzfold_indices.txtz train_X.binZ 918c2871b30a85fa023e0c44e0bee87fz train_y.binZ 5a34089d4802c674881badbb80307741zunlabeled_X.binZ 5242ba1fed5e4be9e1e742405eb56ca4z
test_X.binZ 7f263ba9f9e0b06b93213547f721ac82z
test_y.binZ 36f9794fa4beb8a2c72628de14fa638e)traintrain+unlabeled unlabeledtestr NF)rootsplitfolds transformtarget_transformdownloadreturnc s t j|||d t|d| j| _| || _|r<| n| sLt d| | jdkr|
| j d d | j d d \| _ | _
ttj| j
| _
| | n| jdkr>|
| j d d | j d d \| _ | _
ttj| j
| _
| | |
| j d d \}}t| j |f| _ t| j
td g|jd f| _
nj| jd
kr|
| j d d \| _ }td g| j jd | _
n(|
| jd d | jd d \| _ | _
tj| j| j| j} tj | rt | }
|
| _ W 5 Q R X d S ) N)r r r zHDataset not found or corrupted. You can use download=True to download itr r r r r )!super__init__r splitsr
_verify_foldsr r _check_integrity RuntimeError_STL10__loadfile
train_listdatalabelsr npndarray_STL10__load_foldsZ concatenateZasarrayshape test_listospathjoinr base_folderclass_names_fileisfileopenread
splitlinesclasses) selfr r r r r r Zunlabeled_data_Z
class_filef __class__ Y/var/www/html/bwave/python/venv/lib/python3.8/site-packages/torchvision/datasets/stl10.pyr . s6
( (
& (
zSTL10.__init__)r r c C sT |d kr |S t |tr:|tdkr&|S d}t||nd}t|t|d S )N
zDValue for argument folds should be in the range [0, 10), but got {}.z>Expected type None or int for argument folds, but got type {}.)
isinstanceintrange
ValueErrorformattype)r4 r msgr9 r9 r: r Z s
zSTL10._verify_folds)indexr c C sx | j dk r&| j| t| j | }}n| j| d }}tt|d}| jdk r\| |}| jdk rp| |}||fS )z
Args:
index (int): Index
Returns:
tuple: (image, target) where target is index of the target class.
N)r r r ) r$ r# r= r Z fromarrayr% transposer r )r4 rC Zimgtargetr9 r9 r: __getitem__f s
zSTL10.__getitem__)r c C s | j jd S )Nr )r# r( r4 r9 r9 r: __len__ s z
STL10.__len__) data_file labels_filer c C s d }|rFt j| j| j|}t|d}tj|tjdd }W 5 Q R X t j| j| j|}t|d.}tj|tjd}t |d}t
|d}W 5 Q R X ||fS )Nrb)dtyper )r ` rN )r r rM r ) r* r+ r, r r- r0 r% fromfileZuint8ZreshaperD ) r4 rI rJ r$ Zpath_to_labelsr6 Z path_to_dataZ
everythingZimagesr9 r9 r: Z
__loadfile s zSTL10.__loadfilec C s> | j | j D ],\}}tj| j| j|}t||s dS q dS )NFT)r" r) r* r+ r, r r- r )r4 filenamemd5Zfpathr9 r9 r: r s
zSTL10._check_integrityc C s8 | rtd d S t| j| j| j| jd | d S )Nz%Files already downloaded and verified)rP rQ )r printr
urlr rP tgz_md5rG r9 r9 r: r s
zSTL10.downloadc C s dj f | jS )NzSplit: {split})r@ __dict__rG r9 r9 r:
extra_repr s zSTL10.extra_reprc C s |d kr d S t j| j| j| j}t|^}| | }t j
|t j dd}| j |d d d d d d f | _ | j
d k r| j
| | _
W 5 Q R X d S )N )rL sep)r* r+ r, r r- folds_list_filer0 r1 r2 r%
fromstringZint64r# r$ )r4 r Z
path_to_foldsr6 Zstr_idxZlist_idxr9 r9 r: Z __load_folds s
zSTL10.__load_folds)r NNNF)N) __name__
__module__ __qualname____doc__r- rS rP rT r. rY r" r) r strr r= r boolr r r r rF rH r% r& r! r r rV r'
__classcell__r9 r9 r7 r: r
sF , (r
)os.pathr* typingr r r r r numpyr% ZPILr utilsr r
r Zvisionr r
r9 r9 r9 r: s