U e{j(9@sdZddlZddlZddlZddlmZddlmZdZ dZ ddgZ d d Z d d Z d dZdddZddZdddZddZdS)z This package contains functions for reading and writing HDF5 tables that are not meant to be used directly, but instead are available as readers/writers in `astropy.table`. See :ref:`astropy:table_io` for more details. N)AstropyUserWarning)NOT_OVERWRITING_MSGsHDF  Z__table_column_meta__read_table_hdf5write_table_hdf5cCs |dtS)N.)META_KEYpathr S/var/www/html/bwave/python/venv/lib/python3.8/site-packages/astropy/io/misc/hdf5.py meta_pathsr cs(ddlgfdd}||S)z4 Find all structured arrays in an HDF5 file rNcs&t|jr"|jjdkr"|dS)NV) isinstanceDatasetdtypekindappend)nameobjh5pyZstructured_arraysr r append_structured_arrays$sz=_find_all_structured_arrays..append_structured_arrays)rZ visititems)handlerr rr _find_all_structured_arrayss  rc Os|dk r4|}z|d}W5||X|tkS|dk rF|dSz ddl}Wntk rhYdSXt|d|j|j |j fSdS)N)z.hdf5z.h5rF) tellseekreadHDF5_SIGNATUREendswithr ImportErrorrFileGroupr)originfilepathfileobjargskwargsloc signaturerr r r is_hdf5,s   r*Tc Csz ddl}Wntk r(tdYnX|}t||j|jfr|dk rz ||}Wn(ttfk r~td|dYnXt||jr~t |}t |dkrtd|n\t |dkr~|dkr|dn|d|d}t |dkrt d |d t t||d Snnt||js~t|d rTz |j}Wntk rRtd YnX||d}zt|||dWS|Xddlm}m}m} |t|} t|jk} |dk ot||k} | s| r| r|dd|t|D} n|dd|jtD} dt| kr&| d| _dd| dD}| j!"D]8}dD],}|||jkrJt#||||j|qJqB| $| } n| j%|j|s| &| S)a! Read a Table object from an HDF5 file This requires `h5py `_ to be installed. If more than one table is present in the HDF5 file or group, the first table is read in and a warning is displayed. Parameters ---------- input : str or :class:`h5py.File` or :class:`h5py.Group` or :class:`h5py.Dataset` If a string, the filename to read the table from. If an h5py object, either the file or the group object to read the table from. path : str The path from which to read the table inside the HDF5 file. This should be relative to the input file or group. character_as_bytes : bool If `True` then Table columns are left as bytes. If `False` then Table columns are converted to unicode. rN-h5py is required to read and write HDF5 fileszPath z does not existzno table found in HDF5 group /z`path= was not specified but multiple tables are present, reading in first available table (path=)rrz h5py can only open regular filesr)r character_as_bytes)Tablemeta serializecss|]}|dVqdSutf-8Ndecode.0hr r r sz"read_table_hdf5..css|]}|dVqdSr4r6r8r r r r;sr2cSsi|]}|d|qS)rr )r9xr r r sz#read_table_hdf5..datatype) descriptionformatunitr2)'rr Exceptionrr!r"KeyError ValueErrorOSErrorrlenwarningswarnrrrhasattrrAttributeError TypeErrorclose astropy.tabler1r2r3nparrayrattrsr Zget_header_from_yamllistkeyscolumnsvaluessetattrZ_construct_mixins_from_columnsupdateZconvert_bytestring_to_unicode)inputr r0rZ input_saveZarraysfr1r2r3tableZold_version_metaZnew_version_metaheaderZ header_colscolattrr r r r?sr                c Cs:ddlm}ddlm}|d||}W5QRX|S)zEncode a Table ``tbl`` that may have mixin columns to a Table with only astropy Columns + appropriate meta-data to allow subsequent decoding. r)r3)serialize_context_ashdf5)rMr3Zastropy.utils.data_infor]Zrepresent_mixins_as_columns)Ztblr3r]Z encode_tblr r r _encode_mixinss    r_Fc KsFddlm}z ddl} Wntk r4tdYnX|dkrDd}n|drVtdd|krp|dd\} } n d|} } t|| j | j fr t t | dkr| dkrtd n| dkrtd || rz || } Wn$ttfk r|| } YnXn|} nt|trtj|rR|sR|rD|sDt|ntt|| ||rbd nd } zt|| |||||d WS| Xntd| | kr|r|r| | =|r| d| kr| | d=ntd|dt|}tdd|Dr|j dd}|!|dkrb|D]6}dD]*}t"|j#|ddifkr2tdt$q2q*|r|dkrvd}| j%| f|&|d|}n| j%| fd|&i|}|r|'|}t()dd|D}| j%t*| |dn\|jD]T}|j|}z||j+|<Wn4tk r<td|d t,|d!t$YnXqdS)"a Write a Table object to an HDF5 file This requires `h5py `_ to be installed. Parameters ---------- table : `~astropy.table.Table` Data table that is to be written to file. output : str or :class:`h5py.File` or :class:`h5py.Group` If a string, the filename to write the table to. If an h5py object, either the file or the group object to write the table to. path : str The path to which to write the table inside the HDF5 file. This should be relative to the input file or group. If not specified, defaults to ``__astropy_table__``. compression : bool or str or int Whether to compress the table inside the HDF5 file. If set to `True`, ``'gzip'`` compression is used. If a string is specified, it should be one of ``'gzip'``, ``'szip'``, or ``'lzf'``. If an integer is specified (in the range 0-9), ``'gzip'`` compression is used, and the integer denotes the compression level. append : bool Whether to append the table to an existing HDF5 file. overwrite : bool Whether to overwrite any existing file without warning. If ``append=True`` and ``overwrite=True`` then only the dataset will be replaced; the file/group will not be overwritten. serialize_meta : bool Whether to serialize rich table meta-data when writing the HDF5 file, in particular such data required to write and read back mixin columns like ``Time``, ``SkyCoord``, or ``Quantity`` to the file. **create_dataset_kwargs Additional keyword arguments are passed to ``h5py.File.create_dataset()`` or ``h5py.Group.create_dataset()``. r)r2Nr+Z__astropy_table__r,z,table path should end with table name, not /r-zUtable path should always be set via the path= argument when writing to existing fileszBtable path was not set via the path= argument; using default path aw)r compressionr overwriteserialize_metaz9output should be a string or an h5py File or Group objectz.__table_column_meta__zTable z already existscss|]}|jjjdkVqdS)UN)inforr)r9r[r r r r;Ssz#write_table_hdf5..F)Z copy_data)rAr@r?r2ztable contains column(s) with defined 'unit', 'format', 'description', or 'meta' info attributes. These will be dropped since serialize_meta=False.Tgzip)datarbrhcSsg|]}|dqS)r5)encoder8r r r vsz$write_table_hdf5..)rhz Attribute `z ` of type zm cannot be written to HDF5 files - skipping. (Consider specifying serialize_meta=True to write all meta data))-rMr2rr rBrrDrsplitrr!r"rFrQrRrGrHrCZ create_groupstrosr existsremoverErr@rLrrKr_anyZitercolscopyZconvert_unicode_to_bytestringgetattrrfrZcreate_datasetZas_arrayZget_yaml_from_tablerNrOr rPtype)rYoutputr rbrrcrdZcreate_dataset_kwargsr2rgrouprZ output_grouprXr[r\ZdsetZ header_yamlZheader_encodedkeyvalr r r rs/                    cCsFddlm}ddlm}|d|t|d|t|d|t dS)z) Register HDF5 with Unified I/O. r)registry)r1r^N) Z astropy.iorxrMr1Zregister_readerrZregister_writerrZregister_identifierr*)Z io_registryr1r r r register_hdf5s   ry)NT)NFFFF)__doc__rmrGnumpyrNZastropy.utils.exceptionsrZastropy.utils.miscrrr__all__r rr*rr_rryr r r r s,    :