U e{j7@sdZddlZddlZddlZddlZddlmZddlmZddl m Z m Z dgZ Gdd d e j ZGd d d e jZGd d d e jZdS)zAn extensible ASCII table reader and writer. cds.py: Classes to read CDS / Vizier table format :Copyright: Smithsonian Astrophysical Observatory (2011) :Author: Tom Aldcroft (aldcroft@head.cfa.harvard.edu) N)suppress)Unit)core fixedwidth*c@s:eZdZdZejejejejdZdZ ddZ ddZ dS) CdsHeaderCDS)efiaNcCsBtd|j}|s8td|jd|jd|jd|dS)Nz\d*(\S)z Unrecognized z format "z " for column""r)rematchraw_typelower ValueError_subfmtnamegroup)selfcolrrS/var/www/html/bwave/python/venv/lib/python3.8/site-packages/astropy/io/ascii/cds.pyget_type_map_key&s zCdsHeader.get_type_map_keyc Cs4|jr|jjrd}t}||j}g}d}|D]}|}|rl|||dr|d7}|dkrqq2t d|t j }|r2ddt d | d D}|D]&} t|jj| rd }||q2qq2td |jjd |jd} t|D]2\} }t d|t j rd } q| r| d8} q.qtdt dt j} g} t|| ddD]}|drjq| |}|rtj| d d}tt dd| dp| dd|_t| d|_| d}|dkrd|_nt|ddd|_| dpd|_| d|_|||_ t d|jt j}|r| d pFd|_t!|j tj"rdd!}nd"}| d#d$krd|_#d%D] }|jj$d$|||j%fqn6| d#|_#|j#dkrd|_#|jj$|j#||j%f| |n.| r| d&j|7_ntd'|d(qRd)d| D|_&| |_'dS)*z Initialize the header Column objects from the table ``lines`` for a CDS/MRT header. Parameters ---------- lines : list List of table lines Frz------z=======rz/Byte-by-byte Description of file: (?P.+)$cSsg|] }|r|qSrr).0srrr Tsz&CdsHeader.get_cols..z[, ]+rTzCan't find table z in zByte-by-byte Descriptionz-no line with "Byte-by-byte Description" foundz\s* (?P \d+ \s* -)? \s* (?P \d+) \s+ (?P [\w.]+) \s+ (?P \S+) \s+ (?P \S+) (\s+ (?P \S.*))?Nrz[-\s]startendZunitsz---cdswarn)formatZ parse_strictdescrr(zu(?P[\[\]] \S* [\[\]])?\?((?P=)(?P \S*))?(?P[-+]?[=]?)(\s* (?P \S.*))?Zdescriptiontextnan0Znullval-)rrr!zLine "z" not parsable as CDS headercSsg|] }|jqSrr")rxrrrr s)(readmedata table_namerZ BaseInputter get_linesstripappend startswithrr IGNORECASEsplitrfnmatchInconsistentTableError enumeratercompileVERBOSE itertoolsisliceColumnintsubr$r%unitr descriptionrZ get_col_typetype issubclass FloatTypenullZ fill_valuesrnamescols)rlinesZ in_headerZreadme_inputterr Z comment_lineslinerrIpatternZ found_lineZ i_col_defZ re_col_defrJrrCZfillvalr rrrget_cols/s                zCdsHeader.get_cols) __name__ __module__ __qualname__rrrGZIntTypeZStrTypeZ col_type_mapr0rrNrrrrrs rc@s"eZdZdZdZejZddZdS)CdsDatazCDS table data readerr cCsP|jjr|jr|Sddt|D}|sSkip over CDS/MRT header by finding the last section delimitercSsg|]\}}|dr|qS)r)r6)rr r/rrrr s z)CdsData.process_lines..zNo z section delimiter foundr.rN)headerr0r2r;rr:r)rrKZ i_sectionsrrr process_liness zCdsData.process_linesN) rOrPrQ__doc__rrZFixedWidthSplitterZsplitter_classrTrrrrrRsrRcsReZdZdZdZdgZdZdZeZ e Z d fdd Z d dd Z fd d ZZS)CdsaVCDS format table. See: http://vizier.u-strasbg.fr/doc/catstd.htx Example:: Table: Table name here = ============================================================================== Catalog reference paper Bibliography info here ================================================================================ ADC_Keywords: Keyword ; Another keyword ; etc Description: Catalog description here. ================================================================================ Byte-by-byte Description of file: datafile3.txt -------------------------------------------------------------------------------- Bytes Format Units Label Explanations -------------------------------------------------------------------------------- 1- 3 I3 --- Index Running identification number 5- 6 I2 h RAh Hour of Right Ascension (J2000) 8- 9 I2 min RAm Minute of Right Ascension (J2000) 11- 15 F5.2 s RAs Second of Right Ascension (J2000) -------------------------------------------------------------------------------- Note (1): A CDS file can contain sections with various metadata. Notes can be multiple lines. Note (2): Another note. -------------------------------------------------------------------------------- 1 03 28 39.09 2 04 18 24.11 **About parsing the CDS format** The CDS format consists of a table description and the table data. These can be in separate files as a ``ReadMe`` file plus data file(s), or combined in a single file. Different subsections within the description are separated by lines of dashes or equal signs ("------" or "======"). The table which specifies the column information must be preceded by a line starting with "Byte-by-byte Description of file:". In the case where the table description is combined with the data values, the data must be in the last section and must be preceded by a section delimiter line (dashes or equal signs only). **Basic usage** Use the ``ascii.read()`` function as normal, with an optional ``readme`` parameter indicating the CDS ReadMe file. If not supplied it is assumed that the header information is at the top of the given table. Examples:: >>> from astropy.io import ascii >>> table = ascii.read("data/cds.dat") >>> table = ascii.read("data/vizier/table1.dat", readme="data/vizier/ReadMe") >>> table = ascii.read("data/cds/multi/lhs2065.dat", readme="data/cds/multi/ReadMe") >>> table = ascii.read("data/cds/glob/lmxbrefs.dat", readme="data/cds/glob/ReadMe") The table name and the CDS ReadMe file can be entered as URLs. This can be used to directly load tables from the Internet. For example, Vizier tables from the CDS:: >>> table = ascii.read("ftp://cdsarc.u-strasbg.fr/pub/cats/VII/253/snrs.dat", ... readme="ftp://cdsarc.u-strasbg.fr/pub/cats/VII/253/ReadMe") If the header (ReadMe) and data are stored in a single file and there is content between the header and the data (for instance Notes), then the parsing process may fail. In this case you can instruct the reader to guess the actual start of the data by supplying ``data_start='guess'`` in the call to the ``ascii.read()`` function. You should verify that the output data table matches expectation based on the input CDS file. **Using a reader object** When ``Cds`` reader object is created with a ``readme`` parameter passed to it at initialization, then when the ``read`` method is executed with a table filename, the header information for the specified table is taken from the ``readme`` file. An ``InconsistentTableError`` is raised if the ``readme`` file does not have header information for the given table. >>> readme = "data/vizier/ReadMe" >>> r = ascii.get_reader(ascii.Cds, readme=readme) >>> table = r.read("data/vizier/table1.dat") >>> # table5.dat has the same ReadMe file >>> table = r.read("data/vizier/table5.dat") If no ``readme`` parameter is specified, then the header information is assumed to be at the top of the given table. >>> r = ascii.get_reader(ascii.Cds) >>> table = r.read("data/cds.dat") >>> #The following gives InconsistentTableError, since no >>> #readme file was given and table1.dat does not have a header. >>> table = r.read("data/vizier/table1.dat") Traceback (most recent call last): ... InconsistentTableError: No CDS section delimiter found Caveats: * The Units and Explanations are available in the column ``unit`` and ``description`` attributes, respectively. * The other metadata defined by this format is not available in the output table. r&FzCDS format tableNcst||j_dS)N)super__init__rSr0)rr0 __class__rrrXDs z Cds.__init__cCstdS)zrar contextlibrZ astropy.unitsrr#rrZ__doctest_skip__Z BaseHeaderrZBaseDatarRZ BaseReaderrVrrrrs   "