U
e{jF @ s d Z ddlZddlmZ ddlmZ ddlmZ ddlm Z G dd d e
Z G d
d d Z d d
Z
G dd de jZG dd de jZG dd de jZG dd de jZG dd de jZG dd de jZdS )zAn extensible HTML table reader and writer.
html.py:
Classes to read and write HTML tables
`BeautifulSoup `_
must be installed to read HTML tables.
N)deepcopy)Column)writer )corec @ s e Zd ZdZdd Zdd ZdS )
SoupStringz8
Allows for strings to hold BeautifulSoup data.
c O s t j| f||S N)str__new__)clsargskwargs r T/var/www/html/bwave/python/venv/lib/python3.8/site-packages/astropy/io/ascii/html.pyr
s zSoupString.__new__c C s
|| _ d S r )soup)selfvalr r r __init__ s zSoupString.__init__N)__name__
__module__ __qualname____doc__r
r r r r r r s r c @ s e Zd ZdZdd Zdd ZdS )
ListWriterzD
Allows for XMLWriter to write to a list instead of a file.
c C s
|| _ d S r )out)r r r r r r % s zListWriter.__init__c C s | j | d S r )r append)r datar r r write( s zListWriter.writeN)r r r r r r r r r r r s r c C sd | dks| j dkrdS d|kr&|dkS |d }t|trNd| jkoL| d |kS t|tr`||kS dS )zb
Checks whether the given BeautifulSoup tag is the table
the user intends to process.
NtableFtable_idr id)name
isinstancer attrsint)r htmldictZnumtabler r r r identify_table, s
r% c @ s e Zd ZdZdd ZdS ) HTMLInputterz
Input lines of HTML in a valid form.
This requires `BeautifulSoup
`_ to be installed.
c
C s zddl m} W n tk
r. tdY nX d| jkrjt tdd |d |}W 5 Q R X n|d || jd }|
d}t |D ]"\}}t || j|d r|} qqt
| jd
trd | jd
}nd | jd
d
}td| ddd |
dD } | S )zh
Convert the given input into a list of SoupString rows
for further processing.
r )
BeautifulSoupz3BeautifulSoup must be installed to read HTML tablesparserignorez&.*no parser was explicitly specified.*
r r r znumber zid ''zERROR: HTML table z
not foundc S s g | ] }t |qS r )r .0xr r r
o s z.HTMLInputter.process_lines..tr)Zbs4r' ImportErrorr ZOptionalTableImportErrorhtmlwarningscatch_warningsfilterwarningsjoinfind_all enumerater% r! r# InconsistentTableError)
r linesr' r ZtablesiZpossible_tabler Z err_descrZ soup_listr r r
process_linesJ s6
zHTMLInputter.process_linesN)r r r r r< r r r r r& B s r& c @ s e Zd ZdZdd ZdS ) HTMLSplitterz
Split HTML table data.
c c sx |D ]X}t |tstd|j}|d}|r>dd |D V |d}|rdd |D V qt|dkrttdd S )
z=
Return HTML data from lines as a generator.
'HTML lines should be of type SoupStringthc S s2 g | ]*}| d r$|j |d fn|j qS colspan)Zhas_attrtextstripr- elr r r r/ s z)HTMLSplitter.__call__..tdc S s g | ]}|j qS r )rB rC rD r r r r/ s r z.HTML tables must contain data in a tagN)r! r TypeErrorr r7 lenr r9 )r r: liner Zheader_elementsZ
data_elementsr r r __call__y s
zHTMLSplitter.__call__N)r r r r rJ r r r r r= t s r= c s< e Zd ZdZeeeeeegZ fddZ
Z S )
HTMLOutputterz
Output the HTML data as an ``astropy.table.Table`` object.
This subclass allows for the final table to contain
multidimensional columns (defined using the colspan attribute
of | ).
c s g }d}|t |k r|| }t|drr||||j }t|j}ttdd |D |_| | ||j7 }q| | |d7 }qt
||S )z?
Process the data in multidimensional columns.
r rA c S s g | ]
}|j qS r )str_valsr, r r r r/ s z*HTMLOutputter.__call__..r ) rH hasattrrA r r r listziprL r superrJ )r colsmetanew_colsZcol_numcolZ span_colsnew_col __class__r r rJ s
zHTMLOutputter.__call__) r r r r r Z
convert_numpyr# floatr Zdefault_convertersrJ
__classcell__r r rV r rK s rK c @ s e Zd ZeZdd Zdd ZdS )
HTMLHeaderc C s@ t |D ]2\}}t|ts"td|j}|jdk r| S qdS )zE
Return the line number at which header data begins.
r> N)r8 r! r rG r r? r r: r; rI r r r r
start_line s
zHTMLHeader.start_linec C s g | _ g }| jD ]}t|trtj|d d}t|d |_| j | ||d t dt|d D ] }| j td |d qhq| j tj|d || q|| _dS )zU
Set columns from header names, handling multicolumns appropriately.
r )r r N)
rQ namesr! tupler r r# rA r range)r Z new_namesr rT r; r r r _set_cols_from_names s
z HTMLHeader._set_cols_from_namesN)r r r r= splitter_classr\ ra r r r r rZ s rZ c @ s e Zd ZeZdd Zdd ZdS )HTMLDatac C s^ t |D ]F\}}t|ts"td|j}|jdk r|jdk rFtd| S qtddS )zD
Return the line number at which table data begins.
r> Nz9HTML tables cannot have headings and data in the same rowz!No start line found for HTML data) r8 r! r rG r rF r? r r9 r[ r r r r\ s
zHTMLData.start_linec C sP d}t |D ].\}}t|ts&td|j}|jdk r |}q |dkrHdS |d S )zB
Return the line number at which table data ends.
r> Nr )r8 r! r rG r rF )r r: Z
last_indexr; rI r r r r end_line s
zHTMLData.end_lineN)r r r r= rb r\ re r r r r rc s rc c sb e Zd ZdZdZdgZdZdZeZ e
Z e Z
dZi f fdd Z fdd Zd
d Zd d
Z ZS )HTMLaq
HTML format table.
In order to customize input and output, a dict of parameters may
be passed to this class holding specific customizations.
**htmldict** : Dictionary of parameters for HTML input/output.
* css : Customized styling
If present, this parameter will be included in a |