U
e{j\ @ s d Z ddlmZ ddlZddlZddlmZ ddlm Z m
Z
ddl m Z ddl
mZmZ dd lmZmZ er|dd
lmZmZ ejje d d d
d Zdd Zejje d d dd Zejje d d dd Zejje d d dd Z ejje d d dd Z ejje d d dd Z ejje d d dd Z ejjed d d d Z ejje d d d d! Z!ejje d d d"d# Z"ejje d d d$d% Z#ejje d d d&d' Z$d(d) Z%ejje d*d d+d, Z&d-d. Z'ejje d d d/d0 Z(ejje d*d d1d2 Z)ejje d*d d3d4 Z*d5d6 Z+d7d8 Z,d9d: Z-d;d< Z.d=d> Z/d?d@ Z0ejje d d dAdB Z1dS )Cz
This module tests some of the methods related to the ``HTML``
reader/writer and aims to document its functionality.
Requires `BeautifulSoup `_
to be installed.
)StringION)ascii)corehtml)Table)
HAS_BLEACHHAS_BS4 )setup_functionteardown_function)
BeautifulSoupFeatureNotFoundzrequires BeautifulSoup4)reasonc C sP t dd} t| }t|ts"tt|tjs2t|dks>t|j| ksLtdS )zB
Test to make sure the class SoupString behaves properly.
z1foo
html.parserN)r r
SoupString
isinstancestrAssertionErrorsoup)r Zsoup_str r _/var/www/html/bwave/python/venv/lib/python3.8/site-packages/astropy/io/ascii/tests/test_html.pytest_soupstring s
r c C s^ g } t | }tdD ]}|| qdD ]}|| q*| ddddddd d
d d g
ksZtd
S )zB
Test to make sure the class ListWriter behaves properly.
Zabcder r abcdeN)r Z
ListWriterrangewriter )lstwriterichr r r test_listwriter+ s
r' c C s t dd} t| i ddks ttdi ddks6tt ddj} t| i ddksXtt| i dd ksntt| d
diddkstt| d
didd kstt| d
d iddkstt| d
d idd kstdS )
z
Test to make sure that identify_table() returns whether the
given BeautifulSoup tag is the correct table to process.
zr r FNz>r r Ttable_idbarfoo)r r Zidentify_tabler table)r r r r test_identify_table; s
r, c C s dddddg} t j| dd}|jdks*tt|d jd
dgksFt|d jjd ksZtddd ddg} t j| dd
gd}|jdkstt|d jd
dgkst|d jjd kstdS )z0
Test reading a table with missing data
ascii.htmlformatFATr% z| ... |
)z...0)r2 fill_valuesN) r readmaskedr npallmaskdtypekindtable_inZdatr r r test_missing_dataW s( r? c C s ddddg} t j| dddgd}|jddgks2tt|d ksBtt j| dddgdgd
}|jdgksjtt|d ksztt|d d kstd S )
z0
Test reading a table and renaming cols
r- z | A | B |
|---|
z | 1 | 2 |
r/ r0 Br3 r2 namesr )r2 rB Z
include_namesr N)r r6 colnamesr lenr8 r9 r= r r r test_rename_colsw s" rE c C sp ddddg} t j| dd}|jdgks*tt|dks:tt j| dd gd
}|jd gks\tt|dksltd S ) z4
Test reading a table with no column header
r- r. z| 2 |
r/ r0 r1 col1r r rA N)r r6 rC r rD r= r r r
test_no_names s rG c C s ddg} t tj }tj| dddidd W 5 Q R X |dsDtt tj }tj| ddd idd W 5 Q R X |d
std S ) z\
Raise an exception with an informative error message if table_id
is not found.
z#r0 r( Zbad_idFr2 htmldictguessz(ERROR: HTML table id 'bad_id' not found$r z%ERROR: HTML table number 3 not found$N)pytestraisesr InconsistentTableErrorr r6 matchr )r> errr r r test_identify_table_fail s rP c C st dD ]>} zt jddd| idd W q tk
r@ | dkr< Y qX qtt t jddddidd W 5 Q R X d S )
z
Make sure the user can specify which back-end parser to use
and that an error is raised if the parser is invalid.
)Zlxmlxmlr Zhtml5libdata/html2.htmlr0 parserFrH r r* N)r r6 r
rK rL )rS r r r test_backend_parsers s$
rT zrequires no BeautifulSoup4c C s. t } ttj | g W 5 Q R X dS )z_
This should return an OptionalTableImportError if BeautifulSoup
is not installed.
N)r HTMLInputterrK rL r ZOptionalTableImportErrorZ
process_lines)inputterr r r test_htmlinputter_no_bs4 s rW c C s d} t | }| }W 5 Q R X t }i |_ddddg}dd ||D |ksVtdd i|_ttj || W 5 Q R X d
|jd< d d d
dg}dd ||D |kstd|jd< ddddg}dd ||D |kstdS )z
Test to ensure that HTMLInputter correctly converts input
into a list of SoupStrings representing table elements.
data/html.html<| Column 1 | Column 2 | Column 3 |
|---|
*| 1 | a | 1.05 |
z*| 2 | b | 2.75 |
+| 3 | c | -1.25 |
c S s g | ] }t |qS r r .0xr r r
s z%test_htmlinputter..r( r second<| Column A | Column B | Column C |
|---|
*| 4 | d | 10.5 |
z*| 5 | e | 27.5 |
+| 6 | f | -12.5 |
c S s g | ] }t |qS r r\ r] r r r r` s r *| C1 | C2 | C3 |
|---|
+| 7 | g | 105.0 |
z+| 8 | h | 275.0 |
,| 9 | i | -125.0 |
c S s g | ] }t |qS r r\ r] r r r r`
s N)
openr6 r rU get_linesr rK rL r rM )ffdr+ rV expectedr r r test_htmlinputter s8
rm c C s t } t tddjt tddjg}ddgddgg}t| ||ksPt|d t t
t| | W 5 Q R X t t j t| g W 5 Q R X d S )
z
Test to make sure that HTMLSplitter correctly inputs lines
of type SoupString to return a generator that gives all
header and data elements.
z4r z6zCol 1zCol 2zData 1zData 2z'| Data 3 | Data 4 |
N)
r Z HTMLSplitterr r trlistr appendrK rL TypeErrorr rM )ZsplitterlinesZ
expected_datar r r test_htmlsplitter
s*
rs c C s d} t | }| }W 5 Q R X t }i |_t }||}t||| dksZtd|jd< ||}t||| dkstd|jd< ||}t||| dkstt t
dd j t t
d
d j g}||d kst|
d tt || W 5 Q R X d S )
z
Test to ensure that the start_line method of HTMLHeader
returns the first line of header data. Uses t/html.html
for sample input.
rX rY ra r( rb r re z%r Text
Nz| Header |
|---|
)rh r6 r rU Z
HTMLHeaderri r
start_liner r r rn prp rK rL rq )rj rk r+ rV headerrr r r r test_htmlheader_start0 s@
rx c C s d} t | }| }W 5 Q R X t }i |_t }||}t||| dksZtt|| |d dksxtd|jd< ||}t||| dkstt|| |d dkstd |jd< ||}t||| d
kstt|| |d d kstt
t d d
j t
t dd
j
g}ttj || W 5 Q R X | |dkslt|d tt || W 5 Q R X tt | | W 5 Q R X dS )z
Test to ensure that the start_line and end_lines methods
of HTMLData returns the first line of table data. Uses
t/html.html for sample input.
rX rZ r r[ ra r( rc rd r rf rg z r rt Nz| Data |
)rh r6 r rU ZHTMLDatari r ru r end_liner r divrv rK rL r rM rp rq )rj rk r+ rV datarr r r r
test_htmldataa s\
r| c C s^ dddg} dddg}ddd g}t | ||gd
d }d }t |d
}|| ksZtdS )
Test to make sure that the HTML writer writes multidimensional
columns (those with iterable elements) using the colspan
attribute of .
r r r ?r @r @r r r r r r r r r r C1C2C3rB al
| C1 |
C2 |
C3 |
| 1 |
1.0 |
1.0 |
a |
a |
a |
| 2 |
2.0 |
2.0 |
b |
b |
b |
| 3 |
3.0 |
3.0 |
c |
c |
c |
r Nr r HTMLr" stripr rF col2col3r+ rl outr r r test_multicolumn_write s
+r zrequires bleachc C sf dddg} dddg}ddd g}t | ||gd
d }d }tjd
did|d }|| ksbtdS )r} r r r r~ r r )r r )zr r r r r a~
| C1 |
C2 |
C3 |
| 1 |
1.0 |
1.0 |
|
|
a |
| 2 |
2.0 |
2.0 |
|
b |
b |
| 3 |
3.0 |
3.0 |
c |
c |
c |
raw_html_colsr )rI r Nr r r r r test_multicolumn_write_escape s
+ r c C s` dddg} dddg}ddd g}t | ||gd
d }d }td
di|d | ks\tdS )z
Test to make sure that the HTML writer will not use
multi-dimensional columns if the multicol parameter
is False.
r r r r~ r r r r r r r a
| C1 |
C2 |
C3 |
| 1 |
1.0 .. 1.0 |
a .. a |
| 2 |
2.0 .. 2.0 |
b .. b |
| 3 |
3.0 .. 3.0 |
c .. c |
ZmulticolFr Nr )rF r r r+ rl r r r test_write_no_multicols s
"r c C sb t jddd} ttdf}t tjddgdfddgd fgd
|d fd gd
}t| |ks^tdS )a'
Test to make sure that the HTML reader inputs multidimensional
columns (those with iterable elements) using the colspan
attribute of | .
Ensure that any string element within a multidimensional column
casts all elements to string prior to type conversion operations.
rR r0 r1 1z2.5000000000000000001r Z1ag @r3 )r )r@ zx
yr r r r0 r r2 rI zL
| x |
<em>y</em> |
z@
| x |
y |
N)r r r" getvaluer )tr rl r r r test_raw_html_write` s r c C s ddl } tdgdgdggdddgd }t }|j|d
d |jid d
}|| ksVtt }|j|d
|jdt| jdg idd d}|| kstdS )r r Nzzy r r r r r r0 r r zv
| <script>x</script> |
<p>y</p> |
y |
tagsrv )r Zraw_html_clean_kwargszj
| <script>x</script> |
y |
y |
) bleachr r r" rC r r ro Z ALLOWED_TAGS)r r r rl r r r test_raw_html_write_clean s& r c C sn t } tdgdggdd}tj|| ddd tdgdggdd}t }tj||dd | | ksjtd
S ) zG
Test that passing fill_values should replace any matching row
r r r r r )r Hello worldr r5 r2 r r1 Nr r r r" r r
buffer_outputr
t_expectedbuffer_expectedr r r !test_write_table_html_fill_values s r c C sn t } tdgdggdd}tj|| ddd tdgdggdd}t }tj||dd | | ksjtd S )
zc
Test that passing optional column in fill_values should only replace
matching columns
r r r )r r r r r r r1 Nr r r r r 2test_write_table_html_fill_values_optional_columns s r c C s t } tdgdggdddd}tjj|d< tj|| tjdfdd tdgdggdd
}t }tj||dd | | kstd S )
zi
Test that passing masked values in fill_values should only replace
masked columns or values
r r T)i4i8)rB r7 r; r ZTESTr r r r1 N) r r r8 mar7 r r" r r r r r r (test_write_table_html_fill_values_masked s r c C s dddg} dddg}ddd g}t }t| ||gd
d }tj||d d
d dddg} dddg}ddd g}t }t| ||gd
d }tj||d
d | | kstdS )zy
Test to make sure that the HTML writer writes multidimensional
columns with correctly replaced fill_values.
r r r r~ r r r r r r r )r zr r )r r r r1 Nr )rF r r r r r r r r r 'test_multicolumn_table_html_fill_values s
r c C s t } tddddgddddggdd d
}tjj|d d d< tjj|d d d< tj|| tjd fgd
d td d ddgd d ddggdd}t }tj||d
d t| | | kst dS )z
Test that passing masked values in fill_values should only replace
masked columns or values for multidimensional tables
r r r r z--r r r T)rB r7 r ZMASKEDr r r r1 N)
r r r8 r r7 r r" printr r r r r r 5test_multi_column_write_table_html_fill_values_masked s " r c C st ddg} ddg}ddd}t | |g| d}d }t "}|j|d
|d | }W 5 Q R X || ksptd S )
z^
Test to make sure that the HTML writer writes out using the
supplied formatting.
r r gz#э%=g ,lZ04dz.2e)r r r ai
| C1 |
C2 |
| 0001 |
1.23e-11 |
| 0002 |
-9.88e+11 |
r )r2 formatsN)r keysr r" r r r )rF r r r+ rl spr r r r "test_write_table_formatted_columns s
r c C s8 ddddg} t j| dd}t|d ddgks4td S )
z8
Test reading an HTML table with unicode values
r- z| Δ | u | Δ | r/ r0 r1 rF u ΔN)r r6 r8 r9 r r= r r r test_read_html_unicode2 s r )2__doc__ior numpyr8 rK Z
astropy.ior Zastropy.io.asciir r Z
astropy.tabler Z"astropy.utils.compat.optional_depsr r commonr
r Zbs4r r
markZskipifr r' r, r? rE rG rP rT rW rm rs rx r| r r r r r r r r r r r r r r r r r sj
0
"
0
C:
:0
(+ |