U e{j@stdZddlZddlmZddlmZmZdgZddZd d Z d d Z d dZ ddZ ddZ ddZdddZdS)zy Validates a large collection of web-accessible VOTable files, and generates a report as a directory tree of HTML files. N)get_pkg_data_filename)htmlresultmake_validation_reportcCs tjtS)N)ospathdirname__file__r r `/var/www/html/bwave/python/venv/lib/python3.8/site-packages/astropy/io/votable/validator/main.py get_srcdirsr c Csddl}dddg}t}g}|D]}td|d}||db}|D]R} t|| } | |krtj| |d} || d <W5QRX| | | | qJW5QRXq |S) NrZgoodbrokenZ incorrectzdata/urls/cone.z.dat.gzrbrootexpected) gzipsetropen readlinesnextstriprResultappendadd) destdirsrtypesseenurlstypefilenamefdurlrr r r get_urlss    r&c Cs.|\}}tj||d}|W5QRXdSNr)rrZdownload_xml_contentargsr$rr%r r r download,sr*c Cs.|\}}tj||d}|W5QRXdSr')rr validate_vor(r r r r+2sr+c Cs>|\}}}tj||d}|ddkr0||W5QRXdS)NrZ network_error)rrZvalidate_with_votlint)r)Zpath_to_stilts_jarr$rr%r r r votlint_validate8s  r,c Cs0|\}}tj||d}t|W5QRXdSr')rrrZ write_resultr(r r r write_html_result?sr-cCs$|\}}}tj|f|d|idS)Ntotal)rZwrite_index_table)r)subsetrr.r r r write_subindexEs r0$astropy.io.votable.validator.resultsTc sddlm}m}m}dk r6tjs6tdtjtj dkrx|dd}t |W5QRXnHddD|d d|D]&}t j |d } t | d <W5QRXqfd dD} |d d|jt| |d|dd|jt| |ddk r>|ddfddD} |jt| |d|dd|jt| |d|dd}t |} W5QRX|ddt| |ddfdd| D} |jt| |ddS)a Validates a large collection of web-accessible VOTable files. Generates a report as a directory tree of HTML files. Parameters ---------- urls : list of str, optional If provided, is a list of HTTP urls to download VOTable files from. If not provided, a built-in set of ~22,000 urls compiled by HEASARC will be used. destdir : path-like, optional The directory to write the report to. By default, this is a directory called ``'results'`` in the current directory. If the directory does not exist, it will be created. multiprocess : bool, optional If `True` (default), perform validations in parallel using all of the cores on this machine. stilts : path-like, optional To perform validation with ``votlint`` from the the Java-based `STILTS`_ VOTable parser, in addition to `astropy.io.votable`, set this to the path of the ``'stilts.jar'`` file. ``java`` on the system shell path will be used to run it. Notes ----- Downloads of each given URL will be performed only once and cached locally in *destdir*. To refresh the cache, remove *destdir* first. r) ProgressBarSpinner color_printNz does not exist.z Loading URLsgreencSsg|]}t|tr|qSr ) isinstancestrencode.0r$r r r ~s z*make_validation_report..z Marking URLsrrcsg|] }|fqSr r r9)rr r r;szDownloading VO files) multiprocesszValidating VO fileszValidating with votlintcsg|]}|fqSr r )r:x)rstiltsr r r;szGenerating HTML fileszGrouping resultszGenerating indexzGenerating subindicescsg|]}|tfqSr )len)r:r/)rr r r r;s)Zastropy.utils.consoler2r3r4rrexists ValueError expanduserabspathr&rrr!mapr*r+r,r-Zget_result_subsetsrZ write_indexr0)r rr<r>r2r3r4rr$r%r)Z votlint_argsZsubsetsZ subindex_argsr )rr>r r rJs@'              )Nr1TN)__doc__rZastropy.utils.datarrr__all__r r&r*r+r,r-r0rr r r r s