U e{j6@sddlZddlZddlZddlmZddlmZddgZddZ d d Z d d Z Gd ddZ Gddde Z Gddde ZdS)N)AstropyUserWarning)get_index_by_names TableGroups ColumnGroupsc Cs,|dt||W5QRSQRXdS)NZdiscard_on_copy)Z index_mode_table_group_by)tablekeysr S/var/www/html/bwave/python/venv/lib/python3.8/site-packages/astropy/table/groups.pytable_group_bys r cs.ddlm}ddlm}t|tr(|f}t|ttfr|D]B}|jkrVt d|j r:t |j r:t d|dq:jfdd|Dd d }t|}d }nXt|t j|fr|}t|tkrt d t|td }d }ntdt||st||r||}z(|d k r2|}n |jdd}d } Wn*tk rn|}tdk} YnX||}t d g|dd |d dkd gf} t | } | st| d d| dd D]\} } || | qʈ|}|| d d}t||r||jd<t|| |d|_|S)a2 Get groups for ``table`` on specified ``keys``. Parameters ---------- table : `Table` Table to group keys : str, list of str, `Table`, or Numpy array Grouping key specifier Returns ------- grouped_table : Table object with groups attr set accordingly rrepresent_mixins_as_columnsTablezTable does not have key column zMissing values in key column z are not allowedcsg|] }|qSr r ).0keyrr r 5sz#_table_group_by..F)copyTz9Input keys array length {} does not match table length {}NzHKeys input must be string, list, tuple, Table or numpy array, but got {}Z mergesort)kind)DarwinWindowsgrouped_by_table_colsindicesr ) serializerrr isinstancestrlisttuplecolnames ValueErrormaskednpanymask __class__rndarraylenformat TypeErrortypeZ sorted_dataargsortplatformsystem concatenate flatnonzerozipsortmetar_groups)rr rrnameZ table_keysZ table_indexridx_sortZ stable_sortdiffsri0i1outZout_keysr rr rsj         ( "  rcCsddlm}ddlm}t||r2||}|}t|tjsPtdt |t |t |krxt d t |t || }||}tdg|dd|ddkdgf}t|}|||}t||||ddd |_|S) a= Get groups for ``column`` on specified ``keys`` Parameters ---------- column : Column object Column to group keys : Table or Numpy array of same length as col Grouping key specifier Returns ------- grouped_column : Column object with groups attr set accordingly rr rz(Keys input must be numpy array, but got z:Input keys array length {} does not match column length {}TNrr)rrrrrZas_arrayr%r)r,r-r*r#r+r.r1r2r(rr6)columnr rrr8r9rr<r r r column_group_byys*    ( r>c@sHeZdZdZeddZddZddZeZdd Z d d Z d d Z dS) BaseGroupsa4 A class to represent groups within a table of heterogeneous data. - ``keys``: key values corresponding to each group - ``indices``: index values in parent table or column corresponding to group boundaries - ``aggregate()``: method to create new table by aggregating within groups cCst|tr|jS|jSN)rr parent_column parent_tableselfr r r parentszBaseGroups.parentcCs d|_|SNr) _iter_indexrCr r r __iter__szBaseGroups.__iter__cCsV|j}|t|jdkrN|j||j|d}}|jd7_|j||StdSNr)rGr*rrE StopIteration)rDiir:r;r r r nexts zBaseGroups.nextc Cs|j}t|ttjfrN|j||j|d}}|||}|jj||j_n|jdd|jdd}}z||||}} Wn,t k r} zt d| W5d} ~ XYnXtj t |t d} t|| D]\}}d| ||<q|| }|jj||j_tdgt| |g|j_|S)NrrzHIndex item for groups attribute must be a slice, numpy mask or int arraydtypeTr)rErintr%integerrgroupsr _keys Exceptionr,Zzerosr*boolr3r1Zcumsum_indices) rDitemrEr:r;r<Zindices0Zindices1i0si1serrr'r r r __getitem__s* zBaseGroups.__getitem__cCsd|jjd|jdS)N)r(__name__rrCr r r __repr__szBaseGroups.__repr__cCst|jdSrI)r*rrCr r r __len__szBaseGroups.__len__N) r] __module__ __qualname____doc__propertyrErHrL__next__rZr^r_r r r r r?s  r?c@s>eZdZd ddZeddZeddZdd Zd d ZdS) rNcCs ||_|jj|_||_||_dSr@)rAinforBrUrR)rDrArr r r r __init__s zColumnGroups.__init__cCs8|jr|jjjS|jdkr.tdt|jgS|jSdSrF)rBrQrrUr%arrayr*rArCr r r rs   zColumnGroups.indicescCs|jr|jjjS|jSdSr@)rBrQr rRrCr r r r s zColumnGroups.keysc sVddlm}|jdd|jdd}}|jt|}td}tjk}tjk}zv|s|sj|sj|r|rtj |t |j} q|rtj |} n t fddt ||D} | } Wn@tk r} z tdjjjj| | W5d} ~ XYnX| j} dD]6} zt| | tj| Wntk rLYnXq| S) Nr) MaskedColumnrreduceatcs g|]\}}||qSr r )rr:r;funcZpar_colr r rsz*ColumnGroups.aggregate..z/Cannot aggregate column '{}' with type '{}': {})r7unitr+ descriptionr5)r=rhrrArhasattrr%sumZmeanaddridiffrgr3r(rSr,r+rer7rNsetattrgetattrAttributeError)rDrkrhrWrXr$riZsum_caseZ mean_casevalsr<rYZout_infoattrr rjr aggregatesB       zColumnGroups.aggregatecCs8tjt|td}t|D]\}}||||<q||S)a Filter groups in the Column based on evaluating function ``func`` on each group sub-table. The function which is passed to this method must accept one argument: - ``column`` : `Column` object It must then return either `True` or `False`. As an example, the following will select all column groups with only positive values:: def all_positive(column): if np.any(column < 0): return False return True Parameters ---------- func : function Filter function Returns ------- out : Column New column with the aggregated rows. rM)r%emptyr*rT enumerate)rDrkr'iZ group_columnr r r filter%szColumnGroups.filter)NN) r]r`rarfrcrr rwr{r r r r rs   $c@sJeZdZdddZeddZeddZdd Zd d Zed d Z dS)rNcCs||_||_||_dSr@)rBrUrR)rDrBrr r r r rfHszTableGroups.__init__cCs&t|jdidd}|r"|jjSdS)z^ Return the names of columns in the parent table that were used for grouping. r5rFr )rsr getr")rDrr r r key_colnamesMs zTableGroups.key_colnamescCs(|jdkrtdt|jgS|jSdSrF)rUr%rgr*rBrCr r r r[s zTableGroups.indicesc Cs|jdd}g}|j}|jD]v}|jj|jkr@||}nNz|jj |}Wn:t k r}zt t |tWYq"W5d}~XYnX||q"|j||jdS)a Aggregate each group in the Table into a single row by applying the reduction function ``func`` to group values in each column. Parameters ---------- func : function Function that reduces an array of values to a single value Returns ------- out : Table New table with the aggregated rows. Nr)r5)rrBcolumnsvaluesrer7r}ZtakerQrwr,warningswarnrrappendr(r5)rDrkrWZout_colsrBcolZnew_colrYr r r rwbs  zTableGroups.aggregatecCs@tjt|td}|j}t|D]\}}|||||<q ||S)a Filter groups in the Table based on evaluating function ``func`` on each group sub-table. The function which is passed to this method must accept two arguments: - ``table`` : `Table` object - ``key_colnames`` : tuple of column names in ``table`` used as keys for grouping It must then return either `True` or `False`. As an example, the following will select all table groups with only positive values in the non-key columns:: def all_positive(table, key_colnames): colnames = [name for name in table.colnames if name not in key_colnames] for colname in colnames: if np.any(table[colname] < 0): return False return True Parameters ---------- func : function Filter function Returns ------- out : Table New table with the aggregated rows. rM)r%rxr*rTr}ry)rDrkr'r}rzZ group_tabler r r r{s zTableGroups.filtercCs|jSr@)rRrCr r r r szTableGroups.keys)NN) r]r`rarfrcr}rrwr{r r r r r rGs   #%)r/rnumpyr%Zastropy.utils.exceptionsrindexr__all__r rr>r?rrr r r r s  d/?`