U f{j@sdZddlZddlZddlZddlmZddlmZmZm Z m Z m Z m Z m Z mZeddddd d Zed dd dZddZdS)zParallel util function.N) get_config)loggerverbosewarn ProgressBar_validate_type _check_option _ensure_int deprecatedauton_jobs)max_jobsrcs`tjtjk}t|d|dkr\zddlm} m} Wn(tk rZ|dk rRt dd}YnX|dkrrd}|} t nt dd} t |t r|dkrt d d}|dk r| dkrtd d |rĈdkrd ndi} || d <|| d<| dkrd}| | d<|| d<| |f| tj}|dk r,t|tt|dd}| |} dk rRfdd}|}n}|| |fS)aReturn parallel instance with delayed function. Util function to use joblib only if available Parameters ---------- func : callable A function. %(n_jobs)s max_nbytes : int, str, or None Threshold on the minimum size of arrays passed to the workers that triggers automated memory mapping. Can be an int in Bytes, or a human-readable string, e.g., '1M' for 1 megabyte. Use None to disable memmaping of large arrays. Use 'auto' to use the value set using mne.set_memmap_min_size. pre_dispatch : int, or str, optional See :class:`joblib.Parallel`. total : int | None If int, use a progress bar to display the progress of dispatched jobs. This should only be used when directly iterating, not when using ``split_list`` or :func:`np.array_split`. If None (default), do not add a progress bar. prefer : str | None If str, can be "processes" or "threads". See :class:`joblib.Parallel`. .. versionadded:: 0.18 max_jobs : int | None The upper limit of jobs to use. This is useful when you know ahead of a the maximum number of calls into :class:`joblib.Parallel` that you will possibly want or need, and the returned ``n_jobs`` should not exceed this value regardless of how many jobs the user requests. %(verbose)s INFO or DEBUG will print parallel status, others will not. Returns ------- parallel: instance of joblib.Parallel or list The parallel object. my_func: callable ``func`` if not parallel or delayed(func). n_jobs: int Number of jobs >= 1. zint-likeNrr)ParalleldelayedNz-joblib not installed. Cannot run in parallel.Z MNE_CACHE_DIRr ZMNE_MEMMAP_MIN_SIZEzjoblib supports memapping pool but "MNE_CACHE_DIR" is not set in MNE-Python config. To enable it, use, e.g., mne.set_cache_dir('/tmp/shm'). This will store temporary files under /dev/shm and can result in large memory savings.r pre_dispatchpreferZ temp_folder max_nbytesrcst|dS)N)iterableZ max_value)r)Zop_iterparalleltotalK/var/www/html/bwave/python/venv/lib/python3.8/site-packages/mne/parallel.pyparallel_progressisz(parallel_func..parallel_progress)rlevelloggingINFOrZjoblibrr ImportErrorrlistr isinstancestrinfo _check_n_jobsr minmaxr )funcr rrrrrrZ should_printrrZmy_func cache_dirkwargsrZ parallel_outrrr parallel_funcsJ.         r+zQcheck_n_jobs is deprecated and will be removed in 1.1, use parallel_func directlyFcCsBd}|r|d}t||dt|tr:td|ddddSt|S)aJCheck n_jobs in particular for negative values. Parameters ---------- n_jobs : int The number of jobs. allow_cuda : bool Allow n_jobs to be 'cuda'. Default: False. Returns ------- n_jobs : int The checked number of jobs. Always positive (or 'cuda' if applicable). r)r#r )cudazwhen str)extrar,)rr"r#r r%)r Z allow_cudatypesrrr check_n_jobsrs  r/cCst|ddd}tdddkr:|dkr:d}tdnD|d kr~t}|}t||d|}|d kr~t d |d |d |S) Nr zan int or None)Zmust_beZMNE_FORCE_SERIAL)true1rz;... MNE_FORCE_SERIAL set. Processing in forced serial mode.rz$If n_jobs has a non-positive value (z7) it must not be less than the number of CPUs present ()) r osgetenvlowerrr$multiprocessing cpu_countr& ValueError)r Zn_coresZ n_jobs_origrrrr%s r%)r r NN)F)__doc__rr7r4r0rutilsrrrrrr r r r+r/r%rrrrs  (a