U ʹjsA@sddlZddlZddlmZddlmZmZddlmZm Z m Z m Z m Z ddl mZddlmZmZddlmZddlmZmZmZmZd d lmZmZd d lmZeeZ d)e!e!dddZ"d*e!e!e!dddZ#dZ$dedededZ%edddZ&edddZ'd+e e!efe e e!efddd Z(ed,e!e e!d!d"d#Z)ed$dddddddddd% e!e!e e*e e!e e+e e!e e*e e e e!e!fe e e e!e!fe e e e!e!fe e!d& d'd(Z,dS)-N)Path)DEFAULT_PROTOCOL PicklingError)AnyDictListOptionalUnion)version) constantssnapshot_download)HfApi)SoftTemporaryDirectoryget_fastai_versionget_fastcore_versionget_python_version)loggingvalidate_hf_hub_args) _PY_VERSION2.41.3.27)fastai_min_versionfastcore_min_versionc Cstp tdkr6td|d|dtdtd tt}tt}|t|krttd|dtd |t|krtd |d td d S)a- Checks that the installed fastai and fastcore versions are compatible for pickle serialization. Args: fastai_min_version (`str`, *optional*): The minimum fastai version supported. fastcore_min_version (`str`, *optional*): The minimum fastcore version supported. > [!TIP] > Raises the following error: > > - [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError) > if the fastai or fastcore libraries are not available or are of an invalid version. zN/Azfastai>=z and fastcore>=z' are required. Currently using fastai==z and fastcore==.zD`push_to_hub_fastai` and `from_pretrained_fastai` require a fastai>=z+ version, but you are using fastai version zA which is incompatible. Upgrade with `pip install fastai==2.5.6`.zF`push_to_hub_fastai` and `from_pretrained_fastai` require a fastcore>=- version, but you are using fastcore version zD which is incompatible. Upgrade with `pip install fastcore==1.3.27`.N)rr ImportErrorr Version)rrZcurrent_fastai_versionZcurrent_fastcore_versionr[/var/www/html/bwave/python/venv/lib/python3.8/site-packages/huggingface_hub/fastai_utils.py_check_fastai_fastcore_versionss   r )storage_folderrrc Csz ddl}Wntk r(tdYnXtj|dsJtddS||d}d| krttddS|d}d| krtd dS|d}d d |D}t |dkrtd nLt |d d d}|dkrt |t |krtd|d|ddd |D} t | dkr8tdnLt | d d d} | dkrt | t |krtd|d| ddS)a Checks that the `pyproject.toml` file in the directory `storage_folder` has fastai and fastcore versions that are compatible with `from_pretrained_fastai` and `push_to_hub_fastai`. If `pyproject.toml` does not exist or does not contain versions for fastai and fastcore, then it logs a warning. Args: storage_folder (`str`): Folder to look for the `pyproject.toml` file. fastai_min_version (`str`, *optional*): The minimum fastai version supported. fastcore_min_version (`str`, *optional*): The minimum fastcore version supported. > [!TIP] > Raises the following errors: > > - [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError) > if the `toml` module is not installed. > - [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError) > if the `pyproject.toml` indicates a lower than minimum supported version of fastai or fastcore. rNzn`push_to_hub_fastai` and `from_pretrained_fastai` require the toml module. Install it with `pip install toml`.z/pyproject.tomlzThere is no `pyproject.toml` in the repository that contains the fastai `Learner`. The `pyproject.toml` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.z build-systemzThere is no `build-system` section in the pyproject.toml of the repository that contains the fastai `Learner`. The `build-system` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.requireszThere is no `requires` section in the pyproject.toml of the repository that contains the fastai `Learner`. The `requires` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.cSsg|]}|dr|qS)fastai startswith.0Zpckrrr s z=_check_fastai_fastcore_pyproject_versions..zPThe repository does not have a fastai version specified in the `pyproject.toml`.=z*`from_pretrained_fastai` requires fastai>=z$ version but the model to load uses z which is incompatible.cSsg|]}|dr|qS)Zfastcorer$r&rrrr(s zRThe repository does not have a fastcore version specified in the `pyproject.toml`.z,`from_pretrained_fastai` requires fastcore>=r)tomlModuleNotFoundErrorrospathisfileloggerwarningloadkeyslenstr partitionr r) r!rrr,pyproject_tomlZbuild_system_tomlZpackage_versionsZfastai_packagesZfastai_versionZfastcore_packagesZfastcore_versionrrr)_check_fastai_fastcore_pyproject_versionsHsP         r9u--- tags: - fastai --- # Amazing! 🥳 Congratulations on hosting your fastai model on the Hugging Face Hub! # Some next steps 1. Fill out this model card with more information (see the template below and the [documentation here](https://huggingface.co/docs/hub/model-repos))! 2. Create a demo in Gradio or Streamlit using 🤗 Spaces ([documentation here](https://huggingface.co/docs/hub/spaces)). 3. Join the fastai community on the [Fastai Discord](https://discord.com/invite/YKrxeNn)! Greetings fellow fastlearner 🤝! Don't forget to delete this content from your model card. --- # Model card ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed zB[build-system] requires = ["setuptools>=40.8.0", "wheel", "python=z ", "fastai=z ", "fastcore=z6"] build-backend = "setuptools.build_meta:__legacy__" )repo_dirc Cs8|d}|s4|jddd}|tW5QRXdS)z Creates a model card for the repository. Args: repo_dir (`Path`): Directory where model card is created. z README.mdwutf-8encodingN)existsopenwriteREADME_TEMPLATE)r:Z readme_pathfrrr_create_model_cardsrDc Cs8|d}|s4|jddd}|tW5QRXdS)z Creates a `pyproject.toml` for the repository. Args: repo_dir (`Path`): Directory where `pyproject.toml` is created. zpyproject.tomlr;r<r=N)r?r@rAPYPROJECT_TEMPLATE)r:Zpyproject_pathrCrrr_create_model_pyprojectsrF)save_directoryconfigc Csttj|dd|dk rlt|ts:tdt|dtj|t j }t |d}t ||W5QRXtt|tt|t||_tj|ddz|jdtdWntk rtd YnXdS) a Saves a fastai learner to `save_directory` in pickle format using the default pickle protocol for the version of python used. Args: learner (`Learner`): The `fastai.Learner` you'd like to save. save_directory (`str` or `Path`): Specific directory in which you want to save the fastai learner. config (`dict`, *optional*): Configuration object. Will be uploaded as a .json file. Example: 'https://huggingface.co/espejelomar/fastai-pet-breeds-classification/blob/main/config.json'. > [!TIP] > Raises the following error: > > - [`RuntimeError`](https://docs.python.org/3/library/exceptions.html#RuntimeError) > if the config file provided is not a dictionary. T)exist_okNz(Provided config should be a dict. Got: ''r; model.pkl)fnameZpickle_protocolzYou are using a lambda function, i.e., an anonymous function. `pickle` cannot pickle function objects and requires that all functions have names. One possible solution is to name the function.)r r.makedirs isinstancedict RuntimeErrortyper/joinr Z CONFIG_NAMEr@jsondumprDrrFZexportrr)learnerrGrHr/rCrrr_save_pretrained_fastais*      rV)repo_idrevisioncCsPttj|s&t||dtd}n|}t|ddlm}|tj |dS)ap Load pretrained fastai model from the Hub or from a local directory. Args: repo_id (`str`): The location where the pickled fastai.Learner is. It can be either of the two: - Hosted on the Hugging Face Hub. E.g.: 'espejelomar/fatai-pet-breeds-classification' or 'distilgpt2'. You can add a `revision` by appending `@` at the end of `repo_id`. E.g.: `dbmdz/bert-base-german-cased@main`. Revision is the specific model version to use. Since we use a git-based system for storing models and other artifacts on the Hugging Face Hub, it can be a branch name, a tag name, or a commit id. - Hosted locally. `repo_id` would be a directory containing the pickle and a pyproject.toml indicating the fastai and fastcore versions used to build the `fastai.Learner`. E.g.: `./my_model_directory/`. revision (`str`, *optional*): Revision at which the repo's files are downloaded. See documentation of `snapshot_download`. Returns: The `fastai.Learner` model in the `repo_id` repo. r#)rWrXZ library_nameZlibrary_versionr) load_learnerrK) r r.r/isdirr rr9Zfastai.learnerrYrR)rWrXr!rYrrrfrom_pretrained_fastai"s  r[z(Push FastAI model using huggingface_hub.) commit_messageprivatetokenrHbranch create_prallow_patternsignore_patternsdelete_patterns api_endpoint) rWr\r]r^rHr_r`rarbrcrdc  Csxtt| d} | j|||ddj}tD} t| |}t|||d| j|||||||| | d W5QRSQRXdS)a Upload learner checkpoint files to the Hub. Use `allow_patterns` and `ignore_patterns` to precisely filter which files should be pushed to the hub. Use `delete_patterns` to delete existing remote files in the same commit. See [`upload_folder`] reference for more details. Args: learner (`Learner`): The `fastai.Learner' you'd like to push to the Hub. repo_id (`str`): The repository id for your model in Hub in the format of "namespace/repo_name". The namespace can be your individual account or an organization to which you have write access (for example, 'stanfordnlp/stanza-de'). commit_message (`str`, *optional*): Message to commit while pushing. Will default to :obj:`"add model"`. private (`bool`, *optional*): Whether or not the repository created should be private. If `None` (default), will default to been public except if the organization's default is private. token (`str`, *optional*): The Hugging Face account token to use as HTTP bearer authorization for remote files. If :obj:`None`, the token will be asked by a prompt. config (`dict`, *optional*): Configuration object to be saved alongside the model weights. branch (`str`, *optional*): The git branch on which to push the model. This defaults to the default branch as specified in your repository, which defaults to `"main"`. create_pr (`boolean`, *optional*): Whether or not to create a Pull Request from `branch` with that commit. Defaults to `False`. api_endpoint (`str`, *optional*): The API endpoint to use when pushing the model to the hub. allow_patterns (`List[str]` or `str`, *optional*): If provided, only files matching at least one pattern are pushed. ignore_patterns (`List[str]` or `str`, *optional*): If provided, files matching any of the patterns are not pushed. delete_patterns (`List[str]` or `str`, *optional*): If provided, remote files matching any of the patterns will be deleted from the repo. Returns: The url of the commit of your model in the given repository. > [!TIP] > Raises the following error: > > - [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) > if the user is not log on to the Hugging Face Hub. )ZendpointT)rWr^r]rI)rH) rWr^Z folder_pathr\rXr`rarbrcN)r r Z create_reporWrrrVZ upload_folder)rUrWr\r]r^rHr_r`rarbrcrdapitmpZ saved_pathrrrpush_to_hub_fastaiOs">  rg)rr)rr)N)N)-rSr.pathlibrpicklerrtypingrrrrr packagingr Zhuggingface_hubr r Zhuggingface_hub.hf_apir Zhuggingface_hub.utilsrrrrutilsrrZutils._runtimerZ get_logger__name__r1r6r r9rBrErDrFrVr[boolrOrgrrrrs      1 _"  5,