U ʹj=@sfUdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZddlmZddlmZmZmZmZmZmZdd l m!Z!m"Z"m#Z#m$Z$d d l%m&Z&m'Z'e rdd l(m)Z)m*Z*dd l+m,Z,e-Z.ee-e fZ/ee0ee/e.de1e2fZ3ddhZ4e5e6Z7eGdddZ8Gddde0Z9ddZ:ddZ;ddZe3e-e-d"d#d$Z?e-dd%d&d'Z@e0edd(d)ZAe0edd*d+ZBe0ddd,d-ZCee0efed.d/d0ZDee0eEeee-ee'fd1d2d3ZFe e0eEee e-e e'fd1d4d5ZGe0eEeee-e'fd6d7d8ZHee0ee&d9d:d;ZIe e0e e&d9dd?d@ZKdAdBe e0dCdDdEZLiZMeee-ee-feNdF<ee-ee-ddGdHdIZOee-ee-dJdKdLZPeedMdNdOZQee-ee-edPdQdRZRdS)SzEContains utilities used by both the sync and async inference clients.N) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIODictIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImager"z text-to-imagezimage-to-imagec@s\eZdZUeed<eed<eeed<eeeeefed<ee ed<eee fed<dS)RequestParametersurltaskmodeljsondataheadersN) __name__ __module__ __qualname__str__annotations__r rrr bytesrr0r0`/var/www/html/bwave/python/venv/lib/python3.8/site-packages/huggingface_hub/inference/_common.pyr#Es   r#cs<eZdZUdZeeed<deeedfdd ZZ S) MimeBytesa& A bytes object with a mime type. To be returned by `_prepare_payload_open_as_mime_bytes` in subclasses. Example: ```python >>> b = MimeBytes(b"hello", "text/plain") >>> isinstance(b, bytes) True >>> b.mime_type 'text/plain' ``` mime_typeN)r(r3cs2t||}||_t|tr.|dkr.|j|_|SN)super__new__r3 isinstancer2)clsr(r3obj __class__r0r1r6`s zMimeBytes.__new__)N) r*r+r,__doc__r r-r.r/r6 __classcell__r0r0r:r1r2Os  r2cCststdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)r?r0r0r1_import_aiohttpksr@cCststdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rr>numpy)rAr0r0r1 _import_numpytsrBcCststdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr!)rr>PILr"r!r0r0r1_import_pil_image}s  rD)contentreturncCsdSr4r0rEr0r0r1_open_as_mime_bytessrHcCsdSr4r0rGr0r0r1rHscCs|dkr dSt|trt|St|ttfr8tt|St|drtd|}t|drnt |j dnd}t|t rt dt||dSt|t r|ds|d rtd |t|}|jd }|dkrt |d}t|j|dSt|}|std |d t|trTtd|t|t |ddStrddlm}t||jrtdt}|jpd}|j||dt|d|dSt dt |ddS)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. NreadzReading content from BinaryIOnamerz3Expected binary stream (bytes), but got text stream)r3https://http://zDownloading content from z Content-TypezFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from r!zConverting PIL Image to bytesZPNG)formatzimage/zUnsupported content type: zl. Expected one of: bytes, bytearray, BinaryIO, memoryview, Path, str (URL or file path), or PIL.Image.Image.)!r7r/r2 bytearray memoryviewhasattrloggerdebugrI mimetypes guess_typerJr- TypeError startswithrgetr)rErexistsFileNotFoundError read_bytesrrCr"ioBytesIOrMsavegetvaluelowertype)rEr(r3responser"bufferrMr0r0r1rHsP               cCst|}t|S)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.)rHbase64 b64encodedecode)rE raw_bytesr0r0r1 _b64_encodesrg)rEdefault_mime_typerFcCsHt|tr|dr|St|}|jp(|}t|}d|d|S)N)rLrKdata:riz;base64,)r7r-rVrHr3rcrdre)rErhrfr3Z encoded_datar0r0r1_as_urls  rj) encoded_imagerFcCst}|tt|S)z/Parse a base64-encoded string into a PIL Image.)rDopenr[r\rc b64decode)rkr"r0r0r1 _b64_to_imagesrncCst|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r'loadsrerGr0r0r1_bytes_to_listsrqcCst|S)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rorGr0r0r1_bytes_to_dictsrrcCst}|t|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rDrlr[r\)rEr"r0r0r1_bytes_to_image srs)rarFcCst|trt|S|Sr4)r7r/r'rp)rar0r0r1_as_dictsrt)bytes_output_as_linesdetailsrFc csF|D]<}zt||}Wntk r0YqBYnX|dk r|VqdS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrurv byte_payloadoutputr0r0r1 _stream_text_generation_responses r}c CsP|2zD3dHW}zt||}Wntk r8YqLYnX|dk r|Vq6dS)z/Used in `AsyncInferenceClient.text_generation`.Nrwrzr0r0r1&_async_stream_text_generation_response's r~)r{rvrFcCs~|dsdS|dkr"td|d}t|dd}|ddk rdt |d|dt |}|sz|j j S|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8riz/nerror error_type)rVstripryrer'rplstriprstriprW_parse_text_generation_errorrparse_obj_as_instancetokentext)r{rvpayload json_payloadr|r0r0r1rx5s    rx) bytes_linesrFc csD|D]:}z t|}Wntk r.Yq@YnX|dk r|VqdS)zFUsed in `InferenceClient.chat_completion` if model is served with TGI.N%_format_chat_completion_stream_outputryritemr|r0r0r1 _stream_chat_completion_responseKs  rc CsN|2zB3dHW}z t|}Wntk r6YqJYnX|dk r|Vq6dS)z/Used in `AsyncInferenceClient.chat_completion`.Nrrr0r0r1&_async_stream_chat_completion_responseXs  r)r{rFcCsn|dsdS|dkr"td|d}t|dd}|ddk rdt |d|dt |Sr) rVrryrer'rprrrWrrr)r{rrr0r0r1res   rr r)clientrarFcCs:z$|j2z3dHW}|Vq6W5|IdHXdSr4)closerEr)rrar{r0r0r1_async_yield_fromzsr#_UNSUPPORTED_TEXT_GENERATION_KWARGS)r&unsupported_kwargsrFcCst|g|dSr4)r setdefaultextend)r&rr0r0r1'_set_unsupported_text_generation_kwargssr)r&rFcCs t|gSr4)rrW)r&r0r0r1'_get_unsupported_text_generation_kwargssr) http_errorrFcCshz.t|ddp|j}|d}|d}Wntk rF|YnX|dk r`t||}|||dS)z Try to parse text-generation-inference error message and raise HTTPError in any case. Args: error (`HTTPError`): The HTTPError that have been raised. Zresponse_error_payloadNrr)getattrrar'rW Exceptionr)rrrr exceptionr0r0r1raise_text_generation_errors    r)rrrFcCsH|dkrt|S|dkr t|S|dkr0t|S|dkr@t|St|S)NZ generationZincomplete_generationZ overloadedZ validation)rrrrr)rrr0r0r1rsr)Sr<rcr[r'loggingrS dataclassesrpathlibrtypingrrrrrr r r r r rrrequestsrZhuggingface_hub.errorsrrrrrrutilsrrrrZ_generated.typesrrr?rr Z PIL.Imager"r-ZUrlTZPathTr/rNrOZContentTZTASKS_EXPECTING_IMAGES getLoggerr*rQr#r2r@rBrDrHrgrjrnrqrrrsrtboolr}r~rxrrrrrr.rrrrr0r0r0r1s  8        B