`i,2UddlmZddlmZmZmZddlmZmZddl m Z ddl m Z m Z ddlmZe r dd lmZdd l mZeed efZeed <Gd deZGddeZdedeeefdZGddeZdS))Sequence)Any TypedDictUnion) TypeAliasoverload) is_pil_image)is_vision_availablerequires_backends)Pipeline)Image load_imagez Image.Image ImagePairc$eZdZUeed<eed<dS)KeypointxyN)__name__ __module__ __qualname__float__annotations__|/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/transformers/pipelines/keypoint_matching.pyrr"s" HHH HHHHHrrc.eZdZUeed<eed<eed<dS)Matchkeypoint_image_0keypoint_image_1scoreN)rrrrrrrrrr r 's1 LLLLLrr imagesreturncd}dt|trNt|dkrtfd|Dr|gStfd|Dr|St |)N)z-Input images must be a one of the following :z - A pair of images.z - A list of pairs of images.cJt|pt|tS)z"images is a PIL Image or a string.)r isinstancestr)images r_is_valid_imagez-validate_image_pairs.._is_valid_image4sE""z'validate_image_pairs..9s-#Q#Q__U%;%;#Q#Q#Q#Q#Q#Qrc3K|]G}t|to-t|dkotfd|DVHdS)r c3.K|]}|VdSr-rr.s rr0z1validate_image_pairs...>s-CCuOOE**CCCCCCrN)r(rlenall)r/ image_pairr+s rr0z'validate_image_pairs..;s}   z8 , , DJ1$ DCCCC CCCCC      r)r(rr3r4 ValueError)r$ error_messager+s @rvalidate_image_pairsr8-sM ===&(##  v;;!  #Q#Q#Q#Q&#Q#Q#Q Q Q 8O     %        M ] # ##rc VeZdZdZdZdZdZdZfdZddZ e dde d e d e d eefd Ze ddee d e d e d eeefd Z ddeee e fd e d e d eeeeeefffd ZddZdZdd eefdZxZS)KeypointMatchingPipelinez Keypoint matching pipeline using any `AutoModelForKeypointMatching`. This pipeline matches keypoints between two images. FTctj|i|t|d|jdkrt ddS)NvisionptzBKeypoint matching pipeline only supports PyTorch (framework='pt').)super__init__r frameworkr6)selfargskwargs __class__s rr?z!KeypointMatchingPipeline.__init__OsS$)&)))$))) >T ! !abb b " !rNc0i}|||d<i}|||d<|i|fS)Ntimeout thresholdr)rArGrFpreprocess_paramspostprocess_paramss r_sanitize_parametersz-KeypointMatchingPipeline._sanitize_parametersUs>  +2 i (  .7 { + "&888rinputsrGrCr%c dSr-rrArLrGrCs r__call__z!KeypointMatchingPipeline.__call__^sadadrc dSr-rrNs rrOz!KeypointMatchingPipeline.__call__asmpmprc |tdt|}tj|fd|i|}t |dkr|dS|S)a Find matches between keypoints in two images. Args: inputs (`str`, `list[str]`, `PIL.Image` or `list[PIL.Image]`): The pipeline handles three types of images: - A string containing a http link pointing to an image - A string containing a local path to an image - An image loaded in PIL directly The pipeline accepts either a single pair of images or a batch of image pairs, which must then be passed as a string. Images in a batch must all be in the same format: all as http links, all as local paths, or all as PIL images. threshold (`float`, *optional*, defaults to 0.0): The threshold to use for keypoint matching. Keypoints matched with a lower matching score will be filtered out. A value of 0 means that all matched keypoints will be returned. kwargs: `timeout (`float`, *optional*, defaults to None)` The maximum time in seconds to wait for fetching images from the web. If None, no timeout is set and the call may block forever. Return: Union[list[Match], list[list[Match]]]: A list of matches or a list if a single image pair is provided, or of lists of matches if a batch of image pairs is provided. Each match is a dictionary containing the following keys: - **keypoint_image_0** (`Keypoint`): The keypoint in the first image (x, y coordinates). - **keypoint_image_1** (`Keypoint`): The keypoint in the second image (x, y coordinates). - **score** (`float`): The matching score between the two keypoints. NzFCannot call the keypoint-matching pipeline without an inputs argument!rGr r)r6r8r>rOr3)rArLrGrCformatted_inputsoutputsrDs rrOz!KeypointMatchingPipeline.__call__dsoN >eff f/77"%''"#3SSySFSS  A % %1: rcfd|D}|||j}||j}d|D}||d}|S)Nc2g|]}t|S))rFr)r/r*rFs r z7KeypointMatchingPipeline.preprocess..s&III*UG444IIIr)r$return_tensorscg|] }|j Sr)size)r/r*s rrVz7KeypointMatchingPipeline.preprocess..s777u 777r) model_inputs target_sizes)image_processorr@todtype)rAr$rFrZr[preprocess_outputss ` r preprocessz#KeypointMatchingPipeline.preprocessspIIII&III++6$.+YY #tz22 77777 .:LYY!!rcH|d}|jdi|}||dgd}|S)NrZr[) model_outputsr[r)model)rAr_rZrbforward_outputss r_forwardz!KeypointMatchingPipeline._forwards@).9 " 22\22 ,9L^_mLnKopprc `|d}|d}|j|||}|d}g}t|d|d|dD]\}}} t|d|d }t|d|d }|t |||  t|d d }|S)Nrbr[)r[rGr keypoints0 keypoints1matching_scoresr )rr)r!r"r#c|dS)Nr#r)rs rz6KeypointMatchingPipeline.postprocess..s ' rT)keyreverse)r\post_process_keypoint_matchingzipritemappendr sorted) rArdrGrbr[postprocess_outputs pair_resultkp_0kp_1r#s r postprocessz$KeypointMatchingPipeline.postprocesss0'8 &~6 "2QQ  R  2!4 !$  -  -  1 2" "  h h D$ d1gllnnQ ???Dd1gllnnQ ???D   udTY^YcYcYeYefff g g g g[.B.BDQQQ r)NN)rKr-)rrr__doc___load_processor_load_image_processor_load_feature_extractor_load_tokenizerr?rJrrrrlistr rOrr`rerw __classcell__)rDs@rr:r:EsO #Occccc 9999ddydUdCdTXY^T_dddXd pptIp5pRUpZ^_cdi_jZkpppXp --d9oy01-- - tE{De-- . ------^"""" T%[rr:N)collections.abcrtypingrrrtyping_extensionsrr image_utilsr utilsr r baserPILrrr)rrrr r8r:rrrrs%$$$$$$((((((((((11111111&&&&&&::::::::)(((((( mS&8 9: 9:::     y   I $$(92E)F$$$$0mmmmmxmmmmmr