Pi? ddlZddlZddlZddlZddlmZmZGddeZdZ dZ dZ d dZ e d kr e dSdS) N) TokenizerProfileceZdZdS) ParserErrorN)__name__ __module__ __qualname__e/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/segments/__main__.pyrr sDr rc|jr:tj|jst dt t |jt||jdS)z Tokenize a string (passed as argument or read from stdin) segments [--profile=PATH/TO/PROFILE] tokenize [STRING] z---profile must be a path for an existing file)profile)columnN) rpathlibPathexistsrprintr_readmappingargss r tokenizer sw  |KGL66==??KIJJJ ))DL ) ) )%++dl K K KLLLLLr cbttjt|dS)z{ Create an orthography profile for a string (passed as argument or read from stdin) segments profile [STRING] N)rr from_textrrs r rrs)  ' E$KK ( ()))))r c|jr |jdntj}t |t s||j}|S)Nr) rsysstdinread isinstancestrdecodeencodingstrip)rstrings r rr!sW!Y >r c.ttd}tjt jdd}|dd|dd ||d tj |d d d|ddd|ddtj |p| }|j dkr{t|jrgt|jd|vr*||jdjnd|jdn|j |vr7td|t)jd ||j |n#t,$r^}t|t||j jt)jdYd}~n=d}~wt.$r-}t|t)jdYd}~nd}~wwxYwt)jddS)N)rrz4Main command line interface of the segments package.z@Use '%(prog)s help ' to get help about individual commands.) descriptionepilogz --verbosityzincrease output verbosity)helpcommandz | r)nargsz --encodingzinput encodingutf8)r(defaultz --profilezpath to an orthography profilez --mappingz-column name in ortho profile to map graphemesr(rzInvalid command: '{}'zinvalid command@)rrlogging basicConfigargparseArgumentParser add_argumentjoin REMAINDERr GRAPHEME_COL parse_argsr)lenrr__doc__r#format print_helprexitr Exception) parsed_argscommandsparserres r mainrB(s$99H   $JQSSSF  ,GHHH   8(<(<=== h&8999  +;VLLL  *JTXYYY  <$&&&  -&++--D |v#di.. 1))ty|$,22444/F/M/MdiXYl/[/[ ] ] ] ] +AI I>#I99I>__main__)N)rr/rr1segmentsrrr=rrrrrBrr r r rEs ''''''''     )   MMM***$$$$N zDFFFFFr