Pi]cdZddlmZddlZddlZddlmZddlmZm Z ddl m Z ddl m Z mZddlmZerdd lmZmZdd lmZejd ZdEdZdEdZdFdZGddeZGddeZGddZ dGdHd&Zejd'Z dEd(Z!dIdJd.Z"dKd0Z# dLdMd;Z$dd1ddddd*d<dNd@Z%dOdDZ&dS)Pz babel.messages.pofile ~~~~~~~~~~~~~~~~~~~~~ Reading and writing of files in the ``gettext`` PO (portable object) format. :copyright: (c) 2013-2026 by the Babel Team. :license: BSD, see LICENSE for more details. ) annotationsN)Iterable) TYPE_CHECKINGLiteral)Locale)CatalogMessage) TextWrapper)IOAnyStr) SupportsWritez \\([\\trn"])stringstrreturncjd}d|vr |ddSt||ddS)zReverse `escape` the given string. >>> print(unescape('"Say:\\n \\"hello, world!\\"\\n"')) Say: "hello, world!" :param string: the string to unescape c`|d}|dkrdS|dkrdS|dkrdS|S)Nn t r )group)matchms i/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/babel/messages/pofile.pyreplace_escapesz!unescape..replace_escapes+s@ KKNN 884 #XX4 #XX4\r) _unescape_resub)rrs runescaper$ sJ    6ad|   OVAbD\ : ::rcd|vr[|}|dr |dd}dtt|St |S)aReverse the normalization done by the `normalize` function. >>> print(denormalize(r'''"" ... "Say:\n" ... " \"hello, world!\"\n"''')) Say: "hello, world!" >>> print(denormalize(r'''"" ... "Say:\n" ... " \"Lorem ipsum dolor sit " ... "amet, consectetur adipisicing" ... " elit, \"\n"''')) Say: "Lorem ipsum dolor sit amet, consectetur adipisicing elit, " :param string: the string to denormalize r""rN) splitlines startswithjoinmapr$)r escaped_liness r denormalizer-;sl* v~~))++   T " " .)!""-Mwws8]33444rline list[str]cd|vr*d|vr&|Sg}d}d}|D]c}|dkr|rtdd}|dkr|stdd}6|dkr"|r||z }D|r||d}^||z }d|r&|rtd|||S) zExtract locations from location comments. Locations are extracted while properly handling First Strong Isolate (U+2068) and Pop Directional Isolate (U+2069), used by gettext to enclose filenames with spaces and tabs in their names. ⁨⁩r'Fzglocation comment contains more First Strong Isolate characters, than Pop Directional Isolate charactersTzglocation comment contains more Pop Directional Isolate characters, than First Strong Isolate characters )lstripsplit ValueErrorappend)r. locationslocation in_filenamecs r_extract_locationsr<YsDt 4 4{{}}""$$$IHK  ' ' ==  JK  (]]  G K  #XX A    *** MHH  '  J   X & & & rc$eZdZdZd fd ZxZS) PoFileErrorzDException thrown by PoParser when an invalid po file is encountered.messagercatalogrr.linenointrNonec~t|d|||_||_||_dS)Nz on )super__init__r@r.rA)selfr?r@r.rA __class__s rrFzPoFileError.__init__sB G1111222   r) r?rr@rr.rrArBrrC)__name__ __module__ __qualname____doc__rF __classcell__rHs@rr>r>sCNNrr>c(eZdZdfd ZddZxZS) _NormalizedStringargsrrrCcztttj|dSN)rErFr+rstrip)rGrQrHs rrFz_NormalizedString.__init__s- SY--.....rcZ|sdSdtt|S)Nr')r*r+r$rGs rr-z_NormalizedString.denormalizes+ 2wws8T**+++r)rQrrrC)rr)rIrJrKrFr-rMrNs@rrPrPsQ//////,,,,,,,,rrPcleZdZdZ ddd Zdd Zdd Zdd ZdddZdddZ ddZ ddZ ddZ ddZ dS) PoFileParserzSupport class to read messages from a ``gettext`` PO (portable object) file and add them to a `Catalog` See `read_po` for simple cases. Fr@rignore_obsoletebool abort_invalidrrCct||_||_d|_d|_||_|dS)Nr)r@rYcounteroffsetr[_reset_message_state)rGr@rYr[s rrFzPoFileParser.__init__sA  .  * !!#####rcg|_g|_g|_g|_g|_g|_d|_d|_d|_d|_ d|_ dS)NF) messages translationsr8flags user_comments auto_commentscontextobsoletein_msgid in_msgstr in_msgctxtrVs rr_z!PoFileParser._reset_message_statesV     rc t|jdkrtd|jD}dt|jjD}t |jD]I\}}||jjkr|d|j d2| ||<Jt|}nD|jd }|jdd }|j r|j nd}t|||j |j|j|j|j dz|}|jr0|js(||jj|j||<n ||j|<|xjdz c_|dS) z Add a message to the catalog based on the current parser state and clear the state ready to process the next message. rc3>K|]}|VdSrS)r-).0rs r z,PoFileParser._add_message..s*AAa!--//AAAAAArcg|]}dSr')rm_s r z-PoFileParser._add_message..sBBBQbBBBrr'z5msg has more translations than num_plurals of catalogrN)rArf)lenratupleranger@ num_pluralssortedrb_invalid_pofiler^r-rfr r8rcrerdrgrY_key_forr]r_)rGmsgidridx translationmsgctxtr?s r _add_messagezPoFileParser._add_messages t}   ! !AA4=AAAAAEBB% (@"A"ABBBF$*4+<$=$= 8 8 [$,222(( O )5577s 6]]FFM!$0022E&q)!,88::F04 F$,**,,,$   N J    ;?     = *' WOV %dl&;&;E7&K&KL")DL    !!#####rc|jr|jse|d|jd|jdd|jdt g|dSdS)Nr'zmissing msgstr for msgid 'r')rarbryr^r-r7rPrrVs r_finish_current_messagez$PoFileParser._finish_current_messages = $ C$$KRq1A1M1M1O1ORRR !((!->-@-@)ABBB          rc|sdS|ddkr|||dS||||dS)Nr")!_process_string_continuation_line_process_keyword_line)rGrAr.rgs r_process_message_linez"PoFileParser._process_message_linesV  F 7c>>  2 24 @ @ @ @ @  & &vtX > > > > >rc|d\}}}|dvr|||_|dkr||_|dvr7d|_d|_|jt|dS|dkrd|_t||_ dS|dks| d rd|_d|_ |d \}}} |rt| dd nd } |d krt|n t} |j | | gdS|||ddS)Nr3)r{r~r{)r{ msgid_pluralFTr~msgstrmsgstr[[r!rr&zUnknown or misformatted keyword) partitionrrgr^rjrhrar7rPrfr)rirBrbry) rGrAr.rgkeywordrrargkwarg has_bracketidxargr|ss rrz"PoFileParser._process_keyword_lines|..--C * * *  ( ( * * *   g   DK / / /#DO DM M !23!7!7 8 8 8 F i  "DO,S11DL F h  '"4"4Y"?"? !DM!DN)0):):3)?)? &E;&18#fSbSk"""qC*-++!#&&&;L;N;NA   $ $c1X . . . F T6+LMMMMMrc|jr|jd}nC|jr|jdd}n(|jr|j}n|||ddS||dS)Nr!rzK|]}|VdSrS)rT)rmflags rrnz0PoFileParser._process_comment..@s*TTtdjjllTTTTTTr,z#.r)rr< rpartitionr8r7rBr6rcextendr4r5rTrerd)rGr.prefixr9acolonbcomments r_process_commentzPoFileParser._process_comment/s $$&&&bqb T>>.tABBx88 < <&11#66 5!<!--q#a&&k::::%!!! !N))8T*:;;;; F T>> J  TTtABBx7H7H7N7Ns7S7STTT T T T F T>>122hnn&&G 3"))'222 F !!$qrr(.."2"233333s)B BBfileobjIO[AnyStr] | Iterable[AnyStr]c nd}t|D] \}}|}|t|t }|s5|r||jj}|ddkr|dddkr3|||ddd | |#t$r.}| ||t|Yd}~d}~wwxYw||| | |j sy|js|js|jrf|jt'|jdt'g|dSdSdS)aV Reads from the file-like object (or iterable of string-likes) `fileobj` and adds any po file units found in it to the `Catalog` supplied to the constructor. All of the items in the iterable must be the same type; either `str` or `bytes` (decoded with the catalog charset), but not a mixture. Nr#rz#~T)rg) enumeraterT isinstancerdecoder@charsetrr4rr6ryrr]rcrdrerar7rPrbr)rGr needs_decoderAr.excs rparsezPoFileParser.parseMs %g.. 9 9LFD::< > >            s6C  D$C??Dct|tsJ|jrt||j||t d|t d|dzd|dS)NzWARNING:zWARNING: Problem on line rz: )rrr[r>r@print)rGr.rAmsgs rryzPoFileParser._invalid_pofilevsr$$$$$$   ?c4<v>> > j# @&1*@@@@AAAAArN)FF)r@rrYrZr[rZrrC)rrC)F)rrrrC)rIrJrKrLrFr_rrrrrrrryrqrrrXrXs !&# $ $ $ $ $     &$&$&$&$P     ?????!N!N!N!N!NF"4444<' ' ' ' RBBBBBBrrXFrrlocaleLocale | str | Nonedomain str | NonerYrZrr[rcxt|||}t|||}|||S)aRead messages from a ``gettext`` PO (portable object) file from the given file-like object (or an iterable of lines) and return a `Catalog`. >>> from datetime import datetime >>> from io import StringIO >>> buf = StringIO(''' ... #: main.py:1 ... #, fuzzy, python-format ... msgid "foo %(name)s" ... msgstr "quux %(name)s" ... ... # A user comment ... #. An auto comment ... #: main.py:3 ... msgid "bar" ... msgid_plural "baz" ... msgstr[0] "bar" ... msgstr[1] "baaz" ... ''') >>> catalog = read_po(buf) >>> catalog.revision_date = datetime(2007, 4, 1) >>> for message in catalog: ... if message.id: ... print((message.id, message.string)) ... print(' ', (message.locations, sorted(list(message.flags)))) ... print(' ', (message.user_comments, message.auto_comments)) ('foo %(name)s', 'quux %(name)s') ([('main.py', 1)], ['fuzzy', 'python-format']) ([], []) (('bar', 'baz'), ('bar', 'baaz')) ([('main.py', 3)], []) (['A user comment'], ['An auto comment']) .. versionadded:: 1.0 Added support for explicit charset argument. :param fileobj: the file-like object (or iterable of lines) to read the PO file from :param locale: the locale identifier or `Locale` object, or `None` if the catalog is not bound to a locale (which basically means it's a template) :param domain: the message domain :param ignore_obsolete: whether to ignore obsolete messages in the input :param charset: the character set of the catalog. :param abort_invalid: abort read if po file is invalid )rrr)r[)rrXr)rrrrYrr[r@parsers rread_por~sDlVFGDDDG '?- P P PF LL NrzL(\s+|[^\s\w]*\w+[a-zA-Z]-(?=\w+[a-zA-Z])|(?<=[\w\!\"\'\&\.\,\?])-{2,}(?=\w))cd|dddddddd d d zS) zEscape the given string so that it can be included in double-quoted strings in ``PO`` files. >>> escape('''Say: ... "hello, world!" ... ''') '"Say:\\n \\"hello, world!\\"\\n"' :param string: the string to escape z"%s"r z\\rz\trz\rrz\nrz\")replace)rs rescapersf FNN40088uEEMM  gdE773.. //rr'LrwidthrBc|rW|dkrPt}g}|dD]'}tt||z|krt|}||rg}d}|rtt|ddz |z} || z|kr-|||| z }n*|s'||n||d||||)n|d}t|dkrt|S|r|ds|d=|dxxdz cc<ddfd |DzS) aConvert a string into a format that is appropriate for .po files. >>> print(normalize('''Say: ... "hello, world!" ... ''', width=None)) "" "Say:\n" " \"hello, world!\"\n" >>> print(normalize('''Say: ... "Lorem ipsum dolor sit amet, consectetur adipisicing elit, " ... ''', width=32)) "" "Say:\n" " \"Lorem ipsum dolor sit " "amet, consectetur adipisicing" " elit, \"\n" :param string: the string to normalize :param prefix: a string that should be prepended to every line :param width: the maximum line width; use `None`, 0, or a negative number to completely disable line wrapping rTrr!r'rrz"" c4g|]}t|zSrq)r)rmr.rs rrsznormalize..s$III4 5IIIr) rtr(rWORD_SEPr5reverser7popr*) rrr prefixlenlinesr.chunksbufsizelengths ` r normalizers0 (KK %%d++ # #D6$<<  9,u44!--   /CD "!$VF2J%7%7!8!81!>> catalog = Catalog() >>> catalog.add('foo %(name)s', locations=[('main.py', 1)], ... flags=('fuzzy',)) >>> catalog.add(('bar', 'baz'), locations=[('main.py', 3)]) >>> from io import BytesIO >>> buf = BytesIO() >>> write_po(buf, catalog, omit_header=True) >>> print(buf.getvalue().decode("utf8")) #: main.py:1 #, fuzzy, python-format msgid "foo %(name)s" msgstr "" #: main.py:3 msgid "bar" msgid_plural "baz" msgstr[0] "" msgstr[1] "" :param fileobj: the file-like object to write to :param catalog: the `Catalog` instance :param width: the maximum line width for the generated output; use `None`, 0, or a negative number to completely disable line wrapping :param no_location: do not emit a location comment for every message :param omit_header: do not include the ``msgid ""`` entry at the top of the output :param sort_output: whether to sort the messages in the output by msgid :param sort_by_file: whether to sort the messages in the output by their locations :param ignore_obsolete: whether to ignore obsolete messages and not include them in the output; by default they are included as comments :param include_previous: include the old msgid as a comment when updating the catalog :param include_lineno: include line number in the location comment Nr?r9rYrrrrsort_byrbackslashreplace) generate_porrencoderwrite) rr@rrrrrrYrrrr.s rwrite_por"spG '%)      dC  D;;w0BCCD d  rrr%Literal['message', 'location'] | None Iterable[str]c#Krdkrnd}t|dtdd} dfd } dfd } t| D]&} | js_|r j} rLdkrFg}| D]}|| |z }d |} | d V| jD]}| |Ed {V| jD]}| |d Ed {V|sg} t| j d}n#t$r | j }YnwxYw|D]Y\}}| tjd}t|}|r |r|d|d}||vr||Z| d|dEd {V| jr0dddgt| jd V| jr||rz| dt'| jddEd {Vt)| jdkr2t'| jd}| d|dEd {V| | Ed {Vd V(|s]tj| D]6} | jD]}| |Ed {V| | dEd {Vd V5d Sd S)zYield text strings representing a ``gettext`` PO (portable object) file. See `write_po()` for a more detailed description. rrF)rbreak_long_wordsz# )rsubsequent_indentrr'c3vK|D]}d|d|dV dS)Nrr3r)wraprT)rrr.comment_wrappers r_format_commentz$generate_po.._format_commentsX#((11 0 0D/f//tzz||/// / / / / 0 0rc 3Kt|jttfr|jr|dt |j|dV|dt |jd|dV|dt |jd|dVt jD]A} |j|}n#t$rd}YnwxYw|d |d d t ||dVBdS|jr|dt |j|dV|dt |j|dV|d t |jpd|dVdS) Nzmsgctxt )rrrmsgid r msgid_plural rr'rdz] zmsgstr ) ridlistrurfrrvrwr IndexError)r?rr|rr@rs r_format_messagez$generate_po.._format_messages gj4- 0 0 d dcc7?6Y^)_)_)_cccccc[[9WZ]6QV#W#W#W[[[ [ [ [bb)GJqM&X]*^*^*^bbb b b bW011 c c $^C0FF!   FFF bbbbb6&X]1^1^1^bbbbbbb  c c dcc7?6Y^)_)_)_ccccccXX9WZe#T#T#TXXX X X XccIgn.B6Y^$_$_$_ccc c c c c cs, B:: C C )rrN.)rc\|dt|dtr|dpdfS)Nrrr!)rrB)xs rzgenerate_po..s+1Q4AaD#)>)>)G1Q4)M2"Nrkey/rrr3rz, r)r|rrz#~ rp)r _sort_messagesrheader_commentr(rr*rdrerxr8 TypeErrorrosseprr7rc previous_idrrtrgvalues)r@rYrrrrrr comment_widthheader_wrapperrrr?comment_headerrr.rlocsr8rrAr9norm_previous_idrs` ` @rrros"#8uqyyEEbM! NNNO uW\]]]N000000ddddddd&"'7;;;55z ( $3N 2*557777D^00666EE!%5!1!1#''' ' ' ', 0 0G&w// / / / / / / / /, < .sAKrr)rsort)rars rrrsQH~~H)  J   // 000 Or)rrrr)r.rrr/)NNFNF)rrrrrrrYrZrrr[rZrr)r'r)rrrrrrBrr)rrrr)rFFFFFFT)rrr@rrrBrrZrrZrrZrrZrYrZrrZrrZrrC)r@rrYrZrrZrrZrrZrrZrrrrBrr)rarrrrr)'rL __future__rrrecollections.abcrtypingrr babel.corerbabel.messages.catalogrr babel.utilr r r _typeshedr compiler"r$r-r< Exceptionr>rrPrXrrrrrrrrrqrrrs  #""""" $$$$$$))))))))33333333""""""(!!!!!!!!''''''rz/** ;;;;6