PidZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlmZmZmZddlmZddlZddlZddlZddlmZddlmZddlmZmZm Z dd l!m"Z"dd lm#Z#e$Z%gd Z&id d ddddddddddddddddddd d!d"d#d$d%d&d'd(d)d*d+d,d-id.d/d0d1d2d3d4d5d6d7d8d9d:d;dd?d@dAdBdCdDdEdFdGdHdIdJdKdLdMdNdOdPdQdRdSdTdUdVdWdXdYdZd[d\ Z'd](Z)ej*Z*Gd^d_Z+e+Z,ej-Gd`daeZdddZ.deej/e0e1ffdfZ2ddge3fdhZ4ddiZ5Gdjdkej6Z6dlZ7GdmdnZ8ddpZ9Gdqdrej:Z;dsZdwZ?ej-Gdxdye>Z@dzZAd{ZBej-Gd|d}e>ZCd~ZDej-GddeCZEdZFej-GddZGej-GddZHdZIej-GddeCZJdZKdZLej-GddeCZMej-GddeMZNdZOej-GddeMZPGddZQdS)zFunctionality to read and write metadata for CSV files. This module implements (partially) the W3C recommendation "Metadata Vocabulary for Tabular Data". .. seealso:: https://www.w3.org/TR/tabular-metadata/ N)urljoinurlparse urlunparse)tags)utils DATATYPES)DialectUnicodeReaderWithLineNumber UnicodeWriter) DataPackage)jsonld) TableGroupTableColumn ForeignKeyLinkNaturalLanguageDatatypeis_urlCSVWcsvwzhttp://www.w3.org/ns/csvw#rdfz+http://www.w3.org/1999/02/22-rdf-syntax-ns#rdfsz%http://www.w3.org/2000/01/rdf-schema#xsdz!http://www.w3.org/2001/XMLSchema#dczhttp://purl.org/dc/terms/dcatzhttp://www.w3.org/ns/dcat#provzhttp://www.w3.org/ns/prov#schemazhttp://schema.org/asz&https://www.w3.org/ns/activitystreams#cczhttp://creativecommons.org/ns#ctagzhttp://commontag.org/ns#dc11z http://purl.org/dc/elements/1.1/dctypeszhttp://purl.org/dc/dcmitype/dqvzhttp://www.w3.org/ns/dqv#duvzhttps://www.w3.org/ns/duv#foafzhttp://xmlns.com/foaf/0.1/grz!http://purl.org/goodrelations/v1#grddlz#http://www.w3.org/2003/g/data-view#icalz&http://www.w3.org/2002/12/cal/icaltzd#rzhttp://www.w3.org/ns/json-ld#ldpzhttp://www.w3.org/ns/ldp#mazhttp://www.w3.org/ns/ma-ont#oazhttp://www.w3.org/ns/oa#odrlzhttp://www.w3.org/ns/odrl/2/ogzhttp://ogp.me/ns#orgzhttp://www.w3.org/ns/org#owlzhttp://www.w3.org/2002/07/owl#qbz!http://purl.org/linked-data/cube#rdfazhttp://www.w3.org/ns/rdfa#revzhttp://purl.org/stuff/rev#rifzhttp://www.w3.org/2007/rif#rrzhttp://www.w3.org/ns/r2rml#sdz0http://www.w3.org/ns/sparql-service-description#sioczhttp://rdfs.org/sioc/ns#z$http://www.w3.org/2004/02/skos/core#z"http://www.w3.org/2008/05/skos-xl#zhttp://www.w3.org/ns/sosa/zhttp://www.w3.org/ns/ssn/zhttp://www.w3.org/2006/time#z http://rdf.data-vocabulary.org/#z http://www.w3.org/2006/vcard/ns#zhttp://rdfs.org/ns/void#z!http://www.w3.org/2007/05/powder#z#http://www.w3.org/2007/05/powder-s#z#http://www.w3.org/1999/xhtml/vocab#z$http://www.w3.org/XML/1998/namespace) skosskosxlsosassntimevvcardvoidwdrwrdsxhvxmlaCell Column Datatype Dialect Direction ForeignKey JSON NumericFormat Row Schema Table TableGroup TableReference Transformation aboutUrl base columnReference columns commentPrefix datatype decimalChar default delimiter describes dialect doubleQuote encoding foreignKeys format groupChar header headerRowCount json lang length lineTerminators maxExclusive maxInclusive maxLength maximum minExclusive minInclusive minLength minimum name notes null ordered pattern primaryKey propertyUrl quoteChar reference referencedRows required resource row rowTitles rownum schemaReference scriptFormat separator skipBlankRows skipColumns skipInitialSpace skipRows source suppressOutput tableDirection tableSchema tables targetFormat textDirection titles transformations trim uriTemplate url valueUrl virtualceZdZdS)InvalidN__name__ __module__ __qualname__a/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/csvw/metadata.pyrGrGsDrMrGc eZdZdZejdejej e ddej ej e ZdS)r a The spec is ambiguous regarding a default for the commentPrefix property: > commentPrefix > An atomic property that sets the comment prefix flag to the single provided value, which > MUST be a string. The default is "#". vs. > comment prefix > A string that, when it appears at the beginning of a row, indicates that the row is a > comment that should be associated as a rdfs:comment annotation to the table. This is set > by the commentPrefix property of a dialect description. The default is null, which means > no rows are treated as comments. A value other than null may mean that the source numbers > of rows are different from their numbers. So, in order to pass the number formatting tests, with column names like `##.#`, we chose the second reading - i.e. by default no rows are treated as comments. NT allow_nonedefault converter validator)rIrJrK__doc__attrib functoolspartialrrTstr validatorsoptional instance_of commentPrefixrLrMrNr r sv&DG#)#EOS$4PPP/**4?+F+Fs+K+KLLNNNMMMrMr rutf-8c@|dksJtj|||S)Nraencoding)ioopen)filenamemoderds rN json_openris* w     78TH 5 5 55rMreturnc4t|}t|r2tj|t jSt|5}t j|t jcdddS#1swxYwYdS)N)object_pairs_hook) r[rrequestsgetjson collections OrderedDictriload)fnamefs rNget_jsonrus JJE e}}S|E""''+:Q'RRR 5  GQyk.EFFFGGGGGGGGGGGGGGGGGGs B  BBwarningcR|rt|||dS||Ngetattr)msgloglevel exception_clss rN log_or_raisers: !UC     mC   rMcddlm}Gddt}|}t|||d||S)Nr) MethodTypeceZdZdS)nolog..LogNrHrLrMrNLogrs rMrcdSrxrL)argskws rNznolog..strM)typesrobjectsetattr)r}rrr|s rNnologrsr           f    #%%C C #;#;SAABBB JrMc$eZdZfdZdZxZS) URITemplatect|tr |j|kSt|dsdSt t ||S)NuriF) isinstancer[rhasattrsuperr__eq__)selfother __class__s rNrzURITemplate.__eq__sW eS ! ! %8u$ $ue$$ 5[$''..u555rMc ,d|SN{}format)rrs rNasdictzURITemplate.asdicts{{4   rM)rIrJrKrr __classcell__rs@rNrrsG66666!!!!!!!rMrc d}tjdtjtjt t f|S)z Note: We do not currently provide support for supplying the "_" variables like "_row" when expanding a URI template. .. seealso:: http://w3c.github.io/csvw/metadata/#uri-template-properties c|dSt|tstjdtSt |S)Nz#Invalid value for aboutUrl property)rr[warningswarnINVALIDrr?s rNconverter_uriTemplatez4uri_template_property..converter_uriTemplate s@ 94!S!!  M? @ @ @N1~~rMNrSrUrT)rWrXr\r]r^rrG)rs rNuri_template_propertyrs[ 7/**4?+F+F U\G]+^+^__' ) ) ))rMc\eZdZdZdejeejffdZ dZ d dZ dZ dZ d S) rzK .. seealso:: http://w3c.github.io/csvw/metadata/#link-properties stringctt|ttjfst d||_dS)NzInvalid value for link property)rr[pathlibPath ValueErrorr)rrs rN__init__z Link.__init__s6&3 "566 @>?? ? rMc|jSrxrrs rN__str__z Link.__str__" {rMTc|jSrxrr omit_defaultss rNrz Link.asdict%rrMcPt|tr|j|jkndSNF)rrr)rrs rNrz Link.__eq__(s%.8.E.EPt{el**5PrMct|dr@t|jr|jS|r|n|j|jz St ||jS)z Resolve a `Link` relative to `base`. :param base: :return: Either a string, representing a URL, or a `pathlib.Path` object, representing a local file. joinpath)rrris_dirparentr)rbases rNresolvez Link.resolve,sc 4 $ $ Jdk"" #{" KKMM:DDt{dkI ItT[)))rMNT)rIrJrKrVtypingUnionr[rrrrrrrrLrMrNrrs v|C,=> QQQ * * * * *rMrFctjdtjtjt dS)Nc(||nt|Srx)rrs rNrzlink_property..?sAAQrMr)rWrXr\r]r^rrequireds rN link_propertyr;sG 7/**4?+F+Ft+L+LMM77 9 9 99rMc@eZdZdZfdZd dZd dZdZd dZxZ S) rzW .. seealso:: http://w3c.github.io/csvw/metadata/#natural-language-properties c8tt|||_t |jt r |jg|d<dSt |jt tfrMtd|jDstj ddSt |j|d<dSt |jtr|j D]\}}tj|stdt |t tfs|g}g}|D]A}t |t r||-tj dB|||<dStd)Nc3@K|]}t|tVdSrxrr[).0r?s rN z+NaturalLanguage.__init__..Ns,>>az!S))>>>>>>rMzAtitles with array values containing non-string values are ignoredz(Invalid language tag for NaturalLanguagez1Title with value which is not a string is ignoredz&invalid value type for NaturalLanguage)rrrvaluerr[listtupleallrrdictitemsrcheckrappend)rrkr?titlesvvrs rNrzNaturalLanguage.__init__Hs ot$$--/// dj# & & G*DJJJ  T5M 2 2 G>>4:>>>>> . abbbbb!$*--T  D ) ) G ((** ! !1z!}}Q$%OPPP!!dE]33A[[B!"c**[ b)))) &YZZZZ Q ! !EFF FrMTct|dgkr5t|ddkr|S|dStjd|DS)Nrc3bK|]*\}}|dn|t|dkr|dn|fV+dS)Nundrr)lenrrr?s rNrz)NaturalLanguage.asdict..gs]'&'&1iUUQA! ! C'&'&'&'&'&'&rM)rrgetfirstrprqrrs rNrzNaturalLanguage.asdictbs{ ::$  4:!##}}&: &'&'& '&'&'&&& &rMNcN||vrg||<|||dSrx)r)rrlangs rNaddzNaturalLanguage.addks4 t  DJ T &!!!!!rMc|p3tt|dSNr)rnextitervaluesrs rNrzNaturalLanguage.__str__ps2}}>$tDKKMM':':";";A">>rMc<||dgdSrrn)rrs rNrzNaturalLanguage.getfirstssxxtf%%a((rMrrx) rIrJrKrVrrrrrrrs@rNrrBs GGGGG4&&&&"""" ???))))))))rMrct|tstjddS|dr"t d||S)NzInconsistent link property_zInvalid @id property: {})rr[rr startswithrrrs rNvalid_id_propertyrws` a   2333t||C?3::1==>>> HrMct|trd|Dhdstdd|vrt |dkr~t |dks\t |ddhddhfvs3t|dttttj fstd d|vrd|vrtd d |vrt|d |d <d|vrLt|dtrtj|dstjd |d=d|vr|dttrld rtdt%s8t'fdt(Dst*vrtdn+tt,tfstdd|DSt|t,r d|DS|S)NcLh|]!}|d|dd"S)@rNr)rrs rN z(valid_common_property..s1666!ALL$5$56!""666rM>idtyperlanguagezeAside from @value, @type, @language, and @id, the properties used on an object MUST NOT start with @.z@valuer @language@typeaIf a @value property is used on an object, that object MUST NOT have any other properties aside from either @type or @language, and MUST NOT have both @type and @language as properties. The value of the @value property MUST be a string, number, or boolean value.zXA @language property MUST NOT be used on an object unless it also has a @value property.@idInvalid language tagz_:z\The value of any @id or @type contained within a metadata document MUST NOT be a blank node.c3TK|]"}|kp|dzV#dS):Nr)rnsrs rNrz(valid_common_property..s<YYb CBMM"s(,C,CYYYYYYrMzThe value of any member of @type MUST be either a term defined in [csvw-context], a prefixed name where the prefix is a term defined in [csvw-context], or an absolute URL.zInvalid datatype for @typec4i|]\}}|t|SrLvalid_common_property)rrrs rN z)valid_common_property..s'DDDB(,,DDDrMc,g|]}t|SrLrrrs rN z)valid_common_property..s!666b%b))666rM)rrissubsetrrsetkeysr[boolintdecimalDecimalrrrrrrrany NAMESPACES CSVW_TERMSrr)r?rs @rNrrs!T*E66q666??33355 *)** * q==1vvzzq66A::qvvxx==(K1H8U\J]0^^^)!H+T37XYY_$VWWW !   1 1#$$ $ A::(522AeH !  q~s33 # 1[>8R8R # 4555kN a<<7B"c"" ?==&&5$4555bzz?YYYYjYYYYY?*,,$>??? T4L11 ? !=>>>DD!''))DDDD!T766A6666 HrMc <eZdZdZejejeZejejeZ e d de j ee j fde jede j edffdZe defd Zd Zd defd ZdS)DescriptionBasezzContainer for - common properties (see http://w3c.github.io/csvw/metadata/#common-properties) - @-properties. rSNTd type_namerjc4|rt|tsdStj|}|p|j}iii}}}|piD]\}} |drR|dkrt| } |dkr)| |kr#td | || ||dd<ld|vrt| ||<|r-||vr)tj d ||| ||<td ||d|S) Nrrrz Invalid @type property {} for {}rrzInvalid property {} for {} common_propsat_propsrL) rrrW fields_dictrIrrrrrrrr) clsrrstrictfieldscaddrr?s rNpartition_propertiesz$DescriptionBase.partition_propertiessP  Z4((  F!#&&- r2b1W"OO%%  DAq||C  ::)!,,A<"E"Ea"S"STTTTBqEE5Q55"555rMc8|di||SNrL)r)rrs rN fromvaluezDescriptionBase.fromvalues&s11S--a00111rMc#Kfdfd}t|jD]\}}d|z||fVt|jD]\}}|||fVt j|D]\}}|dvr|||fVdS)NcTt|dr|n|S)Nrr)rr)r?rs rN_asdict_singlez8DescriptionBase._iter_dict_items.._asdict_singles,._asdict_multiple..s#777rr**777rM)rrr)r?r%s rN_asdict_multiplez:DescriptionBase._iter_dict_items.._asdict_multiplesC!dE]++ 87777Q7777!>!$$ $rMrr$r)sortedrrrr attr_asdict)rrr(rr?r%s ` @rN_iter_dict_itemsz DescriptionBase._iter_dict_itemss; X X X X X % % % % % 4=..0011 / /DAq'++A... . . . .4,224455 ) )DAq%%a((( ( ( ( (%d-HHHNNPP - -DAq444))!,,,,,, - -rMcdtjd||DS)Nc3<K|]\}}|dks|gifv||fVdS)nullNrLrs rNrz)DescriptionBase.asdict..sM'5'5q!V "b 1 1F 1 1 1 1'5'5rM)rprqr+rs rNrzDescriptionBase.asdictsC &'5'5#44]CC'5'5'555 5rM)NTr)rIrJrKrVrWrXFactoryrrr classmethodrrAnyOptionalr[rr!r+rrLrMrNrrs 47<4<#5#5666Ltw|t|D11222H@D$(66 & T6:-= >6(.(<6.4\$*-E666[622$222[2---&55D555555rMrctjdtjtjt dS)Nc(||nt|Srx)rrs rNrzoptional_int..sAAArMr)rWrXr\r]r^rrLrMrN optional_intr5sG 7/**4?+F+Fs+K+KLL66 8 8 88rMc eZdZdZejdejej e dddej ej eZejdZeZeZeZejdZejdZejdZejdZejdZejdZed eje edfd dfd Zd Z dd Z!e"dZ#e"dZ$dZ%dZ&dZ'dZ(dS)ra A datatype description Cells within tables may be annotated with a datatype which indicates the type of the values obtained by parsing the string value of the cell. .. seealso:: ``_ NrTc|dup|tvSrxr )sss rNrzDatatype. sB$J lengthzmaxLength < lengthzminLength > maxLengthc30K|]}t|VdSrxr )rnames rNrz/Datatype.__attrs_post_init__..Es&``4y``````rM)r floatdatetimedurationc0g|]}t|SrLry)ratrs rNrz0Datatype.__attrs_post_init__..Fs5ccc"GD"%%cccrMzCminimum maximum minExclusive maxExclusive minInclusive maxInclusivezApplications MUST raise an error if minimum, minInclusive, maximum, maxInclusive, minExclusive, or maxExclusive are specified and the base datatype is not a numeric, date/time, or duration type.r base64Binary hexBinaryzApplications MUST raise an error if length, maxLength, or minLength are specified and the base datatype is not string or one of its subtypes, or a binary type.zApplications MUST raise an error if both minInclusive and minExclusive are specified, or if both maxInclusive and maxExclusive are specified.rc3VK|]#}jdtd|zkV$dS)rrN)rr )rdtrs rNrz/Datatype.__attrs_post_init__..csR)S)SBD d#z%'82'==)S)S)S)S)S)SrMz8datatype @id MUST NOT be the URL of a built-in datatype.r patternu #0.,;%‰E-+zInvalid number pattern)rzrparselength minLengthr maxLengthrderived_descriptionrbasetyperr splitr rBrDrCrErrrrrr)rattr_s` rN__attrs_post_init__zDatatype.__attrs_post_init__-s  G GEtU##/eTZZe0D0D%E%EFFF ; "~)dkDN.J.J !5666~);//$%9::: > %$.*DNT^33455 5$2D99 ,,  ``3_```aacc OccccY__aacccdd O NOOO  8$i&?;AWXZZ ${ $dn $ $ #$$$   V$"3 V9J VtO` VUVV V   !$"3 !8ITM^8^8^"9_'+'89_=A=NQUQb=b=bR..   !$"3 !8ITM^8^8^!9_&*&79_<@= {}zvalue must be > {}zvalue must be <= {}zvalue must be < {})rrTrrrUrV TypeErrorrXminmaxr@rBrDrArCrE)rr?l_s rNvalidatezDatatype.validates+ 9H QW"B{&2+<+< !.A.A !E!L!LT^!\!\]]]~)b4>.A.A !D!K!KDN![![\\\    D  =  Q|'A ,<,< !6!=!=dl!K!KLLL ,T5F1F1F !6!=!=d>O!P!PQQQ ,d6G1G1G !5!O!P!PQQQ ,d6G1G1G !5!+>y+I+IJJ  L L LD TWT " " "F \^^F I Idgd###Gdgd###G474(((L474(((L474(((L474(((L&,sD*'<=*[&>8>8>8@    $$X$77X7FFFFFF 8,,,,,rMrc|gnt|tr|n|g}td|DstjddgS|S)Nc3@K|]}t|tVdSrxrrs rNrz!converter_null..s,11rz"c""111111rMzInvalid null propertyrO)rrrrr)r?r^s rNconverter_nullrqs` ""Z4%8%8 AqcC 11S111 1 1 -...t JrMcZtj|stjddS|S)Nrr)rrrrrs rNconverter_langrss- :a== ,---u HrMc zeZdZdZejdddZeZejddZ ejde j e j eddZejd eZejejd eZejde j e j edd ZeZejd Zeje j e j edd dZejde j e j edd dZeZdZdZdS) DescriptionzvAdds support for inherited properties. .. seealso:: http://w3c.github.io/csvw/metadata/#inherited-properties NF)rSrepreqc>|s|nt|Srx)rr!rs rNrzDescription.sQAAAH,>,>q,A,ArMrSrTrO) allow_listrcdgS)NrOrLrLrMrNrzDescription.srMTrPr)rTrSc |dvS)N)NltrrtlautoinheritrLrs rNrzDescription.s q`_ NTrPryFr)rSrvc|jp9|jo|jpd|jS)N_col.{})rGrrr_numberrs rNrzColumn.__str__sAy+ [ 3T[1133+   T\ * * +rMc|jr |j|krdS|jpiD]\}}||vr|pdcSdS)NTrF)rGrr)rr?tagrs rN has_titlezColumn.has_titlesd 9 a4 K-24466 $ $KCF{{|e###urMc,d|Srrrs rNheaderz Column.headers{{4   rMc|d}||d|d}|d|s}|r)|vr%|stjdt d|r<|sg}n=|vrd}n6fd||D}fd|D}n|vrd}rbt |tr8 fd|DS#t$r|stjd |cYSwxYw|S|S) NrrSrr required column value is missingc3 K|]}|pV dSrxrL)rrrSs rNrzColumn.read..5s'@@rR]7@@@@@@rMc g|] }|vrdn| SrxrL)rrr.s rNrzColumn.read..6s%<<.=s%:::"HMM"--:::rMzInvalid value for list element.) rrrrrrYrrrl)rr?rrrrrSr.s @@@rNrlz Column.read s<< ++  "",,y))LL-- << ++ A  AT  B @AAA?@@ @   =d@@@@QWWY-?-?@@@<<<.fmtKs2yAw -))!,,,HrMc3.K|]}|VdSrxrL)rrrs rNrzColumn.write..Ss+66CCGG666666rM)rrjoin)rr?seprrr.s @@@rNwritez Column.writeFsll;''  ""<< ++        7886666ag266666 6s1vv rMr)rIrJrKrVrWrXrYrZrrTr[rGrsuppressOutputr\r]r^rrrvirtualrrrrnrrlrrLrMrNrrsp 47#)#EOS$4PPP   DTW#)#EOT5AACCCNTW/**4?+F+F+W+WXX"$$$Fdge/@y/@RVX]/^/^___Gdgd///G+++ !!X!$$$$LrMrctjdtjtjt dS)Nc:t|ts||n|gSrxrrrs rNrz"column_reference..[sAt!4!4J AAsrMr)rWrXr\r]r^rrLrMrNcolumn_referencerWsK 7/**4?+F+Ft+L+LMMJJ L L LLrMcPeZdZeZeZeZdZdS) ReferencecD|j|jt|dSdSrx)resourceschemaReferencerrs rNr[zReference.__attrs_post_init__es. = $)=)IT"" " % $)I)IrMN) rIrJrKrrrrcolumnReferencer[rLrMrNrr^sI}H#mooO&&((O#####rMrc`eZdZeZejdZedZ dZ dS)rNrc jt|trv tdi|d}n#t$rt dwxYwt |ddhst dt|tdi|d}|di|S)N referencezInvalid reference propertyrzInvalid foreignKey spec)rrL)rrrrgrrrr)rrrrs rNfromdictzForeignKey.fromdictps a   < ?//+// ? ? ? !=>>> ?qvvxx==))+:: ; ; ;syyRyys *Ac `tj|fi|}tj|dfi||d<|S)Nr)rr*)rrr^s rNrzForeignKey.asdict|sA++++ ,S-=DDDDK rM) rIrJrKrrrWrXrr0rrrLrMrNrrjs`'&((O%%%I  [ rMrcg}tjtjtd|D]T} |t |1#t$rtj dYQwxYw|S)NzInvalid foreignKeys spec) rYrZrrTrrrrrgrr)r?r^rs rNconverter_foreignKeysrs C ;Y ud ; ;A > >66 6 JJz**1-- . . . . 6 6 6 M4 5 5 5 5 5 6 Js-A""BBc&eZdZdZejejedZejejedZ e Z ejejedZ dZ edZedZd d Zd S) SchemaaL A schema description is an object that encodes the information about a schema, which describes the structure of a table. :ivar columns: `list` of :class:`Column` descriptions. :ivar foreignKeys: `list` of :class:`ForeignKey` descriptions. .. seealso:: ``_ c dtjtjtdtjtjt g|DS)NcBg|]}t|SrL)rr!rrs rNrz#Schema...s9BBB$%F  Q  BBBrM)rYrZrrTrrrs rNrzSchema.scBB)W):5?DRV)W)W< !%/4<s!)BB1Fq1I1IrMc6t|tr|n|gSrxrrs rNrzSchema.sAt!4!4=AA1#rMcdtt}}}t|jD] \}}|jrH|jdst jd|jrtjd|j rd}n|rtd|s|j |vrtjd|jrJ|j|vr'td |j| |j| |j ||_|d z|_ |jpgD]@}|j|}|r"|jstjd d|_AdS) NFr\szInvalid column nameTz3no non-virtual column allowed after virtual columnszDuplicate column name!zDuplicate column name {}rz:A primaryKey referenced column MUST have a `name` property)r enumeratecolumnsrGrresearchrrrrrrrrr primaryKey columndictrn)rrseennamesicolcolrefs rNr[zSchema.__attrs_post_init__s$ceeSUUu --  FAsx 5SX0055 55#(9S9S 5 3444{ X X !VWWW %:%%M":;;;8(x5((()C)J)J38)T)TUUUIIch'''$$$CKa%CKKo+ ' 'F/%%f--C '38 ' Z[[["&  ' 'rMcDt|tr1 tj|}n #|cYSxYwt|t s+t|t rtjdi}|di| |S)Nz&Invalid value for tableSchema propertyrL) rr[rmrnrorrrrrr=s rNr!zSchema.fromvalues a    LOO((** !T"" !S!! H FGGGAs11S--a00111s &>Ac$d|jDS)Nci|] }|j| SrLrrs rNrz%Schema.columndict..s222!222rM)rrs rNrzSchema.columndicts22T\2222rMFc|j|}|r |r|jsJ|sM|jD]E}|jr!|j|kr|cS|jr|jj|kr|cSF|Srx)rrnrGrrrrr)rrGrrrs rN get_columnzSchema.get_columnso!!$''11111 \  8 1 1 3 3t ; ;HHH=Q]%6$%>%>HHH rMNF)rIrJrKrVrWrXr/rr foreignKeysrr rowTitlesr[r0r!rnrrrLrMrNrrsdg T""BBCCCG $' T""IIKKKK"!##J T""==I '''2 2 2[ 233X3      rMrct|tstjdiSt|dd}|d=|d=|drd|d <|S) NzInvalid dialect specr F)rrrrheaderRowCountTr)rrrrrurrn)r partitioneds rN dialect_propsrsz a   ,--- 221 RW2XXKJN#'((% $ H rMct|tstjd|D]}t|ddS)Nz Invalid transformations propertyTemplate)r)rrrrrur)instance attributertrs rNvalid_transformationsrs^ eT " ": 8999CC((z(BBBBCCrMc eZdZdZejddZejejeZ ejde j e j eddejgd  Zejdd Zejeeje ZeZejdZd ZdZeddejeejfddfdZeddeddfdZ ddejeejfdejfdZ!e"dejeejffdZ#dde$de%defdZ&dS) TableLikeaH A CSVW description object as encountered "in the wild", i.e. identified by URL on the web or as file on disk. Since `TableLike` objects may be instantiated from "externally referenced" objects (via file paths or URLs), they have the necessary means to resolve `link properties `_ .. code-block:: python >>> from csvw import Table, TableGroup, Link >>> t = Table.from_file('tests/fixtures/csv.txt-table-metadata.json') >>> Link('abc.txt').resolve(t.base) PosixPath('tests/fixtures/abc.txt') >>> tg = TableGroup.from_url( ... 'https://raw.githubusercontent.com/cldf/csvw/master/tests/fixtures/' ... 'csv.txt-metadata.json') >>> str(tg.tables[0].url) 'csv.txt' >>> tg.tables[0].url.resolve(tg.base) 'https://raw.githubusercontent.com/cldf/csvw/master/tests/fixtures/csv.txt' and `URI template properties `_ (see :meth:`~TableLike.expand`). Ncf|t|tr|ntdit|Sr )rr[r rrs rNrzTableLike. s6!)z!S/A/A)AA  ( (}Q'' ( (rMryrrc |dvS)Nr~r}rrL)ss rNrzTableLike.s >T9TrM)r:rrRc6t|Srx)rr!rs rNrzTableLike.sF,,Q//rM)rUrSc rt|jtrUtdit t t |j|j|_|j r&t|j ts ||j _ d|j vr|j d|j|j d<|j d}t|tr|D]}t|tr6t|ddhrt|tr|dkrt%dt|tr5d|vr1t'j|dst+jd|d=dSdS) Nrcontext@baserhttp://www.w3.org/ns/csvwaThe @context MUST have one of the following values: An array composed of a string followed by an object, where the string is http://www.w3.org/ns/csvw and the object represents a local context definition, which is restricted to contain either or both of@base and @language.z$Invalid value for @language propertyrL)rdialectr[r rrurrr tableSchemarrrnrrrrrrrrrr)rctxobjs rNr[zTableLike.__attrs_post_init__s dlC ( ( e"dd]8D>>F# #.2l:t|?R:t|"))#'; 8T[  D :rMFtmplrowc |tur|j|jStD]X\}}|j|dzr6d||j dd}nxYt|j d||dd|D|jr|j|jn|j}t|tjsQ|rOtD]5\}}||r|||dz}n6|S)a# Expand a `URITemplate` using `row`, `_row` and `_name` as context and resolving the result against `TableLike.url`. .. code-block:: python >>> from csvw import URITemplate, TableGroup >>> tg = TableGroup.from_url( ... 'https://raw.githubusercontent.com/cldf/csvw/master/tests/fixtures/' ... 'csv.txt-metadata.json') >>> tg.expand(URITemplate('/path?{a}{#b}'), dict(a='1', b='2'), None) 'https://raw.githubusercontent.com/path?1#2' rz{}{}r)_row_namecDi|]\}}t|t||SrLr)r_k_vs rNrz$TableLike.expand..s-OOO&"b:b#;N;NOr2OOOrMrL)rrrrr rrrrrYrexpandrrrreplace) rrrr r qnameprefixrr^s rNrzTableLike.expandss 7??8##DI.. .%++-- S SKFCx""6C<00 mmC)<)`_ Frc>t|ttfs|gn|}tfd|Ds"t d|jjt |||dddS)a  Add a foreign key constraint to `tableSchema.foreignKeys`. :param colref: Column reference for the foreign key. :param ref_resource: Referenced table. :param ref_colref: Column reference of the key in the referenced table. c3HK|]}|djjDvVdS)cg|] }|j SrL)rGrs rNrz3Table.add_foreign_key...sDDDa16DDDrMN)rr)rrrs rNrz(Table.add_foreign_key..s=WW3DD4+;+CDDDDWWWWWWrMz unknown column in foreignKey {0})rr)rrN) rrrrrrrrrrr)rr ref_resource ref_colrefs` rNadd_foreign_keyzTable.add_foreign_keys",FUDM!B!BN&WWWWPVWWWWW P?FFvNNOO O $++J,?,?%&2zRRA A - -      rMcft||jstddS)Nz#url property is required for Tables)rr[rrrs rNr[zTable.__attrs_post_init__s<%%d+++x DBCC C D DrMrjNc,|jr |jjndSrx)rrrs rN local_namezTable.local_names"&(4tx4rMcR|jp |jr |jjp tSrx)rrr rs rN _get_dialectzTable._get_dialects$|S E1ES'))SrMrrsrr_zippedc |}d|jjD}|tur5|j|rt j|n|j}d}t||5} |j r| d|D|D]ӊtttfrfdt|D} n|rot!d|Dz } | r?t%ddd | Dfd |D} |d z }| | | | cd d d S d d d n #1swxYwY|r|rt j|} t-jt1| j| jd zdt,j5} | t1| | jd d d n #1swxYwY| |S)a Write row items to a CSV file according to the table schema. :param items: Iterator of `dict` storing the data per row. :param fname: Name of the file to which to write the data. :param base: Base directory relative to which to interpret table urls. :param strict: Flag signaling to use strict mode when writing. This will raise `ValueError` if any row (dict) passed in `items` contains unspecified fieldnames. :param _zipped: Flag signaling whether the resulting data file should be zipped. :return: The CSV content if `fname==None` else the number of rows written. c g|] }|j | SrL)rrs rNrzTable.write..sQQQ!qyQAQQQrMrrcg|] }|j SrLrrs rNrzTable.write..s D D Da D D DrMcLg|] \}}||!SrL)r)rrritems rNrzTable.write..s-XXX&!S399T!W--XXXrMc8h|]}d|Srrrrs rNrzTable.write..s$1_1_1_s$++c2B2B1_1_1_rMz*dict contains fields not in fieldnames: {}z, c3@K|]}d|VdS)z'{}'Nr)rfields rNrzTable.write..s.)P)P5&--*>*>)P)P)P)P)P)PrMc g|]V}||jd|WSr*)rrnrr)rrr(s rNrzTable.write..sl555  $((JS1A1A(B(B#D#DEE555rMrN.zipr) compression)arcname)r!rrDEFAULTrrrrrr rwriterowrrrrrrrrrrlzipfileZipFiler[rrrG ZIP_DEFLATEDrunlink)rrrsrrr"rnon_virtual_colsrowcountwriterrrfpathzipfr(s @rNrz Table.writes:"##%%QQt'7'?QQQ G  H$$4%NW\$%7%7%7TYOOE 5' 2 2 2 %f~ F D D3C D D DEEE % %dT5M22 5XXXXIFV>??#0 ; 3u::uz :::  ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; LLNNNs%=DF))F-0F-*IIIcd}|tjd|jjrt j|jj}t }|tdD]S\}}}||} | |vr)td ||| |d}>| | T|S)NTzSthe items argument of check_primary_key is deprecated (its content will be ignored)r| with_metadataz"{0}:{1} duplicate primary key: {2}r|F) rrrroperator itemgetterr iterdictsrrrr) rr|rsuccessget_pkrrslinenorpks rNcheck_primary_keyzTable.check_primary_keys   MH I I I   & !($*:*EFF55D&*nnPTn&U&U ! !"vsVC[[:: <CCE6SUVV!!!!$GGHHRLLLLrMc*|Srx)rCrs rN__iter__zTable.__iter__s~~rMTc #P"K}|pjj}ggt } }}jjD]m} | jr)| jr!| | j | jfn| | j | j r| | j ntj5} t|rRt!jt!jt'jt+|j|j} n|} t1j|""s"j"jdz} | r| t?j t+| }t!j|!"fd|"Dd|j} | tG| |}tI|}|j r7 tK|\}}|sjjr>tMjjtM|krtOj(dtS|jjD]\}} | *|}| js|stOj(dtW|t*rS|,ddd j-pd ,ddfvrtOj(d n#t\$rYd d d d SwxYw|}||ks,tMjjtM|kr*|s(t_tS|jj}n|sjjrtMjjtM|krg}ta|D]\}} | |jj|f.#tb$r`| d 2|d ztf4dd 2|d zifYwxYwnfd|D}dta|D}| t d|Dz }|r#tkd2|||D]\}}d|D}|}d}|s|rdta|D}tS||D]\\}}} }| r | 6|||| j <n#tj$rr}|s9tOj(d2|| j7|||| j <n-tqd2|||d z|||d}Yd }~nd }~wwxYw||vr||=|r-tOj(d2|j9|||<|:D]6\}}||vr-tqd2|||d z|d|d}7|D]} |;| d |D]\} }!|!j<di||| <|s|r |||fV|V d d d n #1swxYwY|j=_>d S)a$Iterate over the rows of the table Create an iterator that maps the information in each row to a `dict` whose keys are the column names of the table and whose values are the values in the corresponding table cells, or for virtual columns (which have no values) the valueUrl for that column. This includes columns not specified in the table specification. Note: If the resolved data filename does not exist - but there is a zip file of the form `fname+'.zip'`, we try to read the data from this file after unzipping. :param log: Logger object (default None) The object that reports parsing errors. If none is given, parsing errors raise ValueError instead. :param bool with_metadata: (default False) Also yield fname and lineno :param fname: file-like, pathlib.Path, or str (default None) The file to be read. Defaults to inheriting from a parent object, if one exists. :param strict: Flag signaling whether data is read strictly - i.e. raising `ValueError` when invalid data is encountered - or not - i.e. only issueing a warning and returning invalid data as `str` as provided by the undelying DSV reader. :return: A generator of dicts or triples (fname, lineno, dict) if with_metadata rcr/cHg|]}|j|SrL)endswithrG)rnr;s rNrz#Table.iterdicts..Ks.&\&\&\QQZZPUPZE[E[&\q&\&\&\rMrr%zColumn number mismatchzIncompatible table models-rzIncompatible column titlesNrrrGcHg|]}|j|fSrLr)rhrs rNrz#Table.iterdicts..xs/SSSq4#3#>#>q#A#ABSSSrMc$g|] \}\}}|||fSrLrLrjrQrs rNrz#Table.iterdicts..ys&MMMFQAq!9MMMrMc30K|]\}}}||jVdSrxrrSs rNrz"Table.iterdicts..zs0(R(RgaAPQ(R(R(R(R(R(R(RrMz#{0} is missing required columns {1}c.i|]\}}}||j||SrLrrSs rNrz#Table.iterdicts..s,PPPWQ1qPQZPAqPPPrMFc g|]P\}}|d|dztdd|dzifQS)rrrG)rrr!)rrrs rNrz#Table.iterdicts..sq#4#4#4!Aq"))!a%00))693C3CAE3J3J*KLLN#4#4#4rMrzInvalid column value: {} {}; {}z{0}:{1}:{2} {3}: {4}r@Tz%Unspecified column "{0}" in table {1}rrL)?r!rrrrrrrrrrrr contextlib ExitStackrre TextIOWrapperBytesIOrmrnr[contentrdrrexistsrrrG enter_contextr4r5rfnamelistr rrrrrziprrrYr StopIterationrr IndexErrorrrr!rrlrrrrr<rcomments _comments)#rr|r?rs_Rowrrcolnames virtualcols requiredcolsrstackhandlezipfnamer<readerrrrGr^ header_colsrcnamemissingrFrrerrorrTrr?ekeyrr;s#` @rNrCzTable.iterdictss8##%%4))$)44.0"cee|+#+ - -C{ ,<C&& CL'ABBB +++| -  ,,,  ! # #t "ue}} 7)Jx|CJJ77?@@7K[]]] U++||~~7$|44UZ&5HIIH((7$227?3x==3Q3QRR!#!1 II&\&\&\&\$--//&\&\&\]^&_``%,%5"7"7"7(()DVU\)])])]^^F&\\F~ "  $V IAv! L+3DD+E+Ec+J+J1+MRO9O9O ( .J K K K$Et "t "t "t "t "t "t "t "B"("")122c&kkAA&A#3vt/?/G#H#HII  T 0 8 T)122S[[@@ )& 1 1RRHAuR#**E43C3KA3N+OPPPP%RRR#**%,,QU33",,fi6F6Fq1u6M6M-NOO,QRRRRRRRTSSSFSSS MMi 6L6LMMMK"S(R(R(R(R(R%R%RRG _ !F!M!MeU\!]!]^^^%5 "5 " PP PPPdff#44#4#4%.cNN #4#4#4K '*+s&;&;##NKQ3# -.1hhqh.H.HC OO) - - -#)- ( $E$L$LQPSP\^_$`$`!b!b!b23CJ ,$:$A$A%QRUVQVXY[\$]$](+!-!-!-!-)- -== ( !d$M G N NqRVRa b bddd!"A$NN,,%%DAq||$299 %vq1ua9[]] #%%%%!%$..CNN3----&166MC.x5555CHH"$"#VS00000! k5 "t "t "t "t "t "t "t "t "t "t "t "t "t "t "t "j sF\DM76\7 N\NB-\>'Q&%\&A'S \SC\V54\5 X1 ?A(X, '\,X1 1C\\\)NN)"rIrJrKrVrWrXrrerr[rnrrr[rr r!r2Iterablerrrr2rrrrrrHrJrprq GeneratorrCrLrMrNrrs  TWU+++NI   "DDD 5FLd3555X5TgTTTT IPGK.3/4 44_V\$e2C%DE4_V\#w|2C%DE4OFLgl1B$CD4od+ 4 t, 4 :@c3h9O 4444l(   ( ])])  $d* +])])])])])])rMrcg}|D]w}t|ttfstjd3|t|trt|n|x|S)NzInvalid value for Table spec)rrrrrrr!)r?r^rs rNconverter_tablesrws} CLL"tUm,, L M8 9 9 9 9 JJjT.B.BJur*** K K K K JrMc eZdZdZejdejeeZ dZ e dZ dZ ddejeejfdejed ejed ejejeeeffd Zd ejejeffd ZedejeeffdZdejejeeeeffdZ ddZ!ddZ"dS)raM A table group description is an object that describes a group of tables. A `TableGroup` delegates most of its responsibilities to the `Table` objects listed in its `tables` property. For convenience, `TableGroup` provides methods to - read data from all tables: :meth:`TableGroup.read` - write data for all tables: :meth:`TableGroup.write` It also provides a method to check the referential integrity of data in related tables via :meth:`TableGroup.check_referential_integrity` .. seealso:: ``_ F)rvrSrTc\t||jD] }||_ dSrx)rr[rr)rrs rNr[zTableGroup.__attrs_post_init__s:%%d+++[ ! !E EMM ! !rMcFt||Srx)r to_tablegroup)rdps rNfrom_frictionless_datapackagez(TableGroup.from_frictionless_datapackages2,,S111rMcHd|jDS)z/ Read all data of a TableGroup cXi|]'\}}|t|(SrL)rrC)rtnamets rNrz#TableGroup.read..s.RRRxuatAKKMM**RRRrM) tabledictrrs rNrlzTableGroup.reads'SR4>;O;O;Q;QRRRRrMrsrr"rc tj|}|D].\}}|j|||j||/||dS)a Write a TableGroup's data and metadata to files. :param fname: Filename for the metadata file. :param items: Keyword arguments are used to pass iterables of rows per table, where the table URL is specified as keyword. )rrr"N)rrrrrrr)rrsrr"rrrowss rNrzTableGroup.writesr U## ;;== a aKE4 N5 ! ' '5<X_ ' ` ` ` ` UrMdestc ftj|}|jD]f}tjt |j|jt |j|g||j j z |_ | |j dS)z Write a TableGroup's data and metadata to files relative to `dest`, adapting the `base` attribute. :param dest: :return: N) rrrshutilcopyr[rrrrrGr)rrrs rNrzTableGroup.copys|D!![ Y YE KEI--di88993uy?P?PQU?V?V;W;W X X X XT[--  T[!!!!!rMrjc$d|jDS)Nci|] }|j| SrLrrrs rNrz(TableGroup.tabledict..s555A a555rMrrs rNrzTableGroup.tabledicts555555rMc*fdjDS)Ncg|]L}|jjD]=}|jjj|jjj|jj||jf>MSrL)rrrrrrrr)rrfkrs rNrz+TableGroup.foreign_keys..sv111 1=+D 11 &(</1r|4;< ,"  $1111rMrrs`rN foreign_keyszTableGroup.foreign_keyss21111 [ 111 1rMc  |D] \}}}}t|t|krtdt||D]\}}|j||}|j||} |r| s#td|||jrZ| jrS|jj| jjkr9td||jj|| jjƐdS#ttf$r'} td| d} ~ wwxYw)NzFForeign key error: non-matching number of columns in source and targetrXz.Foregin key error: missing column "{}" or "{}"z;Foregin key error: non-matching datatype "{}:{}" or "{}:{}"z0Foreign key error: missing table "{}" referenced) rrrrarrrrrKeyErrorAssertionError) rrstsctttcscoltcolscolumntcolumnrrs rNvalidate_schemazTableGroup.validate_schemas ["&"3"3"5"5 [ [BBr77c"gg%%$`bbb"%b"++ [ [JD$ n77V7LLG n77V7LLG#aa(LSSTXZ^__aaa'[G,<[#,1W5E5JJJ(Y`` $g&6&;T7CSCXZZ[[[ [  [ [.) [ [ [OVVWXYYZZ Z [sD#D''E8"EENc "|tjd|rw|jD]o}|jjD]`}|D][t fd|jDr9tdfd|jD|j\ap | d}n8#t$r+}d}tt||d Yd}~nd}~wwxYw| }t|d }tj|d D]p\} } t!| } | d d } dtj| dD} d| D} | |D]9| D]4\}}||vr|rd}||5:t'| | D]\\}}\} }t)|dk}|D]\}}t+j|}||dD]t\}}}||}||rt/|t r|}n|g}|D]@}|sd|vr ||vr3td|||| jj|d}Aur|S)zT Strict validation does not allow for nullable foreign key columns. Nz\the data argument of check_referential_integrity is deprecated (its content will be ignored)c3FK|]}|duVdSrxrrrrs rNrz9TableGroup.check_referential_integrity..-s2RRswws||t3RRRRRRrMz!Foreign key column is null: {} {}c:g|]}|SrLrrs rNrz:TableGroup.check_referential_integrity../s# L L L# L L LrMTFrq)r|r}cD|dj|d|djfS)Nrrrrxs rNrz8TableGroup.check_referential_integrity..8sQqT_adAaDO,TrM)rsc|djSrrrs rNrz8TableGroup.check_referential_integrity..<s 1rMrc0g|]\}}|d|DfS)c g|] \}}}}||f SrLrL)rrchildrefs rNrzETableGroup.check_referential_integrity...?s%HHH/?q!UCuclHHHrMrL)rrskgrps rNrz:TableGroup.check_referential_integrity..?sFPPP$3HH4HHHIPPPrMc|dS)NrrLrs rNrz8TableGroup.check_referential_integrity..@s 1rMcLg|]!\}}tj|tf"SrL)rArBr)rrsrs rNrz:TableGroup.check_referential_integrity..As-QQQvsA,c2CEE:QQQrMr@rr>z({0}:{1} Key `{2}` not found in table {3})rrrrrr rrrrrr[rr) itertoolsgroupbyrrCrrarrArBrrr)rrr|rrrrDrrfkeysrgrprt_fkeysget_seenrnrrschildren single_columnrrget_refrsrFr(rcolrefsrs @rNcheck_referential_integrityz&TableGroup.check_referential_integrity"s   MH I I I  c[ c c-3ccB ccRRRRr?QRRRRRc",-P-W-W L L L L9K L L LbN`.b.b#c#ccccc  9  " " "GG 9 9 9G QS 8 8 8 8 8 8 8 8 8 9!!##u"T"TUUU '/H/HII( 0( 0FAss))CF1IEPP(1(9#~~(N(NPPPGQQQQQH3// ' '!)''ICs3xx4''!,&+GHHSSXX&&&& ' /2'8.D.D 0 0*h!T!$SQ "*00JE3&137G/43VZ/[/[00+vt!(!>$*/z&$/G/G/'-GG'-hG&- 0 0F#0 0TV^^ (!'t!3!3 ,$N$U$U(-(.(.(- (8 %:%: ), !-!-!-!-+0 000 08sB)) C3!CC)FFr)NNF)#rIrJrKrVrWrXr/rrwrr[r0r}rlrrr[rrr2rrtrrrrrnDictrrListTuplerrrrLrMrNrrs  TW%d););GW X X XF!!! 22[2SSS/4/4\#w|"34od+t,v|D%4E'FG " "glC&78 " " " "66;sEz2666X61fk&,udE47O*PQ1111[[[[(CCCCCCrMrceZdZdZddedejedefdZe defd Z e d Z e ddej eeffd Zdd Zd ZdZdZdS)rzH Python API to read CSVW described data and convert it to JSON. NFrmd_urlrjcg|_d}tj5}|r(|tjd}d} t |p|}n2#t jj$r| |\}}YnwxYwt| ddhk|_ d| ddvrtdd |vr|d rt|d t std t#|r=t$|| |_|jd nt$|| |_nt#|r\t.|| |_|r8|jjrd|jj_n>DFF**$*7777'11#B1??DFF#;;;"^^Cb^99DF C6>C49DFN11-4E-B-B-BDFN"__Sr_::DF+5dfj+I+IW$&--PTPVxDK ( ( ,4((Cx(RYuch%?%?(38CVCVWZC[C[(#'(!% 3D O' 4' 4' 4' 4' 4' 4' 4' 4' 4' 4' 4' 4' 4' 4' 4P  $ M  # # # # # $ $s6-J= AJ=,B  J= B  H%J==KKrjc|jrdStjd5}|jD]C}|dD]}|stjdD|jdstjd|r|j|dddn #1swxYwYt|j S)z Performs CSVW validation. .. note:: For this to also catch problems during metadata location, the `CSVW` instance must be initialized with `validate=True`. FTrrXzDuplicate primary keyz"Referential integrity check failedN) rrrrCrHr tablegrouprrr)rrrrs rNis_validz CSVW.is_valids0 = 5  $D 1 1 1 (Q ; ;66A..00;M"9:::?>>d>KK D BCCC ( $$Q''' ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( &&&&sBCC Cct|jtr|jn!td|jji|jS)Nr)rr)rrrrrrs rNrzCSVW.tablegroups>#DFJ77Ktvv  5dk J J J KrMc \d}d}|rt|rtj|}tt jd|jdd}|jd}|rc|ddvrYtt|d  |}|||r||fStj d tjtd  |}|jd kr|jnd }|dD]}tjtt#|| |}|jd krQ |}|||r||fcStj d#t&j$rYwxYwnk|rit+jt/|dzr3tt+jt/|dz|fSd|d}t|pds0t+j|}t/||d<|j|d <||fS)u Implements metadata discovery as specified in `§5. Locating Metadata `_ c|d|gD]C}|dd|dddkrdSDdS)Nr/rTF)rnrY)rrrs rN describesz'CSVW.locate_metadata..describessf2$//  99S>>"%u););C)@)@)DDD44E5rMFzheader\s*=\s*absentz content-typerO describedbyr)zapplication/csvm+jsonzapplication/ld+jsonzapplication/jsonrz?Ignoring linked metadata because it does not reference the dataz/.well-known/csvmz&{+url}-metadata.json csv-metadata.json )rz8Ignoring metadata because it does not reference the dataz-metadata.jsonr)rrr)rrmheadrrrheadersrnlinksrurrrr status_codetextrYrrrorrrr[r^rG) rrrr^descrlocslineps rNrzCSVW.locate_metadatas     $ V6#;;$ V-$$CRY'=s{~_a?b?bccddI9==//D eV )XXXd4;//77<<==9R%%ey=(M"cddd ,t$788@@EEFFC"#55388;dD 4((  l4 D(9(9(@(@S(@(I(I#J#J#R#RSV#W#WXX?c)) XXZZ$9R--1#%y=000 &`aaaa/ *  V|CHH'7788??AA V SXX8H-H I IJJIUU3  ciR    S!!Aq66CLCJI~s'#G" G""G43G4cftj}jjrMt jt s3|tjjjdfdj D|d<|r+ttj d|dDS|S)zk Implements algorithm described in ``_ T) flatten_listcHg|]}|j |SrL)r_table_to_json)rrrs rNrz CSVW.to_json..sF]]]+0uG[]    & &]]]rMrc2g|]}d|dDS)c*g|]}|ddS)rrrL)rr`s rNrz+CSVW.to_json...s!"G"G"G1[>!#4"G"G"GrMrrLrs rNrz CSVW.to_json..s+!_!_!_A"G"Gah"G"G"G!_!_!_rM) rprqrrrrupdaterto_jsonrrrchain)rminimalr^s` rNrz CSVW.to_jsons%'' 6  Oz$&%'@'@ O JJv~df&9MMM N N N]]]]48K]]]H  b!_!_QTU]Q^!_!_!_`bb b rMctj}tjj|d<djvrjd|d<jrtj j|d<| tj j tjdj j DD]6}|d|_|d|_7fdt%d d d D}jrdjD|d<||d<|S)Nrrrrc g|] }|j|f SrLrr+s rNrz'CSVW._table_to_json..s'_'_'_cS(9'_'_'_rMrrc Pg|]"\}\}}}|||#SrL) _row_to_json)rrownumr rowsourcenumrcolsrrs rNrz'CSVW._table_to_json..sJ   ..L#   eT3 E E   rMTF)r?rrstartcg|] }|d S)rrLrs rNrz'CSVW._table_to_json..s"A"A"AA1Q4"A"A"ArMz rdfs:commentr)rprqr[rrrrrrrrrrrrrrrrrCre)rrr^rrrs`` @rNrzCSVW._table_to_jsons%''**5:6677E 5> ! !-CJ ; 7!>%+66CL 6>%"455666&'_'_UEVE^'_'_'_``;;== 3 3C!kk-88CO;;z22CLL      2;d5AA3L3L3L    ? B"A"A"A"A"AC E  rMctj}d|j|j||d<||d<|jjrOdfd|jjDD|d<t|ddkr|dd|d<| ||||d <|S) Nz {}#row={}rrcg|]}||SrLrLrs rNrz%CSVW._row_to_json..(s5YYYVWYYYYrMc:g|]}|SrLr)rrGrs rNrz%CSVW._row_to_json..)s#RRRdCGGDMMRRRrMrrrr) rprqrrrrrrr _describes)rrrrrrr^s ` rNrzCSVW._row_to_json#s%'' '' (9(9%*(E(E|TTE H   & 1YYRRRRe6G6QRRRYYYCM3x=!!Q&& #H a 0H  ??5$VDDK rMc |g}|jd}|r@|tjdd||||t |dD]\}\}} ||} | r| j s| j r.| r| n| } | r| | vs| dks| | r| j r| gkrv|tj || ||jjs|jsd|n|| ||jjD]E} | j r<|tj || || jd|Ftj|S) Nrr)r )aboutrnrrrrOr)rrrrTriplerrrrnrrrrfrom_colrrrr group_triples) rrrrrtriplesrrrr?rr.s rNrzCSVW._describes2s$,,Z88  ] NN6=U%,,xSY,2Z2Z\\\ ] ] ]#399;;a888  IAv1((1++C * ck *-F3##%%%%2D2D2F2FD dqBww194= ]4=/0Bww NN6=11)1S:>:JS   ###QR    $, b bC{ bv}55eS#szSWY_``aaa#G,,,rMrrxr)rIrJrKrVr[rr2rrrnrr staticmethodrrrrrrrrLrMrNrrhs,$,$C,$)=,$PT,$,$,$,$\'$'''X'.KKXK==V\$*%====\=~"6   -----rMr)r`ra)rvr)RrVrerrorr rrr4rArrYrrYrp urllib.parserrr language_tagsrrWrm uritemplaterOr datatypesr dsvr BaseDialectr r frictionlessrrrr2__all__r rYr rrGrrrirrrrurrrrrrrrqrrrrr5rrqrsrurrrrrrrrrrrrwrrrLrMrNrsp  6666666666  SSSSSSSSSS%%%%%% &((   / (/ 8/ 3/ . /  % /  ( / (/ "/ 2/ */ &/ ./-/ &/ '/  (!/" -#//$ 2%/& 4'/( -)/* &+/, (-/. $//0 *1/2 3/4 &5/6 +7/8 -9/: (;/< '=/> (?/@ 'A/B