IWhat is the cause to get XPath in weird format using Python?

[MDRI]

IWhat is the cause to get XPath in weird format using Python?
==============================================

Thanks for reviewing this thread.

I am trying to get the Xpaths for input IRSW2.xsd & W2TestfileS.xml. These files are attached to this thread.

Here is my code :

from lxml import etree, objectify def parseXML(xmlFile, outputFile): """ Parse the XML function """ with open(xmlFile, 'rb') as fobj: xml = fobj.read() f = open(outputFile,'w') #open write to file root = etree.fromstring(xml) f.write("%s|%s\n" %("Field", "Value")) tree = etree.ElementTree(root) for e in root.iter(): f.write("%s|%s\n" %(tree.getpath(e), e.text)) f.close() if __name__ == "__main__": print ('Loading variables...') input = 'IRSW2.xsd' output = input + '.out' parseXML(input,output)

My expectation of output as below:

/IRSW2 /IRSW2/EmployerName/BusinessNameLine1Txt /IRSW2/W2StateLocalTaxGrp/W2StateTaxGrp /IRSW2/WithholdingAmt /IRSW2/EmployersUseGrp/EmployersUseCd /IRSW2/OtherDeductionsBenefitsGrp/Amt /IRSW2/W2StateLocalTaxGrp/W2StateTaxGrp/W2LocalTaxGrp/LocalWagesAndTipsAmt

Input XML messgae to get desired output

<?xml version="1.0" encoding="UTF-8"?> <!--Sample XML file generated by XMLSpy v2020 rel. 2 (x64) (http://www.altova.com)--> <IRSW2 xmlns="http://www.irs.gov/efile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" documentId="-" softwareId="00000000" softwareVersionNum="!" documentName="IRSW2" xsi:schemaLocation="http://www.irs.gov/efile IRSW2.xsd">	<CorrectedW2Ind>X</CorrectedW2Ind>	<EmployeeSSN>000000000</EmployeeSSN>	<EmployerEIN>000000000</EmployerEIN>	<EmployerNameControlTxt>&amp;</EmployerNameControlTxt>	<AgentForEmployerInd>X</AgentForEmployerInd>	<EmployerName>	<BusinessNameLine1Txt>#</BusinessNameLine1Txt>	<BusinessNameLine2Txt>#</BusinessNameLine2Txt>	</EmployerName>	<EmployerUSAddress>	<AddressLine1Txt>0</AddressLine1Txt>	<AddressLine2Txt>0</AddressLine2Txt>	<CityNm>A</CityNm>	<StateAbbreviationCd>AL</StateAbbreviationCd>	<ZIPCd>00000</ZIPCd>	</EmployerUSAddress>	<ControlNum>!</ControlNum>	<EmployeeNm>'</EmployeeNm>	<EmployeeUSAddress>	<AddressLine1Txt>0</AddressLine1Txt>	<AddressLine2Txt>0</AddressLine2Txt>	<CityNm>A</CityNm>	<StateAbbreviationCd>AK</StateAbbreviationCd>	<ZIPCd>00000</ZIPCd>	</EmployeeUSAddress>	<WagesAmt>0</WagesAmt>	<WithholdingAmt>0</WithholdingAmt>	<SocialSecurityWagesAmt>0</SocialSecurityWagesAmt>	<SocialSecurityTaxAmt>0</SocialSecurityTaxAmt>	<MedicareWagesAndTipsAmt>0</MedicareWagesAndTipsAmt>	<MedicareTaxWithheldAmt>0</MedicareTaxWithheldAmt>	<SocialSecurityTipsAmt>0</SocialSecurityTipsAmt>	<AllocatedTipsAmt>0</AllocatedTipsAmt>	<DependentCareBenefitsAmt>0</DependentCareBenefitsAmt>	<NonqualifiedPlansAmt>0</NonqualifiedPlansAmt>	<EmployersUseGrp>	<EmployersUseCd>A</EmployersUseCd>	<PriorUSERRAContributionYr>00</PriorUSERRAContributionYr>	<EmployersUseAmt>0</EmployersUseAmt>	</EmployersUseGrp>	<StatutoryEmployeeInd>X</StatutoryEmployeeInd>	<RetirementPlanInd>X</RetirementPlanInd>	<ThirdPartySickPayInd>X</ThirdPartySickPayInd>	<OtherDeductionsBenefitsGrp>	<Desc>!</Desc>	<Amt>0</Amt>	</OtherDeductionsBenefitsGrp>	<W2StateLocalTaxGrp>	<W2StateTaxGrp>	<StateAbbreviationCd>AS</StateAbbreviationCd>	<EmployerStateIdNum>!</EmployerStateIdNum>	<StateWagesAmt>0</StateWagesAmt>	<StateIncomeTaxAmt>0</StateIncomeTaxAmt>	<W2LocalTaxGrp>	<LocalWagesAndTipsAmt>0</LocalWagesAndTipsAmt>	<LocalIncomeTaxAmt>0</LocalIncomeTaxAmt>	<LocalityNm>!</LocalityNm>	</W2LocalTaxGrp>	</W2StateTaxGrp>	</W2StateLocalTaxGrp>	<StandardOrNonStandardCd>N</StandardOrNonStandardCd>	<W2SecurityInformation>	<W2DownloadCd>0</W2DownloadCd>	<W2DownloadResultCd>0</W2DownloadResultCd>	<W2DownloadFailedAttemptCnt>0</W2DownloadFailedAttemptCnt>	</W2SecurityInformation> </IRSW2>

The above code produce for W2TestfileS.xml

Output:
 Field|Value /*| /*/*[1]|X /*/*[2]|000000000 /*/*[3]|000000000 /*/*[4]|& /*/*[5]|X /*/*[6]| /*/*[6]/*[1]|# /*/*[6]/*[2]|# /*/*[7]| /*/*[7]/*[1]|0 /*/*[7]/*[2]|0 /*/*[7]/*[3]|A /*/*[7]/*[4]|AL /*/*[7]/*[5]|00000 /*/*[8]|! /*/*[9]|' /*/*[10]| /*/*[10]/*[1]|0 /*/*[10]/*[2]|0 /*/*[10]/*[3]|A /*/*[10]/*[4]|AK /*/*[10]/*[5]|00000 /*/*[11]|0 /*/*[12]|0 /*/*[13]|0 /*/*[14]|0 /*/*[15]|0 /*/*[16]|0 /*/*[17]|0 /*/*[18]|0 /*/*[19]|0 /*/*[20]|0 /*/*[21]| /*/*[21]/*[1]|A /*/*[21]/*[2]|00 /*/*[21]/*[3]|0 /*/*[22]|X /*/*[23]|X /*/*[24]|X /*/*[25]| /*/*[25]/*[1]|! /*/*[25]/*[2]|0 /*/*[26]| /*/*[26]/*| /*/*[26]/*/*[1]|AS /*/*[26]/*/*[2]|! /*/*[26]/*/*[3]|0 /*/*[26]/*/*[4]|0 /*/*[26]/*/*[5]| /*/*[26]/*/*[5]/*[1]|0 /*/*[26]/*/*[5]/*[2]|0 /*/*[26]/*/*[5]/*[3]|! /*/*[27]|N /*/*[28]| /*/*[28]/*[1]|0 /*/*[28]/*[2]|0 /*/*[28]/*[3]|0

The above code produce for IRSW2.xsd

Output:
Field|Value /xsd:schema| /xsd:schema/xsd:annotation| /xsd:schema/xsd:annotation/xsd:documentation| /xsd:schema/xsd:annotation/xsd:documentation/*[1]|IRS e-file Income Tax Schema - IRS Form W-2 Wage and Tax Statement /xsd:schema/xsd:annotation/xsd:documentation/*[2]|2020 /xsd:schema/xsd:annotation/xsd:documentation/*[3]|Final Schema Version RL104 Drop 3 1041 Family Form /xsd:schema/xsd:annotation/xsd:documentation/*[4]|Sept 2 2020 /xsd:schema/xsd:include|None /xsd:schema/comment()[1]| =============================================================== /xsd:schema/comment()[2]| ======================= IRS Form W-2 ========================== /xsd:schema/comment()[3]| =============================================================== /xsd:schema/xsd:element| /xsd:schema/xsd:element/xsd:annotation| /xsd:schema/xsd:element/xsd:annotation/xsd:documentation|IRS Form W-2 /xsd:schema/xsd:element/xsd:complexType| /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent| /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent/xsd:extension| /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent/xsd:extension/xsd:attributeGroup| /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent/xsd:extension/xsd:attributeGroup/xsd:annotation| /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent/xsd:extension/xsd:attributeGroup/xsd:annotation/xsd:documentation|Common return document attributes /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent/xsd:extension/xsd:attribute| /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent/xsd:extension/xsd:attribute/xsd:annotation| /xsd:schema/xsd:element/xsd:complexType/xsd:complexContent/xsd:extension/xsd:attribute/xsd:annotation/xsd:documentation|IRS internal use only. To avoid error in the return, do not include the attribute name or value. /xsd:schema/xsd:complexType[1]| /xsd:schema/xsd:complexType[1]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:annotation/xsd:documentation|Content model for Form W-2 /xsd:schema/xsd:complexType[1]/xsd:sequence| /xsd:schema/xsd:complexType[1]/xsd:sequence/comment()[1]| Corrected W2 Indicator /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[1]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[1]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[1]/xsd:annotation/xsd:documentation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[1]/xsd:annotation/xsd:documentation/*[1]|Corrected W2 Indicator /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[1]/xsd:annotation/xsd:documentation/*[2]|0010 /xsd:schema/xsd:complexType[1]/xsd:sequence/comment()[2]| Employee SSN /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[2]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[2]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[2]/xsd:annotation/xsd:documentation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[2]/xsd:annotation/xsd:documentation/*[1]|Employee SSN /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[2]/xsd:annotation/xsd:documentation/*[2]|a /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[2]/xsd:annotation/xsd:documentation/*[3]|0035 /xsd:schema/xsd:complexType[1]/xsd:sequence/comment()[3]| Employer EIN /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[3]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[3]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[3]/xsd:annotation/xsd:documentation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[3]/xsd:annotation/xsd:documentation/*[1]|Employer EIN /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[3]/xsd:annotation/xsd:documentation/*[2]|b /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[3]/xsd:annotation/xsd:documentation/*[3]|0040 /xsd:schema/xsd:complexType[1]/xsd:sequence/comment()[4]| Employer Name Control /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[4]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[4]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[4]/xsd:annotation/xsd:documentation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[4]/xsd:annotation/xsd:documentation/*[1]|c /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[4]/xsd:annotation/xsd:documentation/*[2]|0045 /xsd:schema/xsd:complexType[1]/xsd:sequence/comment()[5]| Agent for Employer Indicator /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[5]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[5]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[5]/xsd:annotation/xsd:documentation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[5]/xsd:annotation/xsd:documentation/*[1]|Agent for Employer Indicator /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[5]/xsd:annotation/xsd:documentation/*[2]|c /xsd:schema/xsd:complexType[1]/xsd:sequence/comment()[6]| Employer Name /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[6]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[6]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[6]/xsd:annotation/xsd:documentation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[6]/xsd:annotation/xsd:documentation/*[1]|Employer name /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[6]/xsd:annotation/xsd:documentation/*[2]|c /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:element[6]/xsd:annotation/xsd:documentation/*[3]|0050 0055 /xsd:schema/xsd:complexType[1]/xsd:sequence/comment()[7]| Employer Address /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:choice[1]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:choice[1]/comment()[1]| Employer US Address /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:choice[1]/xsd:element[1]| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:choice[1]/xsd:element[1]/xsd:annotation| /xsd:schema/xsd:complexType[1]/xsd:sequence/xsd:choice[1]/xsd:element[1]/xsd:annotation/xsd:documentation| ...... .......

*** It is not allowing to upload an .xsd file to this thread. Let me know, how I could upload the file?

How do I fix the above code to get desire XPATH as shown above ?

Thanks for your guidance.
  W2TestfileS.xml (Size: 2.73 KB / Downloads: 506)
  IRSW2.zip (Size: 2.71 KB / Downloads: 546)

[supuflounder]

I cannot find "XPath" (case-insensitive search) anywhere in the post, except the parts that ask about it. I am not able to see what the problem is.
If you need to attach a file and it won't let you, and the file is text, just use a scrolling-box environment and copy/paste it. Not a clean solution, but it would work.

[Larz60+]

superflounder -

XPath is not a word in the document.
It is a path to a particular location within a file based on XML contents.

[MDRI]

Thanks for your responses.

I added the attachments to my questions (.xml, .xsd (zipped).

What is XPath? XPath is a major element in the XSLT standard. XPath can be used to navigate through elements and attributes in an XML document. XPath stands for XML Path Language. XPath uses "path like" syntax to identify and navigate nodes in an XML document.

[MDRI]

I uploaded xml/xsd files related to my thread.

Are you able to open/review those files ?

Thanks for your guidance.

[DeaD_EyE]

Maybe you want this:

from xml.etree import ElementTree as ET doc = ET.parse("Downloads/W2TestfileS.xml") ET.dump(doc)

Output:
<ns0:IRSW2 xmlns:ns0="http://www.irs.gov/efile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" documentId="-" softwareId="00000000" softwareVersionNum="!" documentName="IRSW2" xsi:schemaLocation="http://www.irs.gov/efile IRSW2.xsd"> <ns0:CorrectedW2Ind>X</ns0:CorrectedW2Ind> <ns0:EmployeeSSN>000000000</ns0:EmployeeSSN> <ns0:EmployerEIN>000000000</ns0:EmployerEIN> <ns0:EmployerNameControlTxt>&amp;</ns0:EmployerNameControlTxt> <ns0:AgentForEmployerInd>X</ns0:AgentForEmployerInd> <ns0:EmployerName> <ns0:BusinessNameLine1Txt>#</ns0:BusinessNameLine1Txt> <ns0:BusinessNameLine2Txt>#</ns0:BusinessNameLine2Txt> </ns0:EmployerName> <ns0:EmployerUSAddress> <ns0:AddressLine1Txt>0</ns0:AddressLine1Txt> <ns0:AddressLine2Txt>0</ns0:AddressLine2Txt> <ns0:CityNm>A</ns0:CityNm> <ns0:StateAbbreviationCd>AL</ns0:StateAbbreviationCd> <ns0:ZIPCd>00000</ns0:ZIPCd> </ns0:EmployerUSAddress> <ns0:ControlNum>!</ns0:ControlNum> <ns0:EmployeeNm>'</ns0:EmployeeNm> <ns0:EmployeeUSAddress> <ns0:AddressLine1Txt>0</ns0:AddressLine1Txt> <ns0:AddressLine2Txt>0</ns0:AddressLine2Txt> <ns0:CityNm>A</ns0:CityNm> <ns0:StateAbbreviationCd>AK</ns0:StateAbbreviationCd> <ns0:ZIPCd>00000</ns0:ZIPCd> </ns0:EmployeeUSAddress> <ns0:WagesAmt>0</ns0:WagesAmt> <ns0:WithholdingAmt>0</ns0:WithholdingAmt> <ns0:SocialSecurityWagesAmt>0</ns0:SocialSecurityWagesAmt> <ns0:SocialSecurityTaxAmt>0</ns0:SocialSecurityTaxAmt> <ns0:MedicareWagesAndTipsAmt>0</ns0:MedicareWagesAndTipsAmt> <ns0:MedicareTaxWithheldAmt>0</ns0:MedicareTaxWithheldAmt> <ns0:SocialSecurityTipsAmt>0</ns0:SocialSecurityTipsAmt> <ns0:AllocatedTipsAmt>0</ns0:AllocatedTipsAmt> <ns0:DependentCareBenefitsAmt>0</ns0:DependentCareBenefitsAmt> <ns0:NonqualifiedPlansAmt>0</ns0:NonqualifiedPlansAmt> <ns0:EmployersUseGrp> <ns0:EmployersUseCd>A</ns0:EmployersUseCd> <ns0:PriorUSERRAContributionYr>00</ns0:PriorUSERRAContributionYr> <ns0:EmployersUseAmt>0</ns0:EmployersUseAmt> </ns0:EmployersUseGrp> <ns0:StatutoryEmployeeInd>X</ns0:StatutoryEmployeeInd> <ns0:RetirementPlanInd>X</ns0:RetirementPlanInd> <ns0:ThirdPartySickPayInd>X</ns0:ThirdPartySickPayInd> <ns0:OtherDeductionsBenefitsGrp> <ns0:Desc>!</ns0:Desc> <ns0:Amt>0</ns0:Amt> </ns0:OtherDeductionsBenefitsGrp> <ns0:W2StateLocalTaxGrp> <ns0:W2StateTaxGrp> <ns0:StateAbbreviationCd>AS</ns0:StateAbbreviationCd> <ns0:EmployerStateIdNum>!</ns0:EmployerStateIdNum> <ns0:StateWagesAmt>0</ns0:StateWagesAmt> <ns0:StateIncomeTaxAmt>0</ns0:StateIncomeTaxAmt> <ns0:W2LocalTaxGrp> <ns0:LocalWagesAndTipsAmt>0</ns0:LocalWagesAndTipsAmt> <ns0:LocalIncomeTaxAmt>0</ns0:LocalIncomeTaxAmt> <ns0:LocalityNm>!</ns0:LocalityNm> </ns0:W2LocalTaxGrp> </ns0:W2StateTaxGrp> </ns0:W2StateLocalTaxGrp> <ns0:StandardOrNonStandardCd>N</ns0:StandardOrNonStandardCd> <ns0:W2SecurityInformation> <ns0:W2DownloadCd>0</ns0:W2DownloadCd> <ns0:W2DownloadResultCd>0</ns0:W2DownloadResultCd> <ns0:W2DownloadFailedAttemptCnt>0</ns0:W2DownloadFailedAttemptCnt> </ns0:W2SecurityInformation> </ns0:IRSW2>

[snippsat]

I showed you how to parse W2Testfile.xml in your last Thread, both with using BS and lxml for the task.
IRSW2.xsd is used for Validation,you still miss a file for that to work efileTypes.xsd(see that is referenced in IRSW2.xsd).

# Line 11 <xsd:include schemaLocation="efileTypes.xsd"/>

from lxml import etree xml_file = etree.parse("W2Testfile.xml") xml_validator = etree.XMLSchema(file="IRSW2.xsd") is_valid = xml_validator.validate(xml_file) print(is_valid)

Error:
.... lxml.etree.XMLSchemaParseError: Element '{http://www.w3.org/2001/XMLSchema}include': Failed to load the document 'efileTypes.xsd' for inclusion., line 11

How to validate an XML file with an XML schema in Python

[MDRI]

I showed you how to parse W2Testfile.xml in your last Thread, both with using BS and lxml for the task.
IRSW2.xsd is used for Validation,you still miss a file for that to work efileTypes.xsd(see that is referenced in IRSW2.xsd).

# Line 11 <xsd:include schemaLocation="efileTypes.xsd"/>

from lxml import etree xml_file = etree.parse("W2Testfile.xml") xml_validator = etree.XMLSchema(file="IRSW2.xsd") Thanks. I am attaching .xsd, .xml that validates to TURE. from lxml import etree xml_file = etree.parse("Test41.xml") xml_validator = etree.XMLSchema(file="Test41.xsd") is_valid = xml_validator.validate(xml_file) print(is_valid) is_valid = xml_validator.validate(xml_file) print(is_valid)

Error:
.... lxml.etree.XMLSchemaParseError: Element '{http://www.w3.org/2001/XMLSchema}include': Failed to load the document 'efileTypes.xsd' for inclusion., line 11

How to validate an XML file with an XML schema in Python

testdata.zip contain Test41.xml. Test41.xsd, efilesTypes.xsd
  testata.zip (Size: 16.37 KB / Downloads: 263)

How do I make xpath list for this .xml & .xsd?

Thanks for your help.