How to extract xml attributes using Xpath in Pig?

Question

I wanted to extract attributes from xml using Pig Latin.

This is a sample xml file

<CATALOG>
<BOOK>
<TITLE test="test1">Hadoop Defnitive Guide</TITLE>
<AUTHOR>Tom White</AUTHOR>
<COUNTRY>US</COUNTRY>
<COMPANY>CLOUDERA</COMPANY>
<PRICE>24.90</PRICE>
<YEAR>2012</YEAR>
</BOOK>
</CATALOG>

I used this script, but it did not work:

REGISTER ./piggybank.jar
DEFINE XPath org.apache.pig.piggybank.evaluation.xml.XPath();

A =  LOAD './books.xml' using org.apache.pig.piggybank.storage.XMLLoader('BOOK') as (x:chararray);

B = FOREACH A GENERATE XPath(x, 'BOOK/TITLE/@test'), XPath(x, 'BOOK/PRICE');
dump B;

The output was:

(,24.90)

Hope someone can help me. Thank.

Answer 1

There are 2 errors in the pigathBC XPath class:

• The ignoreNamespace logic interrupts the search for XML attributes https://issues.apache.org/jira/browse/PIG-4751

• The ignoreNamepace parameter defaults to true and cannot be overwritten https://issues.apache.org/jira/browse/PIG-4752

Here is my workaround using XPathAll:

XPathAll(x, 'BOOK/TITLE/@test', true, false).$0 as (test:chararray)

, :

XPathAll(x, '//*[local-name()=\'BOOK\']//*[local-name()=\'TITLE\']/@test', true, false).$0 as (test:chararray)