When you run the Pig script, some of these logs are emitted:
2014-10-29 16:07:03,658 [MainThread] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: TRACKED[155,10],null[-1,-1],null[-1,-1],TRACKED_USERS[156,16],null[-1,-1],HAS_CONV[163,11],HAS_CONV[164,11],null[-1,-1],REACHED[159,10],REACHED[160,10] C: R:
I understand that all my aliases listed after the sections M:are map-based locations, C:must be combinators, and R:must be reducers.
How to interpret the values between brackets, such as 159and 10in: REACHED[159,10]? Do they provide me with a hint about processed input splits?
source
share