Sunday, November 10, 2013

Real time Scenario 7: MAX-CORE Value issue in Hash-Joins(Abinitio)

Real Scenario 7: (Abinitio)

Unable to subdivide hash-join input into partitions smaller than
max-core = 157286400 bytes.   This can be caused by a very large number
of records having the same key value.  Either increase max-core to
at least 157483759 or sort and use the merge-join component.


Solution:

This kind of errors we usually face in Sorter/Joiner components in Abinitio. when we use hash -Join Component we should declare Some max core value. lets say (150M) in this scenario.

if we recieve more numbe rof Records, then hash-Join component will not handle those many records with  a MAX-CORE value of 150M. so we have to Increase our Max-CORE value based on the number of records we are Processing.

so once we increased the MAX_CORE value then we are good to start the Abinitio Graph. it should be completed without any issues.

Thanks,
Anilkumar.

No comments:

Post a Comment