Tag: Sqoop

Recently I have found an issue in Sqoop that when exporting data to Teradata with data value larger than 64KB to CLOB data type, job will be failed with error similar to below: After contacting with Teradata Support, it turned out to be a limitation/restriction from Teradata side, that for …

If your Sqoop job fails with below error message: This is very likely caused by conflicting JAR files being loaded by sqoop, and mostly related to JAR files under /usr/lib/hive directory, which is normally created by package installation of Sqoop, rather than via Parcels through Cloudera Manager. The solution is …

In the last few weeks, I have been working on an issue in Sqoop that Sqoop’s “–append” options does not work well with parameter “-Dmapreduce.output.basename”. The goal of adding “-Dmapreduce.output.basename” is to ask Sqoop to generate custom file names for the target file in HDFS, rather than using the default …

I have got a lot complains from Cloudera customers that after Sqoop job finishes, the table class Jar files were not cleaned up. By default, they are saved under /tmp/sqoop-{username}/compile, to be used by current running jobs. They are not needed anymore after job finishes, so they should be cleaned …

In the last few weeks, I was dealing with an issue that when importing data from DB2 into HDFS, it kept failing with NoClassDefFoundError. Below was the command details: And the error message was: By looking at the error message, it was highly suspicious that the class name ZZZ001$_part_table$1 looked …