Hive MetaStore migration from Embedded Postgres to MySQL

Recently I was dealing with a case where customer wanted to migrate from Cloudera Manager’s Embedded PostgreSQL to MySQL due to the fact that the Embedded PostgreSQL provided by Cloudera Manager is not recommended for production use, instead, using external databases like MySQL, PostgreSQL or Oracle etc is highly recommended. …

Sqoop1 Import Job Failed With Error “java.io.IOException: No columns to generate for ClassWriter”

Recently when I was testing Sqoop1 command in my CDH cluster, I kept getting “java.io.IOException: No columns to generate for ClassWriter” error. The full command was like below: sqoop import –connect jdbc:mysql://<mysql-host>/test –table test –username <username> –password <password> –target-dir sqoop_test -m 1 And full stacktrace: 16/08/20 03:03:13 ERROR manager.SqlManager: Error …

Hive Metastore Upgrade Failed with Error: Specified key was too long; max key length is 1000 bytes

Sympton: After upgrading Cloudera Manager (CM) from CDH5.3 to CDH5.4, the requirement was to also upgrade the Hive Metastore Database Schema: However, it failed with the following message: It is not immediately apparent what needs to be done. Initially you might think that some of the indexes contained too many …