Impala Query fails with NoSuchObjectException error

source In the last few months, I have seem CDH users hitting Impala query returning NoSuchObjectException error very often. This happens when running query against a particular table with INT partition types and it failed with below message:

enter WARNINGS: ImpalaRuntimeException: Error making 'alter_partitions' RPC to Hive Metastore: CAUSED BY: InvalidOperationException: Alter partition operation failed: NoSuchObjectException(message:partition values=[2017, 6, 1, 8]) We have confirmed that the table has four partitions with Integer data type, and select individual partition works.

cost of quality and dissertation

go to link The following scenario will trigger such error:

follow site

term papers on human trafficking To fix the issue, there are two options:

essay on gm foods
  1. Convert the data type of partition columns to String, instead of Integer: do my accounting assignment ALTER TABLE test_tbl PARTITION COLUMN (year string); ALTER TABLE test_tbl PARTITION COLUMN (month string); ALTER TABLE test_tbl PARTITION COLUMN (day string); ALTER TABLE test_tbl PARTITION COLUMN (hour string);

  2. if integer type need to be kept, then we will need to re-build the table into a new one and store them into locations without leading zeros. This can be done by running the following queries from Impala: CREATE TABLE new_test_tbl LIKE test_tbl; INSERT OVERWRITE TABLE new_test_tbl PARTITION (year, month, day, hour) as SELECT * FROM test_tbl;

    technical cv writing service The new table will have leading zeros in partitions removed and then we can switch over to use the new table. When writing more data into the new table through Hive, please be sure to remove all leading zeros to prevent the issue from happening again.

professional help with college admission essays for writing Above steps should help resolve the issue. Hope they will help. dissertation write up results

Leave a Reply

writing a good essay conclusion Your email address will not be published. Required fields are marked *

watch Creating Concept Paper For Dissertation

source site smarty assign var

source link