Hive Incremental load - This is the mini project which explains the incremental load in hive. There are three files -
- Hive_table_creation.hql
- Hive_inital_run.hql
- Hive_incremantal_run.hql
Brief explaination -
- Hive_table_creation.hql - This file creates the external hive table. There are 3 tables - Raw table, Stage table and target table.
- Hive_inital_run.hql - Initial run or history run, which will be first time load.
- Hive_incremantal_run.hql - Incremental run, which will have delta data for daily runs.