Kylin binary package contains a sample dataset for testing. It consists of five tables, including the fact table which has 10,000 rows. Because of the small data size, it is convenient to carry out as a test in the virtual machine. You can import the Kylin built-in sample data into Hive using executable script.
The script is sample.sh. you can find it under $KYLIN_HOME/bin.
$KYLIN_HOME/bin/sample.sh
Once the script is complete, execute the following commands to enter Hive. Then you can confirm whether the tables are imported successfully.
hive
By default, the script imports 5 tables into Hive's default database. You can check the tables imported into Hive or query some tables:
hive> use default; hive> show tables; hive> select count(*) from kylin_sales;
Tip: If you need to import the table to the specified database in Hive, you can modify the configuration item
kylin.source.hive.database-for-flat-tablein the Kylin configuration file$KYLIN_HOME/conf/kylin.propertiesto the specified Hive database.
Kylin supports both star schema and snowflake data model. In this manual, we will use a typical snowflake data model as our sample data set which contains five tables:
The five tables together constitute the structure of the entire snowflake data model. Below is a relational diagram of them.
The generated hive tables contains too many columns which may confused you. So the following tables will list some key columns which referred in Kylin's Model/Cube, and describe the underlying business meaning of them.
| Table | Field | Description |
|---|---|---|
| KYLIN_SALES | TRANS_ID | Order ID |
| KYLIN_SALES | PART_DT | Order Date |
| KYLIN_SALES | LEAF_CATEG_ID | ID Of Commodity Category |
| KYLIN_SALES | LSTG_SITE_ID | Site ID |
| KYLIN_SALES | SELLER_ID | Account ID Of Seller |
| KYLIN_SALES | BUYER_ID | Account ID Of Buyer |
| KYLIN_SALES | PRICE | Order Amount |
| KYLIN_SALES | ITEM_COUNT | The Number Of Purchased Goods |
| KYLIN_SALES | LSTG_FORMAT_NAME | Order Transaction Type |
| KYLIN_SALES | OPS_USER_ID | System User ID |
| KYLIN_SALES | OPS_REGION | System User Region |
| KYLIN_CATEGORY_GROUPINGS | USER_DEFINED_FIELD1 | User Defined Fields 1 |
| KYLIN_CATEGORY_GROUPINGS | USER_DEFINED_FIELD3 | User Defined Fields 3 |
| KYLIN_CATEGORY_GROUPINGS | UPD_DATE | Update Date |
| KYLIN_CATEGORY_GROUPINGS | UPD_USER | Update User |
| KYLIN_CATEGORY_GROUPINGS | META_CATEG_NAME | Level 1 Category |
| KYLIN_CATEGORY_GROUPINGS | CATEG_LVL2_NAME | Level 2 Category |
| KYLIN_CATEGORY_GROUPINGS | CATEG_LVL3_NAME | Level 3 Category |
| KYLIN_CAL_DT | CAL_DT | Date |
| KYLIN_CAL_DT | WEEK_BEG_DT | Week Beginning Date |
| KYLIN_CAL_DT | MONTH_BEG_DT | Month Beginning Date |
| KYLIN_CAL_DT | YEAR_BEG_DT | Year Beginning Date |
| KYLIN_ACCOUNT | ACCOUNT_ID | ID Number Of Account |
| KYLIN_ACCOUNT | ACCOUNT_COUNTRY | Country ID Where Account Resides |
| KYLIN_ACCOUNT | ACCOUNT_BUYER_LEVEL | Buyer Account Level |
| KYLIN_ACCOUNT | ACCOUNT_SELLER_LEVEL | Seller Account Level |
| KYLIN_ACCOUNT | ACCOUNT_CONTACT | Contact of Account |
| KYLIN_COUNTRY | COUNTRY | Country ID |
| KYLIN_COUNTRY | NAME | Descriptive Name Of Country |