This tutorial is designed to provide troubleshooting for end users and developers who are building, deploying, and using CarbonData.
Symptom
Thrift throws following exception :
thrift: error while loading shared libraries: libthriftc.so.0: cannot open shared object file: No such file or directory
Possible Cause
The complete path to the directory containing the libraries is not configured correctly.
Procedure
Follow the Apache thrift docs at https://thrift.apache.org/docs/install to install thrift correctly.
Symptom
The shell prompts the following error :
org.apache.spark.sql.CarbonContext$$anon$$apache$spark$sql$catalyst$analysis $OverrideCatalog$_setter_$org$apache$spark$sql$catalyst$analysis $OverrideCatalog$$overrides_$e
Possible Cause
The Spark Version and the selected Spark Profile do not match.
Procedure
Ensure your spark version and selected profile for spark are correct.
Use the following command :
"mvn -Pspark-2.1 -Dspark.version {yourSparkVersion} clean package"
Note : Refrain from using “mvn clean package” without specifying the profile.
Symptom
Load query failed with the following exception:
Dictionary file is locked for updation.
Possible Cause
The carbon.properties file is not identical in all the nodes of the cluster.
Procedure
Follow the steps to ensure the carbon.properties file is consistent across all the nodes:
Copy the carbon.properties file from the master node to all the other nodes in the cluster. For example, you can use ssh to copy this file to all the nodes.
For the changes to take effect, restart the Spark cluster.
Symptom
Load query failed with the following exception:
Dictionary file is locked for updation.
Possible Cause
The carbon.properties file is not identical in all the nodes of the cluster.
Procedure
Follow the steps to ensure the carbon.properties file is consistent across all the nodes:
Copy the carbon.properties file from the master node to all the other nodes in the cluster. For example, you can use scp to copy this file to all the nodes.
For the changes to take effect, restart the Spark cluster.
Symptom
We get the following exception :
Cannot connect to hiveuser.
Possible Cause
The external process does not have permission to access.
Procedure
Ensure that the Hiveuser in mysql must allow its access to the external processes.
Symptom
We get the following exception on trying to connect :
Cannot read the metastore db
Possible Cause
The metastore db is dysfunctional.
Procedure
Remove the metastore db from the carbon.metastore in the Spark Directory.
Symptom
Data loading fails with the following exception :
Data Load failure exeception
Possible Cause
The following issue can cause the failure :
The core-site.xml, hive-site.xml, yarn-site and carbon.properties are not consistent across all nodes of the cluster.
Path to hdfs ddl is not configured correctly in the carbon.properties.
Procedure
Follow the steps to ensure the following configuration files are consistent across all the nodes:
Copy the core-site.xml, hive-site.xml, yarn-site,carbon.properties files from the master node to all the other nodes in the cluster. For example, you can use scp to copy this file to all the nodes.
Note : Set the path to hdfs ddl in carbon.properties in the master node.
For the changes to take effect, restart the Spark cluster.
Symptom
Insertion fails with the following exception :
Data Load failure exeception
Possible Cause
The following issue can cause the failure :
The core-site.xml, hive-site.xml, yarn-site and carbon.properties are not consistent across all nodes of the cluster.
Path to hdfs ddl is not configured correctly in the carbon.properties.
Procedure
Follow the steps to ensure the following configuration files are consistent across all the nodes:
Copy the core-site.xml, hive-site.xml, yarn-site,carbon.properties files from the master node to all the other nodes in the cluster. For example, you can use scp to copy this file to all the nodes.
Note : Set the path to hdfs ddl in carbon.properties in the master node.
For the changes to take effect, restart the Spark cluster.
Symptom
Execution fails with the following exception :
Table is locked for updation.
Possible Cause
Concurrency not supported.
Procedure
Worker must wait for the query execution to complete and the table to release the lock for another query execution to succeed.
Symptom
Execution fails with the following exception :
Table creation fails.
Possible Cause
Behaviour not supported.
Procedure
A single column that can be considered as dimension is mandatory for table creation.