tree 1dc8cb46f3e4183cbd24ffea099530ab2b1786e2
parent 5b8ac8478847ef6962f39362f8e16f30a9cb6a03
author ajantha-bhat <ajanthabhat@gmail.com> 1577523246 +0800
committer Jacky Li <jacky.likun@qq.com> 1578206744 +0800

[CARBONDATA-3639][CARBONDATA-3638] Fix global sort exception in load from CSV flow with binary non-sort columns

Problem:
Global sort throws exception in load from CSV flow with binary non-sort columns.
Exception is attached in JIRA and test case is added in PR.

Cause: For global sort flow, we make csvRDD from file. But again this String RDD is converted to new string scala objects, here binary was exceeding 32000 length. Hence the exception

Solution: For CSV load flow, avoid this new String object conversion as it is already string object.
This can also handle [CARBONDATA-3638]

This closes #3540