Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

it does not support merge into ,please modify the document. #4181

Open
study-day opened this issue Jul 23, 2021 · 1 comment
Open

it does not support merge into ,please modify the document. #4181

study-day opened this issue Jul 23, 2021 · 1 comment

Comments

@study-day
Copy link

https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+CarbonData+2.1.1+Release
it does not support merge into ,please modify the document.

hive --version  Hive 1.2.1000.2.6.5.0-292
[hdfs@hadoop-node-1 spark-2.3.4-bin-hadoop2.7]$ bin/beeline
Beeline version 1.2.1.spark2 by Apache Hive
beeline> !connect jdbc:hive2://hadoop-node-1:10000
Connecting to jdbc:hive2://hadoop-node-1:10000
Enter username for jdbc:hive2://hadoop-node-1:10000: abcdsesss
Enter password for jdbc:hive2://hadoop-node-1:10000: **********
Connected to: Spark SQL (version 2.3.4)
Driver: Hive JDBC (version 1.2.1.spark2)
Transaction isolation: TRANSACTION_REPEATABLE_READ

0: jdbc:hive2://hadoop-node-1:10000> merge into test_table t using ( select t1.name name,t1.id age, t1.age id, t1.city city from test_table t1 )s on (t.id=s.id) when matched then update set t.age=s.age  ;
Error: org.apache.carbondata.common.exceptions.sql.MalformedCarbonCommandException: Parse failed! (state=,code=0)
0: jdbc:hive2://hadoop-node-1:10000>

finally,MERGE is available starting in Hive 2.2. and carbondata table is the table that support ACID ?

Merge
Version Information

MERGE is available starting in Hive 2.2.

Merge can only be performed on tables that support ACID. See Hive Transactions for details.
@maheshrajus
Copy link
Contributor

maheshrajus commented Oct 11, 2021

Hi,

Merge into support is added as part of below PR(1).
Please check the below guide(2) about merge into operations.
You can refer below test cases(3).
Carbondata supports ACID. you can refer(4) for more details.

1 #4032
2 https://github.com/apache/carbondata/blob/master/docs/scd-and-cdc-guide.md
3 https://github.com/apache/carbondata/blob/master/integration/spark/src/test/scala/org/apache/carbondata/spark/testsuite/iud/MergeIntoCarbonTableTestCase.scala
4 https://brijoobopanna.medium.com/making-apache-spark-better-with-carbondata-d37f98d235de

Thanks & Regards
-Mahesh Raju S (githubid: maheshrajus)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants