selectdb / ccr-syncer Goto Github PK

View Code? Open in Web Editor NEW

16.0 16.0 16.0 4.65 MB

License: Other

Makefile 0.81% Go 44.05% Shell 2.50% Thrift 37.54% Groovy 15.10%

ccr-syncer's People

Contributors

Stargazers

Watchers

Forkers

lcylgs itsharex deadlinefen lsy3993 xujianxu nextdreamblue qidaye butterbright lemonlitree neuyilan mychaow vinlee19 xueyuhai

ccr-syncer's Issues

"get snapshot failed" after "create ccr success"

source cluster version: doris-2.0.1-rc04
destination cluster version: doris-2.0.1-rc04
ccr-syncer commit id 69d5f24

i am trying to copy a table from cluster a to cluster b, so i want to use ccr-syncer to achieve that.

the curl request body is like:

curl -X POST -H "Content-Type: application/json" -d '{
    "name": "ccr_test",
    "src": {
    "host": "192.168.1.10",
    "port": "9030",
    "thrift_port": "9020",
    "user": "root",
    "password": "123456",
    "database": "testdb1",
    "table": "testtb1"
    },
    "dest": {
    "host": "192.168.2.10",
    "port": "9030",
    "thrift_port": "9020",
    "user": "root",
    "password": "123456",
    "database": "testdb2",
    "table": "testtb2"
    }
}' http://192.168.2.10:9190/create_ccr

after that, ccr return "create ccr success". this ccr process will not success because this error:

get snapshot failed, status: TStatus({StatusCode:SNAPSHOT_NOT_EXIST ErrorMsgs:[snapshot not exist]}) job=ccr_test line=ccr/job.go:319
[2023-09-20 07:53:18] DEBUG job:  job=ccr_test line=ccr/job.go:322

the full ccr log is:

start time: Wed Sep 20 07:52:49 AM UTC 2023
[2023-09-20 07:52:49]  INFO Server listening on :9190 line=service/http_service.go:275
[2023-09-20 07:52:50] DEBUG checker state: checkerStateRefresh line=ccr/checker.go:135
[2023-09-20 07:52:50] DEBUG checker state: checkerStateUpdate line=ccr/checker.go:135
[2023-09-20 07:52:50]  INFO update jobs [] line=ccr/checker.go:119
[2023-09-20 07:52:50] DEBUG checker state: checkerStateRefresh line=ccr/checker.go:135
[2023-09-20 07:52:50] DEBUG checker state: checkerStateFinish line=ccr/checker.go:135
[2023-09-20 07:52:55] DEBUG checker state: checkerStateRefresh line=ccr/checker.go:135
[2023-09-20 07:52:55] DEBUG checker state: checkerStateCheck line=ccr/checker.go:135
[2023-09-20 07:52:55] DEBUG checker state: checkerStateFinish line=ccr/checker.go:135
[2023-09-20 07:52:57]  INFO create ccr line=service/http_service.go:83
[2023-09-20 07:52:57]  INFO create ccr name: ccr_test, src: {{192.168.1.10 9030 9020} [] root 123456  testdb1 0 testtb1 0 []}, dest: {{192.168.2.10 9030 9020} [] root 123456  testdb2 0 testtb2 0 []} line=service/http_service.go:49
[2023-09-20 07:52:57]  INFO add job: ccr_test line=ccr/job_manager.go:43
[2023-09-20 07:52:57]  INFO first run check job{src 15 0 host: 192.168.1.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb1, database id: 0, table: testtb1, table id: 0 <nil>} {dest 15 0 host: 192.168.2.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb2, database id: 0, table: testtb2, table id: 0 <nil>} line=ccr/job.go:1298
[2023-09-20 07:52:57] DEBUG show proc '/backends' line=ccr/meta.go:449
[2023-09-20 07:52:57] DEBUG backend: Backend: {Id: 10002, Host: 192.168.1.11, HeartbeatPort: 9050, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} line=ccr/meta.go:494
[2023-09-20 07:52:57] DEBUG backend: Backend: {Id: 10003, Host: 192.168.1.12, HeartbeatPort: 9050, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} line=ccr/meta.go:494
[2023-09-20 07:52:57] DEBUG backend: Backend: {Id: 10004, Host: 192.168.1.13, HeartbeatPort: 9050, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} line=ccr/meta.go:494
[2023-09-20 07:52:57] DEBUG show proc '/backends' line=ccr/meta.go:449
[2023-09-20 07:52:57] DEBUG backend: Backend: {Id: 10019, Host: 127.0.0.1, HeartbeatPort: 9050, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} line=ccr/meta.go:494
[2023-09-20 07:52:57] DEBUG check database exist by spec{spec 15 0 host: 192.168.1.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb1, database id: 0, table: testtb1, table id: 0 <nil>} line=base/spec.go:383
[2023-09-20 07:52:57] DEBUG check table exists by spec{spec 15 0 host: 192.168.1.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb1, database id: 0, table: testtb1, table id: 0 <nil>} line=base/spec.go:417
[2023-09-20 07:52:57]  INFO check table testdb1.testtb1 enable binlog line=base/spec.go:231
[2023-09-20 07:52:57]  INFO table testdb1.testtb1 create string: CREATE TABLE `testtb1` (
  `id` int(11) NOT NULL,
  `col1` varchar(33) NOT NULL,
  `col2` varchar(60) NULL,
  `col3` varchar(60) NULL
) ENGINE=OLAP
UNIQUE KEY(`id`)
COMMENT 'test'
DISTRIBUTED BY HASH(`id`) BUCKETS 1
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"is_being_synced" = "false",
"storage_format" = "V2",
"light_schema_change" = "true",
"disable_auto_compaction" = "false",
"binlog.enable" = "true",
"binlog.ttl_seconds" = "864000",
"binlog.max_bytes" = "9223372036854775807",
"binlog.max_history_nums" = "9223372036854775807",
"enable_single_replica_compaction" = "false"
); line=base/spec.go:261
[2023-09-20 07:52:57]  INFO UpdateTable tableName: testtb1, tableId: 0 line=ccr/meta.go:107
[2023-09-20 07:52:57] DEBUG found table:testdb1.testtb1, tableId:44079 line=ccr/meta.go:152
[2023-09-20 07:52:57] DEBUG check database exist by spec{spec 15 0 host: 192.168.2.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb2, database id: 0, table: testtb2, table id: 0 <nil>} line=base/spec.go:383
[2023-09-20 07:52:57] DEBUG check table exists by spec{spec 15 0 host: 192.168.2.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb2, database id: 0, table: testtb2, table id: 0 <nil>} line=base/spec.go:417
[2023-09-20 07:52:57]  INFO new snapshot, commitSeq: 0 job=ccr_test line=ccr/job.go:1235
[2023-09-20 07:52:57] DEBUG update job progress: JobProgress{JobName: ccr_test, SyncState: TableFullSync, SubSyncState: BeginCreateSnapshot, CommitSeq: 0, TableCommitSeqMap: map[], InMemoryData: <nil>, PersistData: } job=ccr_test line=ccr/job_progress.go:285
[2023-09-20 07:52:57] DEBUG update job progress done: JobProgress{JobName: ccr_test, SyncState: TableFullSync, SubSyncState: BeginCreateSnapshot, CommitSeq: 0, TableCommitSeqMap: map[], InMemoryData: <nil>, PersistData: } job=ccr_test line=ccr/job_progress.go:308
[2023-09-20 07:53:00] DEBUG checker state: checkerStateRefresh line=ccr/checker.go:135
[2023-09-20 07:53:00] DEBUG checker state: checkerStateCheck line=ccr/checker.go:135
[2023-09-20 07:53:00] DEBUG checker state: checkerStateFinish line=ccr/checker.go:135
[2023-09-20 07:53:00] DEBUG table full sync job=ccr_test line=ccr/job.go:1158
[2023-09-20 07:53:00]  INFO fullsync status: create snapshot job=ccr_test line=ccr/job.go:277
[2023-09-20 07:53:00]  INFO create snapshot testdb1.ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:472
[2023-09-20 07:53:00] DEBUG backup snapshot sql: BACKUP SNAPSHOT testdb1.ccrs_testdb1_testtb1_1695196380 TO `__keep_on_local__` ON ( testtb1 ) PROPERTIES ("type" = "full") job=ccr_test line=base/spec.go:480
[2023-09-20 07:53:00] DEBUG check backup state{database 15 0 testdb1 <nil>} job=ccr_test line=base/spec.go:533
[2023-09-20 07:53:00] DEBUG check backup state of snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:500
[2023-09-20 07:53:00] DEBUG check backup state sql: SHOW BACKUP FROM testdb1 WHERE SnapshotName = "ccrs_testdb1_testtb1_1695196380" job=ccr_test line=base/spec.go:508
[2023-09-20 07:53:00]  INFO check snapshot ccrs_testdb1_testtb1_1695196380 backup state: [PENDING] job=ccr_test line=base/spec.go:526
[2023-09-20 07:53:03] DEBUG check backup state of snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:500
[2023-09-20 07:53:03] DEBUG check backup state sql: SHOW BACKUP FROM testdb1 WHERE SnapshotName = "ccrs_testdb1_testtb1_1695196380" job=ccr_test line=base/spec.go:508
[2023-09-20 07:53:03]  INFO check snapshot ccrs_testdb1_testtb1_1695196380 backup state: [SNAPSHOTING] job=ccr_test line=base/spec.go:526
[2023-09-20 07:53:05] DEBUG checker state: checkerStateRefresh line=ccr/checker.go:135
[2023-09-20 07:53:05] DEBUG checker state: checkerStateCheck line=ccr/checker.go:135
[2023-09-20 07:53:05] DEBUG checker state: checkerStateFinish line=ccr/checker.go:135
[2023-09-20 07:53:06] DEBUG check backup state of snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:500
[2023-09-20 07:53:06] DEBUG check backup state sql: SHOW BACKUP FROM testdb1 WHERE SnapshotName = "ccrs_testdb1_testtb1_1695196380" job=ccr_test line=base/spec.go:508
[2023-09-20 07:53:06]  INFO check snapshot ccrs_testdb1_testtb1_1695196380 backup state: [UPLOAD_SNAPSHOT] job=ccr_test line=base/spec.go:526
[2023-09-20 07:53:09] DEBUG check backup state of snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:500
[2023-09-20 07:53:09] DEBUG check backup state sql: SHOW BACKUP FROM testdb1 WHERE SnapshotName = "ccrs_testdb1_testtb1_1695196380" job=ccr_test line=base/spec.go:508
[2023-09-20 07:53:09]  INFO check snapshot ccrs_testdb1_testtb1_1695196380 backup state: [UPLOADING] job=ccr_test line=base/spec.go:526
[2023-09-20 07:53:10] DEBUG checker state: checkerStateRefresh line=ccr/checker.go:135
[2023-09-20 07:53:10] DEBUG checker state: checkerStateCheck line=ccr/checker.go:135
[2023-09-20 07:53:10] DEBUG checker state: checkerStateFinish line=ccr/checker.go:135
[2023-09-20 07:53:12] DEBUG check backup state of snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:500
[2023-09-20 07:53:12] DEBUG check backup state sql: SHOW BACKUP FROM testdb1 WHERE SnapshotName = "ccrs_testdb1_testtb1_1695196380" job=ccr_test line=base/spec.go:508
[2023-09-20 07:53:12]  INFO check snapshot ccrs_testdb1_testtb1_1695196380 backup state: [SAVE_META] job=ccr_test line=base/spec.go:526
[2023-09-20 07:53:15] DEBUG checker state: checkerStateRefresh line=ccr/checker.go:135
[2023-09-20 07:53:15] DEBUG checker state: checkerStateCheck line=ccr/checker.go:135
[2023-09-20 07:53:15] DEBUG checker state: checkerStateFinish line=ccr/checker.go:135
[2023-09-20 07:53:15] DEBUG check backup state of snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:500
[2023-09-20 07:53:15] DEBUG check backup state sql: SHOW BACKUP FROM testdb1 WHERE SnapshotName = "ccrs_testdb1_testtb1_1695196380" job=ccr_test line=base/spec.go:508
[2023-09-20 07:53:15]  INFO check snapshot ccrs_testdb1_testtb1_1695196380 backup state: [UPLOAD_INFO] job=ccr_test line=base/spec.go:526
[2023-09-20 07:53:18] DEBUG check backup state of snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=base/spec.go:500
[2023-09-20 07:53:18] DEBUG check backup state sql: SHOW BACKUP FROM testdb1 WHERE SnapshotName = "ccrs_testdb1_testtb1_1695196380" job=ccr_test line=base/spec.go:508
[2023-09-20 07:53:18]  INFO check snapshot ccrs_testdb1_testtb1_1695196380 backup state: [FINISHED] job=ccr_test line=base/spec.go:526
[2023-09-20 07:53:18] DEBUG update job progress: JobProgress{JobName: ccr_test, SyncState: TableFullSync, SubSyncState: GetSnapshotInfo, CommitSeq: 0, TableCommitSeqMap: map[], InMemoryData: <nil>, PersistData: ccrs_testdb1_testtb1_1695196380} job=ccr_test line=ccr/job_progress.go:285
[2023-09-20 07:53:18] DEBUG update job progress done: JobProgress{JobName: ccr_test, SyncState: TableFullSync, SubSyncState: GetSnapshotInfo, CommitSeq: 0, TableCommitSeqMap: map[], InMemoryData: <nil>, PersistData: ccrs_testdb1_testtb1_1695196380} job=ccr_test line=ccr/job_progress.go:308
[2023-09-20 07:53:18]  INFO fullsync status: get snapshot info job=ccr_test line=ccr/job.go:303
[2023-09-20 07:53:18] DEBUG begin get snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=ccr/job.go:312
[2023-09-20 07:53:18] DEBUG GetSnapshot ccrs_testdb1_testtb1_1695196380, spec: host: 192.168.1.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb1, database id: 44077, table: testtb1, table id: 44079 job=ccr_test line=rpc/fe.go:213
[2023-09-20 07:53:18] DEBUG GetSnapshotRequest user root, db testdb1, table testtb1, label name ccrs_testdb1_testtb1_1695196380, snapshot name , snapshot type 1 job=ccr_test line=rpc/fe.go:226
[2023-09-20 07:53:18] ERROR get snapshot failed, status: TStatus({StatusCode:SNAPSHOT_NOT_EXIST ErrorMsgs:[snapshot not exist]}) job=ccr_test line=ccr/job.go:319
[2023-09-20 07:53:18] DEBUG job:  job=ccr_test line=ccr/job.go:322
[2023-09-20 07:53:18] ERROR job sync failed, job: ccr_test, err: jobInfo is not set
github.com/selectdb/ccr_syncer/ccr.(*Job).fullSync
        /root/ccr-syncer/ccr/job.go:324
github.com/selectdb/ccr_syncer/ccr.(*Job).fullSync
        /root/ccr-syncer/ccr/job.go:473
github.com/selectdb/ccr_syncer/ccr.(*Job).tableSync
        /root/ccr-syncer/ccr/job.go:1159
github.com/selectdb/ccr_syncer/ccr.(*Job).sync
        /root/ccr-syncer/ccr/job.go:1208
github.com/selectdb/ccr_syncer/ccr.(*Job).run
        /root/ccr-syncer/ccr/job.go:1227
github.com/selectdb/ccr_syncer/ccr.(*Job).Run
        /root/ccr-syncer/ccr/job.go:1289
github.com/selectdb/ccr_syncer/ccr.(*JobManager).runJob.func1
        /root/ccr-syncer/ccr/job_manager.go:155
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1598 job=ccr_test line=ccr/job.go:1228
[2023-09-20 07:53:18] DEBUG table full sync job=ccr_test line=ccr/job.go:1158
[2023-09-20 07:53:18]  INFO fullsync status: get snapshot info job=ccr_test line=ccr/job.go:303
[2023-09-20 07:53:18] DEBUG begin get snapshot ccrs_testdb1_testtb1_1695196380 job=ccr_test line=ccr/job.go:312
[2023-09-20 07:53:18] DEBUG GetSnapshot ccrs_testdb1_testtb1_1695196380, spec: host: 192.168.1.10, port: 9030, thrift_port: 9020, user: root, cluster: , database: testdb1, database id: 44077, table: testtb1, table id: 44079 job=ccr_test line=rpc/fe.go:213
[2023-09-20 07:53:18] DEBUG GetSnapshotRequest user root, db testdb1, table testtb1, label name ccrs_testdb1_testtb1_1695196380, snapshot name , snapshot type 1 job=ccr_test line=rpc/fe.go:226
[2023-09-20 07:53:18] ERROR get snapshot failed, status: TStatus({StatusCode:SNAPSHOT_NOT_EXIST ErrorMsgs:[snapshot not exist]}) job=ccr_test line=ccr/job.go:319
[2023-09-20 07:53:18] DEBUG job:  job=ccr_test line=ccr/job.go:322
[2023-09-20 07:53:18] ERROR job sync failed, job: ccr_test, err: jobInfo is not set
github.com/selectdb/ccr_syncer/ccr.(*Job).fullSync
        /root/ccr-syncer/ccr/job.go:324
github.com/selectdb/ccr_syncer/ccr.(*Job).tableSync
        /root/ccr-syncer/ccr/job.go:1159
github.com/selectdb/ccr_syncer/ccr.(*Job).sync
        /root/ccr-syncer/ccr/job.go:1208
github.com/selectdb/ccr_syncer/ccr.(*Job).run
        /root/ccr-syncer/ccr/job.go:1227
github.com/selectdb/ccr_syncer/ccr.(*Job).Run
        /root/ccr-syncer/ccr/job.go:1289
github.com/selectdb/ccr_syncer/ccr.(*JobManager).runJob.func1
        /root/ccr-syncer/ccr/job_manager.go:155
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1598 job=ccr_test line=ccr/job.go:1228

TRUNCATE TABLE can not sync to the destination

CCR version：build base on the latest code
Doris version：build base on the latest code

full tale sync and increasing data sync is working correct

but when the source table has been TRUNCATE use : TRUNCATE TABLE source_table
the TRUNCATE TABLE action can not sync to the destination

bellow is the log：

[2023-09-20 18:19:33] DEBUG db incremental sync job=ccr_test line=ccr/job.go:1191
[2023-09-20 18:19:33] DEBUG start incremental sync job=ccr_test line=ccr/job.go:1090
[2023-09-20 18:19:33] DEBUG src: host: 10.XXX.XXX.XX, port: 9030, thrift_port: 9020, user: root, cluster: , database: ccr_test, database id: 16863, table: , table id: 0, commitSeq: 6688 job=ccr_test line=ccr/job.go:1101
[2023-09-20 18:19:33] DEBUG GetBinlog, spec: host: 10.XXX.XXX.XX, port: 9030, thrift_port: 9020, user: root, cluster: , database: sci_mid, database id: 16863, table: , table id: 0, commit seq: 6688 job=ccr_test line=rpc/fe.go:151
[2023-09-20 18:19:33] DEBUG GetBinlog user root, db ccr_test, tableId 0, prev seq: 6688 job=ccr_test line=rpc/fe.go:166
[2023-09-20 18:19:33] DEBUG resp: TGetBinlogResult_({Status:TStatus({StatusCode:BINLOG_TOO_NEW_COMMIT_SEQ ErrorMsgs:[]}) NextCommitSeq: Binlogs:[] FeVersion: FeMetaVersion:}) job=ccr_test line=ccr/job.go:1107

ERROR need rollback, err: normal: partitionId: 20050 not found

Search before asking

I had searched in the issues and found no similar issues.

Version

CCR: 3cb46f9
Doris:apache/doris@be11b48

What's Wrong?

job error and stop sync data

error message：ERROR need rollback, err: normal: partitionId: 20050 not found
github.com/selectdb/ccr_syncer/xerror.Errorf
/root/ccr-syncer/xerror/xerror.go:123
github.com/selectdb/ccr_syncer/ccr.(*Meta).UpdateIndexes
/root/ccr-syncer/ccr/meta.go:580
github.com/selectdb/ccr_syncer/ccr.(*Meta).getIndexes
/root/ccr-syncer/ccr/meta.go:654
github.com/selectdb/ccr_syncer/ccr.(*Meta).GetIndexIdMap
/root/ccr-syncer/ccr/meta.go:665
github.com/selectdb/ccr_syncer/ccr.(*IngestBinlogJob).preparePartition
/root/ccr-syncer/ccr/ingest_binlog_job.go:355
github.com/selectdb/ccr_syncer/ccr.(*IngestBinlogJob).prepareTable
/root/ccr-syncer/ccr/ingest_binlog_job.go:467
github.com/selectdb/ccr_syncer/ccr.(*IngestBinlogJob).prepareTabletIngestJobs
/root/ccr-syncer/ccr/ingest_binlog_job.go:495
github.com/selectdb/ccr_syncer/ccr.(*IngestBinlogJob).Run
/root/ccr-syncer/ccr/ingest_binlog_job.go:522
github.com/selectdb/ccr_syncer/ccr.(*Job).ingestBinlog
/root/ccr-syncer/ccr/job.go:593
github.com/selectdb/ccr_syncer/ccr.(*Job).handleUpsert
/root/ccr-syncer/ccr/job.go:718
github.com/selectdb/ccr_syncer/ccr.(*Job).handleUpsert
/root/ccr-syncer/ccr/job.go:807
github.com/selectdb/ccr_syncer/ccr.(*Job).handleUpsert
/root/ccr-syncer/ccr/job.go:807
github.com/selectdb/ccr_syncer/ccr.(*Job).handleBinlog
/root/ccr-syncer/ccr/job.go:1078
github.com/selectdb/ccr_syncer/ccr.(*Job).handleBinlogs
/root/ccr-syncer/ccr/job.go:1030
github.com/selectdb/ccr_syncer/ccr.(*Job).incrementalSync
/root/ccr-syncer/ccr/job.go:1170
github.com/selectdb/ccr_syncer/ccr.(*Job).dbSync
/root/ccr-syncer/ccr/job.go:1229
github.com/selectdb/ccr_syncer/ccr.(*Job).sync
/root/ccr-syncer/ccr/job.go:1243
github.com/selectdb/ccr_syncer/ccr.(*Job).run
/root/ccr-syncer/ccr/job.go:1292
github.com/selectdb/ccr_syncer/ccr.(*Job).Run
/root/ccr-syncer/ccr/job.go:1358
github.com/selectdb/ccr_syncer/ccr.(*JobManager).runJob.func1
/root/ccr-syncer/ccr/job_manager.go:156
runtime.goexit
/usr/lib/golang/src/runtime/asm_amd64.s:1594

How to Reproduce?

step 1: TRUNCATE TABLE
step 2: DELETE from table WHERE where_cond
stetp 3: insert into table

Anything Else?

i check the ccr log，and found step 1 and step 2 are correct sync.
logs:
[2023-10-13 09:42:18] INFO handle truncate table binlog job=ccr_test
[2023-10-13 09:42:18] INFO truncateTableSql: TRUNCATE TABLE z_mid_po_gr_ekbe job=ccr_test
[2023-10-13 09:42:18] INFO table z_mid_po_gr_ekbe not found, skip clear job=ccr_test
[2023-10-13 09:42:18] INFO table z_mid_po_gr_ekbe not found, skip clear job=ccr_test
[2023-10-13 09:43:00] INFO handle upsert binlog, sub sync state: Done job=ccr_test
[2023-10-13 09:43:00] INFO handle upsert binlog, sub sync state: BeginTransaction job=ccr_test
[2023-10-13 09:43:00] INFO handle upsert binlog, sub sync state: IngestBinlog job=ccr_test
[2023-10-13 09:43:00] INFO ingestBinlog, txnId: 3008 job=ccr_test
[2023-10-13 09:43:00] INFO handle upsert binlog, sub sync state: CommitTransaction job=ccr_test
[2023-10-13 09:43:00] INFO commit TxnId: 3008 resp: TCommitTxnResult_({Status:TStatus({StatusCode:OK ErrorMsgs:[]})}) job=ccr_test

ERROR wait transaction done failed, err +normal: transaction 1991 status: COMMITTED

ccr version :ef1efb5
Doris version:apache/doris@18b5f70
commit 18b5f70a7c0ee565df5208182d80b7a8d6d6ece9
Author: Pxl [email protected]
Date: Wed Sep 27 11:30:36 2023 +0800

error information：
source cluster transaction had done a long time，but ccr-syncer still get：ERROR wait transaction done failed, err +normal: transaction 1991 status: COMMITTED.

@JackDrogon
thanks a lot

整库做同步时，表名如果和关键词一致，会出大量报错

[2024-01-30 15:04:51] INFO fullsync status: create snapshot job=ccr_test2 line=ccr/job.go:282
[2024-01-30 15:04:51] INFO create snapshot tpcds.ccrs_tpcds_1706598291 job=ccr_test2 line=base/spec.go:448
[2024-01-30 15:04:51] WARN job sync failed, job: ccr_test2, err: [normal] Error 1105 (HY000): errCode = 2, detailMessage = Syntax error in line 1:
...talog_sales, store_sales, roles, warehouse, customer_a...
^
Encountered: ROLES
Expected: ROLES is keyword, maybe ROLES

backup snapshot ccrs_tpcds_1706598291 failed, sql: BACKUP SNAPSHOT tpcds.ccrs_tpcds_1706598291 TO __keep_on_local__ ON ( store_returns, catalog_sales_bak, call_center, inventory, promotion, web_page, store_returns_bak, web_returns_bak, web_sales, catalog_returns, catalog_sales, store_sales, roles, warehouse, customer_address, store_sales_bak, customer, test1, store_bak, reason, catalog_returns_bak, item, time_dim, web_returns, date_dim, income_band, catalog_page, store, dbgen_version, household_demographics, ship_mode, customer_demographics, web_site, web_sales_bak ) PROPERTIES ("type" = "full")
github.com/selectdb/ccr_syncer/pkg/ccr/base.(*Spec).CreateSnapshotAndWaitForDone
/home/doris/workspace/gopath/ccr-syncer/pkg/ccr/base/spec.go:459
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/home/doris/workspace/gopath/ccr-syncer/pkg/ccr/job.go:299
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).dbSync
/home/doris/workspace/gopath/ccr-syncer/pkg/ccr/job.go:1266
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).sync
/home/doris/workspace/gopath/ccr-syncer/pkg/ccr/job.go:1287
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).run
/home/doris/workspace/gopath/ccr-syncer/pkg/ccr/job.go:1339
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).Run
/home/doris/workspace/gopath/ccr-syncer/pkg/ccr/job.go:1405
github.com/selectdb/ccr_syncer/pkg/ccr.(*JobManager).runJob.func1
/home/doris/workspace/gopath/ccr-syncer/pkg/ccr/job_manager.go:160

sql: expected 23 destination arguments in Scan, not 24

source cluster version: doris-2.0.0-rc04
destination cluster version: doris-2.0.0-rc04

all source fe/be and destination fe/be using "enable_feature_binlog = true"
the source fe table "testtb" set "binlog.enable" = "true" and the destination "testtb2" table set the same property.
my curl request body is like

curl -X POST -H "Content-Type: application/json" -d '{
    "name": "ccr_test",
    "src": {
    "host": "192.168.1.10",
    "port": "9030",
    "thrift_port": "9020",
    "user": "root",
    "password": "123456",
    "database": "testdb",
    "table": "testtb"
    },
    "dest": {
    "host": "192.168.2.10",
    "port": "9030",
    "thrift_port": "9020",
    "user": "root",
    "password": "123456",
    "database": "testdb2",
    "table": "testtb2"
    }
}' http://192.168.2.10:9190/create_ccr

this script will return "show proc '/backends': sql: expected 23 destination arguments in Scan, not 24". what is wrong

sync auto stop without finish sync all binlog

sync auto stop without finish sync all binlog
binlog should have more then 50000,but after sync 50000 records to destination, sync stop.
check job_status by using http://127.0.0.1:9190/job_status: {"name":"ccr_test","state":"running","progress_state":"DBIncrementalSync"}
and check log is :job progress is not done, state is (RollbackTransaction), need recover job=ccr_test

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.