Skip to content

Backup changefeed configurations (tools dump) #12283

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 25 commits into from
Dec 12, 2024
Merged

Backup changefeed configurations (tools dump) #12283

merged 25 commits into from
Dec 12, 2024

Conversation

@stanislav-shchetinin
Copy link
Collaborator

@stanislav-shchetinin stanislav-shchetinin commented Dec 4, 2024 •
edited
Loading

Changelog entry

Added a backup of changefeeds when calling the tools dump command in the ydb cli

Changelog category

  • New feature

Additional information

Additionally, a SerializeTo method was implemented in the TChangefeedDescription class for Ydb::Table::ChangefeedDescription in the Table client of the YDB CPP SDK
@github-actions
Copy link

github-actions bot commented Dec 4, 2024 •
edited
Loading

⚪ 2024-12-04 12:42:50 UTC Pre-commit check linux-x86_64-release-asan for 23f7ba6 has started.
⚪ 2024-12-04 12:43:01 UTC Artifacts will be uploaded here
⚪ 2024-12-04 12:45:27 UTC ya make is running...
🔴 2024-12-04 12:47:42 UTC Build failed, see the logs. Also see fail summary
@github-actions
Copy link

github-actions bot commented Dec 4, 2024 •
edited
Loading

⚪ 2024-12-04 12:43:00 UTC Pre-commit check linux-x86_64-relwithdebinfo for 23f7ba6 has started.
⚪ 2024-12-04 12:43:11 UTC Artifacts will be uploaded here
⚪ 2024-12-04 12:45:37 UTC ya make is running...
🔴 2024-12-04 12:47:39 UTC Build failed, see the logs. Also see fail summary
@stanislav-shchetinin stanislav-shchetinin linked an issue Dec 4, 2024 that may be closed by this pull request
Backup/restore changefeeds #7054
Closed
4 tasks
Stanislav Shchetinin and others added 3 commits December 4, 2024 17:06
@github-actions
Copy link

github-actions bot commented Dec 6, 2024 •
edited
Loading

⚪ 2024-12-06 16:14:10 UTC Pre-commit check linux-x86_64-release-asan for 6b3cae5 has started.
⚪ 2024-12-06 16:14:41 UTC Artifacts will be uploaded here
⚪ 2024-12-06 16:17:51 UTC ya make is running...
🟡 2024-12-06 17:32:10 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15391 15325 0 19 4 43

🟢 2024-12-06 17:33:25 UTC Build successful.
🟢 2024-12-06 17:33:53 UTC ydbd size 4.9 GiB changed* by +7.3 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 7a2b05c merge: 6b3cae5 diff diff %
ydbd size 5 305 568 024 Bytes 5 305 575 480 Bytes +7.3 KiB +0.000%
ydbd stripped size 1 365 574 032 Bytes 1 365 575 376 Bytes +1.3 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
@github-actions
Copy link

github-actions bot commented Dec 6, 2024 •
edited
Loading

⚪ 2024-12-06 16:15:08 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6b3cae5 has started.
⚪ 2024-12-06 16:15:20 UTC Artifacts will be uploaded here
⚪ 2024-12-06 16:18:21 UTC ya make is running...
🟡 2024-12-06 17:22:34 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32818 29983 0 2 2720 113

⚪ 2024-12-06 17:25:20 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-06 17:37:28 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
701 (only retried tests) 592 0 0 0 109

🟢 2024-12-06 17:37:37 UTC Build successful.
🟢 2024-12-06 17:37:55 UTC ydbd size 2.5 GiB changed* by +2.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 7a2b05c merge: 6b3cae5 diff diff %
ydbd size 2 699 201 672 Bytes 2 699 204 648 Bytes +2.9 KiB +0.000%
ydbd stripped size 483 500 464 Bytes 483 500 464 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
@github-actions
Copy link

github-actions bot commented Dec 7, 2024 •
edited
Loading

⚪ 2024-12-07 13:16:51 UTC Pre-commit check linux-x86_64-release-asan for d242d53 has started.
⚪ 2024-12-07 13:17:02 UTC Artifacts will be uploaded here
⚪ 2024-12-07 13:20:03 UTC ya make is running...
⚫ 2024-12-07 13:32:46 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 7, 2024 •
edited
Loading

⚪ 2024-12-07 13:19:14 UTC Pre-commit check linux-x86_64-relwithdebinfo for d242d53 has started.
⚪ 2024-12-07 13:19:25 UTC Artifacts will be uploaded here
⚪ 2024-12-07 13:22:25 UTC ya make is running...
⚫ 2024-12-07 13:32:44 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 7, 2024 •
edited
Loading

⚪ 2024-12-07 13:34:08 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8d221d6 has started.
⚪ 2024-12-07 13:34:28 UTC Artifacts will be uploaded here
⚪ 2024-12-07 13:37:37 UTC ya make is running...
🟡 2024-12-07 14:34:31 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32830 29999 0 1 2720 110

⚪ 2024-12-07 14:37:12 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-12-07 14:49:26 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
645 (only retried tests) 538 0 1 0 106

⚪ 2024-12-07 14:49:36 UTC ya make is running... (failed tests rerun, try 3)
🟢 2024-12-07 15:01:34 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
633 (only retried tests) 526 0 0 0 107

🟢 2024-12-07 15:01:42 UTC Build successful.
🟢 2024-12-07 15:02:02 UTC ydbd size 2.5 GiB changed* by +3.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 751da8a merge: 8d221d6 diff diff %
ydbd size 2 699 385 352 Bytes 2 699 388 424 Bytes +3.0 KiB +0.000%
ydbd stripped size 483 518 032 Bytes 483 518 032 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
@github-actions
Copy link

github-actions bot commented Dec 7, 2024 •
edited
Loading

⚪ 2024-12-07 13:36:49 UTC Pre-commit check linux-x86_64-release-asan for 8d221d6 has started.
⚪ 2024-12-07 13:37:00 UTC Artifacts will be uploaded here
⚪ 2024-12-07 13:40:01 UTC ya make is running...
🟡 2024-12-07 14:48:03 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15403 15341 0 13 4 45

🟢 2024-12-07 14:49:24 UTC Build successful.
🟢 2024-12-07 14:49:52 UTC ydbd size 4.9 GiB changed* by +7.6 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 751da8a merge: 8d221d6 diff diff %
ydbd size 5 305 899 064 Bytes 5 305 906 832 Bytes +7.6 KiB +0.000%
ydbd stripped size 1 365 606 032 Bytes 1 365 607 440 Bytes +1.4 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
CyberROFL
CyberROFL reviewed Dec 9, 2024
View reviewed changes
@github-actions
Copy link

github-actions bot commented Dec 9, 2024 •
edited
Loading

⚪ 2024-12-09 11:20:54 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6b1f6a8 has started.
⚪ 2024-12-09 11:21:05 UTC Artifacts will be uploaded here
⚪ 2024-12-09 11:24:04 UTC ya make is running...
🟡 2024-12-09 12:31:30 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32830 29985 0 2 2731 112

⚪ 2024-12-09 12:34:31 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-12-09 12:46:07 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
659 (only retried tests) 550 0 1 1 107

⚪ 2024-12-09 12:46:21 UTC ya make is running... (failed tests rerun, try 3)
🟢 2024-12-09 12:58:37 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
643 (only retried tests) 537 0 0 0 106

🟢 2024-12-09 12:58:46 UTC Build successful.
🟢 2024-12-09 12:59:08 UTC ydbd size 2.5 GiB changed* by +3.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 0a7a679 merge: 6b1f6a8 diff diff %
ydbd size 2 699 396 888 Bytes 2 699 399 944 Bytes +3.0 KiB +0.000%
ydbd stripped size 483 497 424 Bytes 483 497 424 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
@github-actions
Copy link

github-actions bot commented Dec 9, 2024 •
edited
Loading

⚪ 2024-12-09 11:21:25 UTC Pre-commit check linux-x86_64-release-asan for 6b1f6a8 has started.
⚪ 2024-12-09 11:21:36 UTC Artifacts will be uploaded here
⚪ 2024-12-09 11:24:44 UTC ya make is running...
🟡 2024-12-09 12:43:08 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15403 15329 0 18 11 45

🟢 2024-12-09 12:44:23 UTC Build successful.
🟢 2024-12-09 12:44:52 UTC ydbd size 4.9 GiB changed* by +6.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 018b441 merge: 6b1f6a8 diff diff %
ydbd size 5 305 818 160 Bytes 5 305 825 176 Bytes +6.9 KiB +0.000%
ydbd stripped size 1 365 570 096 Bytes 1 365 571 056 Bytes +960 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
@github-actions
Copy link

github-actions bot commented Dec 9, 2024 •
edited
Loading

⚪ 2024-12-09 13:57:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for 41413ab has started.
⚪ 2024-12-09 13:58:13 UTC Artifacts will be uploaded here
⚪ 2024-12-09 14:01:41 UTC ya make is running...
⚫ 2024-12-09 14:03:08 UTC Check cancelled
@stanislav-shchetinin stanislav-shchetinin changed the title Backup/restore change feed configurations Backup change feed configurations (tools dump) Dec 9, 2024
@github-actions
Copy link

github-actions bot commented Dec 9, 2024 •
edited
Loading

⚪ 2024-12-09 13:59:19 UTC Pre-commit check linux-x86_64-release-asan for 41413ab has started.
⚪ 2024-12-09 13:59:30 UTC Artifacts will be uploaded here
⚪ 2024-12-09 14:02:30 UTC ya make is running...
⚫ 2024-12-09 14:03:08 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 9, 2024 •
edited
Loading

⚪ 2024-12-09 14:06:18 UTC Pre-commit check linux-x86_64-release-asan for 52dc38c has started.
⚪ 2024-12-09 14:06:30 UTC Artifacts will be uploaded here
⚪ 2024-12-09 14:09:40 UTC ya make is running...
⚫ 2024-12-09 15:17:40 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 9, 2024 •
edited
Loading

⚪ 2024-12-09 14:06:30 UTC Pre-commit check linux-x86_64-relwithdebinfo for 52dc38c has started.
⚪ 2024-12-09 14:06:34 UTC Artifacts will be uploaded here
⚪ 2024-12-09 14:09:36 UTC ya make is running...
🟡 2024-12-09 15:16:10 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32832 29997 0 3 2720 112

🟢 2024-12-09 15:17:49 UTC ydbd size 2.5 GiB changed* by +60.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 0a7a679 merge: 52dc38c diff diff %
ydbd size 2 699 396 888 Bytes 2 699 458 688 Bytes +60.4 KiB +0.002%
ydbd stripped size 483 497 424 Bytes 483 505 744 Bytes +8.1 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
⚫ 2024-12-09 15:17:50 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 13:23:47 UTC Pre-commit check linux-x86_64-release-asan for d395eb2 has started.
⚪ 2024-12-12 13:23:58 UTC Artifacts will be uploaded here
⚫ 2024-12-12 13:27:14 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 13:25:23 UTC Pre-commit check linux-x86_64-relwithdebinfo for d395eb2 has started.
⚪ 2024-12-12 13:25:34 UTC Artifacts will be uploaded here
⚫ 2024-12-12 13:27:19 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 13:28:45 UTC Pre-commit check linux-x86_64-relwithdebinfo for 0ffbefa has started.
⚪ 2024-12-12 13:28:49 UTC Artifacts will be uploaded here
⚪ 2024-12-12 13:31:48 UTC ya make is running...
⚫ 2024-12-12 13:54:03 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 13:28:47 UTC Pre-commit check linux-x86_64-release-asan for 0ffbefa has started.
⚪ 2024-12-12 13:28:51 UTC Artifacts will be uploaded here
⚪ 2024-12-12 13:32:02 UTC ya make is running...
⚫ 2024-12-12 13:54:18 UTC Check cancelled
Gazizonoki
Gazizonoki previously approved these changes Dec 12, 2024
View reviewed changes
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 13:58:27 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4744476 has started.
⚪ 2024-12-12 13:58:39 UTC Artifacts will be uploaded here
⚪ 2024-12-12 14:01:47 UTC ya make is running...
🟡 2024-12-12 14:59:57 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32917 29988 0 4 2812 113

⚪ 2024-12-12 15:02:37 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-12 15:13:42 UTC ydbd size 2.1 GiB changed* by +3.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: d78c86c merge: 4744476 diff diff %
ydbd size 2 256 263 536 Bytes 2 256 266 656 Bytes +3.0 KiB +0.000%
ydbd stripped size 483 943 952 Bytes 483 943 952 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
⚫ 2024-12-12 15:13:45 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 13:58:40 UTC Pre-commit check linux-x86_64-release-asan for 4744476 has started.
⚪ 2024-12-12 13:58:53 UTC Artifacts will be uploaded here
⚪ 2024-12-12 14:02:12 UTC ya make is running...
🟢 2024-12-12 15:14:12 UTC ydbd size 3.6 GiB changed* by +6.7 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: d78c86c merge: 4744476 diff diff %
ydbd size 3 898 615 992 Bytes 3 898 622 864 Bytes +6.7 KiB +0.000%
ydbd stripped size 1 366 738 000 Bytes 1 366 739 856 Bytes +1.8 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
⚫ 2024-12-12 15:14:15 UTC Check cancelled
CyberROFL
CyberROFL reviewed Dec 12, 2024
View reviewed changes
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 15:18:59 UTC Pre-commit check linux-x86_64-release-asan for b62a24d has started.
⚪ 2024-12-12 15:19:13 UTC Artifacts will be uploaded here
⚪ 2024-12-12 15:22:14 UTC ya make is running...
🔴 2024-12-12 15:25:22 UTC Build failed, see the logs. Also see fail summary
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 15:19:13 UTC Pre-commit check linux-x86_64-relwithdebinfo for b62a24d has started.
⚪ 2024-12-12 15:19:25 UTC Artifacts will be uploaded here
⚪ 2024-12-12 15:22:35 UTC ya make is running...
🔴 2024-12-12 15:30:17 UTC Build failed, see the logs. Also see fail summary
CyberROFL
CyberROFL reviewed Dec 12, 2024
View reviewed changes
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 15:38:19 UTC Pre-commit check linux-x86_64-relwithdebinfo for ec02124 has started.
⚪ 2024-12-12 15:38:31 UTC Artifacts will be uploaded here
⚪ 2024-12-12 15:41:34 UTC ya make is running...
⚫ 2024-12-12 16:11:05 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 15:38:52 UTC Pre-commit check linux-x86_64-release-asan for ec02124 has started.
⚪ 2024-12-12 15:39:05 UTC Artifacts will be uploaded here
⚪ 2024-12-12 15:42:07 UTC ya make is running...
⚫ 2024-12-12 16:11:19 UTC Check cancelled
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 16:13:00 UTC Pre-commit check linux-x86_64-relwithdebinfo for ffc62a6 has started.
⚪ 2024-12-12 16:13:12 UTC Artifacts will be uploaded here
⚪ 2024-12-12 16:16:15 UTC ya make is running...
🟡 2024-12-12 17:12:27 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32700 29755 0 9 2822 114

⚪ 2024-12-12 17:15:08 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-12 17:26:59 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
703 (only retried tests) 595 0 0 0 108

🟢 2024-12-12 17:27:09 UTC Build successful.
🟢 2024-12-12 17:27:29 UTC ydbd size 2.1 GiB changed* by +3.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 46a0f52 merge: ffc62a6 diff diff %
ydbd size 2 256 526 456 Bytes 2 256 529 576 Bytes +3.0 KiB +0.000%
ydbd stripped size 483 997 040 Bytes 483 997 040 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
@github-actions
Copy link

github-actions bot commented Dec 12, 2024 •
edited
Loading

⚪ 2024-12-12 16:13:35 UTC Pre-commit check linux-x86_64-release-asan for ffc62a6 has started.
⚪ 2024-12-12 16:13:46 UTC Artifacts will be uploaded here
⚪ 2024-12-12 16:16:48 UTC ya make is running...
🟡 2024-12-12 17:19:46 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15453 15387 0 15 7 44

🟢 2024-12-12 17:21:03 UTC Build successful.
🟢 2024-12-12 17:21:27 UTC ydbd size 3.6 GiB changed* by +6.8 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 46a0f52 merge: ffc62a6 diff diff %
ydbd size 3 899 037 200 Bytes 3 899 044 136 Bytes +6.8 KiB +0.000%
ydbd stripped size 1 366 820 944 Bytes 1 366 822 864 Bytes +1.9 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation
@stanislav-shchetinin stanislav-shchetinin enabled auto-merge (squash) December 12, 2024 16:49
@stanislav-shchetinin stanislav-shchetinin merged commit 9c831b2 into ydb-platform:main Dec 12, 2024
10 checks passed
@GrigoriyPA GrigoriyPA mentioned this pull request Dec 18, 2024
Merged
@niksaveliev niksaveliev mentioned this pull request Dec 25, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

new-feature

3 participants

@stanislav-shchetinin @CyberROFL @Gazizonoki