-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[BACKPORT pg15-cherrypicks] all: Bulk port from master - 76
Summary: bd1e19e [PLAT-14835]: Add extra transient YCQL index tables in xClusterTableConfig during GET calls and metrics. 2715c58 [docs] updated yb version with shortcode (#23456) a2b5495 [PLAT-14912] docs warning for install root as subdirectory (#23470) 53365b1 [#23422] YSQL: Disable random warmup feature by default for connection manager tests 09d6e96 [#22876][#22835][#22773] CDCSDK: Add null checks & remove optimisation in table removal from CDC stream 69d4052 [#22862] XCluster: Improving XCluster Index Base WAL Retention Policy 706e97d [#23460] DocDB: Read vector index data b1a90b9 [#23428] docdb: Remove non-transactional snapshot code 581648f [PLAT-13957] Update RBAC wrapper for xCluster DR fbaf945 Whitepaper on migration (#23468) f6af2f5 [PLAT-13936] Upgrade Grpc and its dependencies to fix CVEs d7027fe [PLAT-14892] Update PITR configuration step text 92804ac [PLAT-14760] Use new xCluster sync API 3cb8faf [PLAT-11243] Upgrade python requests to latest version Excluded: a036313 [#23070] YSQL, ASH: Replace ysql_session_id with pid 4d2f71f [PLAT-14882] Retrieve userName from the attribute lists in case not found in dn 99489c0 [PLAT-14909] Upgrade YBC version to 2.2.0.0-b4 Test Plan: Jenkins: rebase: pg15-cherrypicks Reviewers: jason, tfoucher Tags: #jenkins-ready Differential Revision: https://phorge.dev.yugabyte.com/D37272
- Loading branch information
1 parent
4abc34c
commit 4aabc0c
Showing
137 changed files
with
3,531 additions
and
2,518 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,38 +1,56 @@ | ||
| --- | ||
| title: Migrate data | ||
| headerTitle: Migrate data | ||
| linkTitle: Migrate data | ||
| linkTitle: Migrate | ||
| description: Import and export data in YugabyteDB. | ||
| image: /images/section_icons/manage/enterprise.png | ||
| headcontent: Bulk export and import data from and to YugabyteDB | ||
| image: fa-thin fa-cloud-binary | ||
| headcontent: Export data and schema from other databases and import into YugabyteDB | ||
| menu: | ||
| preview: | ||
| identifier: manage-bulk-import-export | ||
| parent: manage | ||
| weight: 703 | ||
| type: indexpage | ||
| --- | ||
| <div class="row"> | ||
| <div class="col-12 col-md-6 col-lg-12 col-xl-6"> | ||
| <a class="section-link icon-offset" href="bulk-export-ysql/"> | ||
| <div class="head"> | ||
| <img class="icon" src="/images/section_icons/index/deploy.png" aria-hidden="true" /> | ||
| <div class="title">Bulk export</div> | ||
| </div> | ||
| <div class="body"> | ||
| This section describes how to bulk export data out of YugabyteDB. | ||
| </div> | ||
| </a> | ||
| </div> | ||
| <div class="col-12 col-md-6 col-lg-12 col-xl-6"> | ||
| <a class="section-link icon-offset" href="bulk-import-ysql/"> | ||
| <div class="head"> | ||
| <img class="icon" src="/images/section_icons/index/deploy.png" aria-hidden="true" /> | ||
| <div class="title">Bulk import</div> | ||
| </div> | ||
| <div class="body"> | ||
| This section describes how to bulk import data into YugabyteDB. | ||
| </div> | ||
| </a> | ||
| </div> | ||
| </div> | ||
|
|
||
| Migrating to YugabyteDB, a high-performance distributed SQL database, involves a series of carefully planned steps to ensure a seamless transition from your existing database environment, such as PostgreSQL, to a scalable, fault-tolerant, and globally distributed system. Whether you're moving from a monolithic setup or another distributed system, understanding the migration strategies, tools, and best practices is crucial to achieving a successful migration. | ||
|
|
||
| ## YugabyteDB Voyager | ||
|
|
||
| Yugabyte ships [YugabyteDB Voyager](/preview/yugabyte-voyager/), a comprehensive data migration tool designed specifically to help users migrate from traditional databases like PostgreSQL, Oracle, MySQL, and others to YugabyteDB. It offers a variety of features that make the migration process smoother, more reliable, and less error-prone. | ||
|
|
||
| {{<lead link="/preview/yugabyte-voyager/migrate/">}} | ||
| To learn more about how to methodically export using YB Voyager, see [Migrate](/preview/yugabyte-voyager/migrate/). | ||
| {{</lead>}} | ||
|
|
||
| ## Export your data | ||
|
|
||
| If you need to export your data manually, you can use the [ysql_dump](../../admin/ysql-dump/) tool or use the [COPY TO](../../api/ysql/the-sql-language/statements/cmd_copy/) command to export your tables into CSV files. | ||
|
|
||
| {{<lead link="../../manage/data-migration/bulk-export-ysql/">}} | ||
| To learn more about how to use ysql_dump and the `COPY` command to export your data, see [Export data](../../manage/data-migration/bulk-export-ysql/). | ||
| {{</lead>}} | ||
|
|
||
| ## Import your data | ||
|
|
||
| To import data into a YSQL database manually, you can use [ysqlsh](../../admin/ysqlsh/) tool or use the [COPY FROM](../../api/ysql/the-sql-language/statements/cmd_copy/) command to import CSV files into YugabyteDB. | ||
|
|
||
| {{<lead link="../../manage/data-migration/bulk-import-ysql/">}} | ||
| To learn more about how to import your data manually and best practices, see [Import data](../../manage/data-migration/bulk-import-ysql/). | ||
| {{</lead>}} | ||
|
|
||
| ## Verify migration | ||
|
|
||
| After the data has been imported into the newly set up YugabyteDB cluster, you need to verify and validate that the data and the schema have been migrated correctly to ensure smooth functioning of your services. | ||
|
|
||
| {{<lead link="">}} | ||
| To understand the various steps involved in validating your data, see [Verify migration](./verify-migration-ysql). | ||
| {{</lead>}} | ||
|
|
||
| ## Guide to migration from PostgreSQL | ||
|
|
||
| Migrating from one system to another is no trivial task. It involves pre-planning, exporting and importing schema, analyzing and modifying schema, exporting and importing data, and more. Follow these precautions and steps to ensure a smooth migration. | ||
|
|
||
| {{<lead link="../../manage/data-migration/migrate-from-postgres/">}} | ||
| To understand the various steps involved in migrating from PostgreSQL and best practices, see [Migrate from PostgreSQL](../../manage/data-migration/migrate-from-postgres/). | ||
| {{</lead>}} |
22 changes: 5 additions & 17 deletions
22
docs/content/preview/manage/data-migration/bulk-export-ycql.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.