[BACKPORT pg15-cherrypicks] all: Bulk port from master - 88

Summary:
 bfd17b5 [PLAT-14601]Support restore to Point in time part 2 - Backup/Restore/Restore preflight related changes - Add JSON Property
 91d000a [doc] Thirdparty to integrations (#23598)
 Excluded: 6456777 [#23626] allow loading old dumps that do not have index pg_class OIDs
 c8b8be3 [DB-12586] yugabyted: Update schema migration UI (#23217)
 Excluded: 4ea354b [#23521] YSQL: Cost YB Bitmap Table Scan remote filters
 b80999d [PLAT-14974][PLAT-15045] Added prometheus user as part of yugabyte group
 63f1d65 [#23669] YSQL: Add more logs to debug an assertion failure
 1ad4795 [docs] [TA] Added TA-23476: YCQL currenttimestamp() precision (#23642)
 41ae6b4 [#23653] docdb: Adjust waits for MasterPathHandlersItest.TestUndeletedParentTablet in TSAN
 78b0ae4 [DB-12587] yugabyted: Update data migration UI (#23291)
 d234b3a [PLAT-15046] Create log directory with correct permissions to allow users to export logs without using sudo
 8713c18 [doc][yba] Clarify pre-req for cloud provider image upgrades (#23285)
 9be5c91 [#23448] YSQL: fix failing test PgAutoAnalyzeTest.CheckTableMutationsCount
 Excluded: 9d54710 [#22147] YSQL, QueryDiagnostics: Pgss support for query diagnostics
 417092a [#23373] DocDB: Add max_disk_throughput_mbps gflag to control disk full rejection
 e3a1a36 [PLAT-15035] Add support to sync gflags secret mount location to actual gflag file used by services
 23a6a4c [PLAT-14525][PLAT-14953] Add local provider tests for switchover, failover, change replica, and restart
 6026029 [PLAT-15100][Master]Observed two Scheduled Backup Policies tabs in Backup page
 2cf648b [#23581] CDCSDK: Support dynamic table addition with table removal
 b14851d [#23702] xClusterDDLRepl: Add extra logging
 8a0d6ff [#23645] docdb: Reorder heartbeat handling logic to fix regression.
 2b30b5e [Docs] Changes for Experimental AI (#23714)

Test Plan: Jenkins: rebase: pg15-cherrypicks

Reviewers: jason, tfoucher

Differential Revision: https://phorge.dev.yugabyte.com/D37645

.github/vale-styles/Yugabyte/spelling-exceptions.txt

@@ -421,6 +421,7 @@ negatable
 Netlify
 nginx
 Nokogiri
+Northwind
 noteable
 noteables
 npm
@@ -446,6 +447,7 @@ parallelizations
 passwordless
 Patroni
 performant
+pgAdmin
 PgBouncer
 pgLoader
 pg_cron

docs/assets/scss/_yb_kapa_ai.scss

@@ -61,7 +61,7 @@ body {
       cursor: pointer;
       display: flex;
       padding: 4px 15px 4px 12px;
-      background: linear-gradient(91deg, #ED35EC 3.97%, #ED35C5 50.03%, #5E60F0 60.12%);
+      background: linear-gradient(91deg, #ED35EC 3.97%, #ED35C5 33%, #5E60F0 50%);
       background-clip: text;
       -webkit-background-clip: text;
       -webkit-text-fill-color: transparent;
@@ -119,22 +119,6 @@ body {
       >span.tritiery-btn:not(.btn-priority) > img {
         display: block;
       }
-
-      >span.tritiery-btn:not(.btn-priority) > span {
-        font-size: 0px;
-      }
-
-      >span.tritiery-btn:not(.btn-priority) > span:after {
-        content: 'Use AI';
-        font-size: 13px;
-        display: block !important;
-        position: relative;
-        top: -7px;
-        background: linear-gradient(91deg, #ED35EC 3.97%, #ED35C5 50.03%, #5E60F0 80.11%);
-        background-clip: text;
-        -webkit-background-clip: text;
-        -webkit-text-fill-color: transparent;
-      }
     }
 
     @media (max-width: 450px) {

docs/config/_default/menus.toml

@@ -532,75 +532,88 @@
 
 [[preview_integrations]]
   name = "Drivers and ORMs"
-  weight = 2
+  weight = 3
   url = "/preview/drivers-orms/"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Schema migration"
-  weight = 3
+  weight = 4
   identifier = "schema-migration"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Data migration"
-  weight = 4
+  weight = 5
   identifier = "data-migration"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Data integration"
-  weight = 5
+  weight = 6
   identifier = "data-integration"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "GUI clients"
-  weight = 6
-  url = "/preview/tools/"
-  parent = "integrations"
+  weight = 7
+  identifier = "tools"
+  url = "/preview/integrations/tools/"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Application frameworks"
-  weight = 7
+  weight = 8
   identifier = "application-frameworks"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Development platforms"
-  weight = 8
+  weight = 9
   identifier = "development-platforms"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Data discovery"
-  weight = 9
+  weight = 10
   identifier = "data-discovery"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Security"
-  weight = 10
+  weight = 11
   identifier = "integrations-security"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Applications"
-  weight = 11
+  weight = 12
   identifier = "integrations-applications"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
-  name = "Infrastructure (HW, SW, Data Mgmt)"
-  weight = 12
+  name = "Infrastructure"
+  weight = 13
   identifier = "integrations-platforms"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 [[preview_integrations]]
   name = "Other"
-  weight = 13
+  weight = 14
   identifier = "integrations-other"
-  parent = "integrations"
+  [preview_integrations.params]
+    showSection = true
 
 ########## Menus (in preview) for Tutorials
 
@@ -630,28 +643,41 @@
   [preview_tutorials.params]
     showSection = true
 
-#[[preview_tutorials]]
-#  name = "Hello world"
-#  weight = 3
-#  identifier = "build-apps"
-#  url = "/preview/tutorials/build-apps/"
-#  parent = "tutorials"
-#  [preview_tutorials.params]
-#    showSection = true
+[[preview_tutorials]]
+  name = "Hello world"
+  weight = 5
+  identifier = "build-apps"
+  url = "/preview/tutorials/build-apps/"
+  [preview_tutorials.params]
+    showSection = true
+
+[[preview_tutorials]]
+  name = "Build and learn"
+  weight = 10
+  identifier = "tutorials-build-and-learn"
+  url = "/preview/tutorials/build-and-learn/"
+  [preview_tutorials.params]
+    showSection = true
 
 [[preview_tutorials]]
   name = "Cloud"
   weight = 30
   identifier = "tutorials-cloud"
-  parent = "tutorials"
+  [preview_tutorials.params]
+    showSection = true
+
+[[preview_tutorials]]
+  name = "AI"
+  weight = 35
+  identifier = "tutorials-ai"
+  url = "/preview/tutorials/ai/"
   [preview_tutorials.params]
     showSection = true
 
 [[preview_tutorials]]
   name = "CDC"
   weight = 40
   identifier = "tutorials-cdc"
-  parent = "tutorials"
   [preview_tutorials.params]
     showSection = true
 

docs/config/_default/params.toml

@@ -4,7 +4,7 @@ copyright = "Yugabyte, Inc."
 privacy_policy = "https://www.yugabyte.com/privacy-policy/"
 kapa_ai = true
 drift_snippet = true
-search_banner = true
+search_banner = false
 version_menu = "Releases"
 
 # Change version_menu_pagelinks to true to go to the same page when you switch

docs/content/preview/drivers-orms/elixir/phoenix.md

@@ -13,7 +13,7 @@ type: docs
 
 <ul class="nav nav-tabs-alt nav-tabs-yb">
   <li >
-    <a href="../elixir/phoenix" class="nav-link active">
+    <a href="../phoenix" class="nav-link active">
       <i class="icon-postgres" aria-hidden="true"></i>
       Phoenix/Ecto
     </a>

docs/content/preview/drivers-orms/java/_index.md

@@ -31,10 +31,10 @@ The following projects can be used to implement Java applications using the Yuga
 | Projects | Documentation and Guides | Example Apps |
 | ------- | ------------------------ | ------------ |
 | Hibernate ORM | [Documentation](hibernate/)<br />[Hello World](../orms/java/ysql-hibernate/)<br />[Blog](https://www.yugabyte.com/blog/run-the-rest-version-of-spring-petclinic-with-angular-and-distributed-sql-on-gke/)<br /> | [Hibernate ORM App](https://github.com/yugabyte/orm-examples/tree/master/java/hibernate/) |
-| Spring Data JPA | [Documentation](../../integrations/spring-framework/sd-jpa/)<br />[Hello World](../orms/java/ysql-spring-data/)<br />[Blog](https://www.yugabyte.com/blog/run-the-rest-version-of-spring-petclinic-with-angular-and-distributed-sql-on-gke/) | [Spring Data JPA App](https://github.com/yugabyte/orm-examples/tree/master/java/spring/)
+| Spring Data JPA | [Documentation](/preview/integrations/spring-framework/sd-jpa/)<br />[Hello World](../orms/java/ysql-spring-data/)<br />[Blog](https://www.yugabyte.com/blog/run-the-rest-version-of-spring-petclinic-with-angular-and-distributed-sql-on-gke/) | [Spring Data JPA App](https://github.com/yugabyte/orm-examples/tree/master/java/spring/) |
 | Ebean ORM | [Documentation](ebean/)<br /> [Hello World](../orms/java/ysql-ebean/)<br /> [Blog](https://www.yugabyte.com/blog/ebean-orm-yugabytedb/)| [Ebean ORM App](https://github.com/yugabyte/orm-examples/tree/master/java/ebean/) |
-| MyBatis ORM | [Documentation](mybatis/)<br /> [Hello World](../orms/java/ysql-mybatis/) | [MyBatis ORM App](https://github.com/yugabyte/orm-examples/tree/master/java/mybatis/)
-| Spring Data YugabyteDB | [Documentation](../../integrations/spring-framework/sdyb/)<br/>[Blog](https://www.yugabyte.com/blog/spring-data-yugabytedb-getting-started/) | [Spring Data YugabyteDB Sample App](https://github.com/yugabyte/spring-data-yugabytedb-example/) |
+| MyBatis ORM | [Documentation](mybatis/)<br /> [Hello World](../orms/java/ysql-mybatis/) | [MyBatis ORM App](https://github.com/yugabyte/orm-examples/tree/master/java/mybatis/) |
+| Spring Data YugabyteDB | [Documentation](/preview/integrations/spring-framework/sdyb/)<br/>[Blog](https://www.yugabyte.com/blog/spring-data-yugabytedb-getting-started/) | [Spring Data YugabyteDB Sample App](https://github.com/yugabyte/spring-data-yugabytedb-example/) |
 
 Learn how to establish a connection to a YugabyteDB database and begin basic CRUD operations by referring to [Connect an app](yugabyte-jdbc/) or [Use an ORM](hibernate/).
 

docs/content/preview/drivers-orms/java/postgres-jdbc.md

@@ -224,6 +224,6 @@ If there is no output or you get an error, verify that the connection string in
 
 - [PostgreSQL JDBC driver reference](../../../reference/drivers/java/postgres-jdbc-reference/)
 - [YugabyteDB smart drivers for YSQL](../../smart-drivers/)
-- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](../../../integrations/spring-framework/sdyb/)
+- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](/preview/integrations/spring-framework/sdyb/)
 - Build Java applications using [Hibernate ORM](../hibernate/)
 - Build Java applications using [Ebean ORM](../ebean/)

docs/content/preview/drivers-orms/java/yb-r2dbc.md

@@ -230,6 +230,6 @@ ID: 3, Name: John, Age: 38, Language: JAVA
 
 - [YugabyteDB smart drivers for YSQL](../../smart-drivers/)
 - [Smart Driver architecture](https://github.com/yugabyte/yugabyte-db/blob/master/architecture/design/smart-driver.md)
-- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](../../../integrations/spring-framework/sdyb/)
+- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](/preview/integrations/spring-framework/sdyb/)
 - Build Java applications using [Hibernate ORM](../hibernate/)
 - Build Java applications using [Ebean ORM](../ebean/)

docs/content/preview/drivers-orms/java/ysql-vertx-pg-client.md

@@ -206,6 +206,6 @@ Example ran successfully!
 ## Learn more
 
 - [YugabyteDB smart drivers for YSQL](../../smart-drivers/)
-- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](../../../integrations/spring-framework/sdyb/)
+- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](/preview/integrations/spring-framework/sdyb/)
 - Build Java applications using [Hibernate ORM](../hibernate/)
 - Build Java applications using [Ebean ORM](../ebean/)

docs/content/preview/drivers-orms/java/yugabyte-jdbc.md

@@ -254,6 +254,6 @@ If you receive no output or an error, check the parameters in the connection str
 - [YugabyteDB smart drivers for YSQL](../../smart-drivers/)
 - Refer to [YugabyteDB JDBC driver reference](../../../reference/drivers/java/yugabyte-jdbc-reference/) and [Try it out](../../../reference/drivers/java/yugabyte-jdbc-reference/#try-it-out) for detailed smart driver examples.
 - [Smart Driver architecture](https://github.com/yugabyte/yugabyte-db/blob/master/architecture/design/smart-driver.md)
-- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](../../../integrations/spring-framework/sdyb/)
+- [Develop Spring Boot applications using the YugabyteDB JDBC Driver](/preview/integrations/spring-framework/sdyb/)
 - Build Java applications using [Hibernate ORM](../hibernate/)
 - Build Java applications using [Ebean ORM](../ebean/)

docs/content/preview/explore/change-data-capture/using-yugabytedb-grpc-replication/debezium-connector-yugabytedb.md

@@ -935,7 +935,7 @@ For example, the connector is lagging behind in streaming the changes. In this c
 
 ## Deployment
 
-To deploy a Debezium connector, you install the YugabyteDB gRPC Connector archive, configure the connector, and start the connector by adding its configuration to Kafka Connect. For complete steps, follow the guide to [running the Debezium connector in YugabyteDB](../../../../integrations/cdc/debezium/).
+To deploy a Debezium connector, you install the YugabyteDB gRPC Connector archive, configure the connector, and start the connector by adding its configuration to Kafka Connect. For complete steps, follow the guide to [running the Debezium connector in YugabyteDB](/preview/integrations/cdc/debezium/).
 
 ### Connector configuration example
 

docs/content/preview/faq/compatibility.md

@@ -59,11 +59,11 @@ YugabyteDB supports two flavors of distributed SQL.
 
 #### Yugabyte Cloud QL (YCQL)
 
-[YCQL](../../api/ycql/) is a semi-relational SQL API that is best fit for internet-scale OLTP and HTAP applications needing massive data ingestion and blazing-fast queries. It supports distributed transactions, strongly consistent secondary indexes and a native JSON column type. YCQL has its roots in the Cassandra Query Language. Get started by [exploring YCQL features](../../quick-start/explore/ycql/).
+[YCQL](../../api/ycql/) is a semi-relational SQL API that is best fit for internet-scale OLTP and HTAP applications needing massive data ingestion and blazing-fast queries. It supports distributed transactions, strongly consistent secondary indexes and a native JSON column type. YCQL has its roots in the Cassandra Query Language. Get started by [exploring YCQL features](/preview/quick-start/explore/ycql/).
 
 {{< note title="Note" >}}
 
-The YugabyteDB APIs are isolated and independent from one another today. This means that the data inserted or managed by one API cannot be queried by the other API. Additionally, there is no common way to access the data across the APIs (external frameworks such as [Presto](../../integrations/presto/) can help for basic cases).
+The YugabyteDB APIs are isolated and independent from one another today. This means that the data inserted or managed by one API cannot be queried by the other API. Additionally, there is no common way to access the data across the APIs (external frameworks such as [Presto](/preview/integrations/presto/) can help for basic cases).
 
 **The net impact is that you need to select an API first before undertaking detailed database schema/query design and implementation.**
 
@@ -94,10 +94,10 @@ For key-value workloads that need persistence, elasticity and fault-tolerance, Y
 
 ### What does API compatibility mean exactly?
 
-API compatibility refers to the fact that the database APIs offered by YugabyteDB servers implement the same wire protocol and modeling/query language as that of an existing database. Because [client drivers](../../drivers-orms/), [command line shells](../../admin/), [IDE integrations](../../tools/), and other [ecosystem integrations](../../integrations/) of the existing database rely on this wire protocol and modeling/query language, they are expected to work with YugabyteDB without major modifications.
+API compatibility refers to the fact that the database APIs offered by YugabyteDB servers implement the same wire protocol and modeling/query language as that of an existing database. Because [client drivers](../../drivers-orms/), [command line shells](../../admin/), and IDE and other [ecosystem integrations](/preview/integrations/) of the existing database rely on this wire protocol and modeling/query language, they are expected to work with YugabyteDB without major modifications.
 
 {{< note title="Note" >}}
-The [YSQL](../../api/ysql/) API is compatible with PostgreSQL. This means PostgreSQL client drivers, psql command line shell, IDE integrations such as TablePlus and DBWeaver, and more can be used with YugabyteDB. The same concept applies to [YCQL](../../api/ycql/) in the context of the Apache Cassandra Query Language.
+The [YSQL](../../api/ysql/) API is compatible with PostgreSQL. This means PostgreSQL client drivers, psql command line shell, IDE integrations such as TablePlus and DBeaver, and more can be used with YugabyteDB. The same concept applies to [YCQL](../../api/ycql/) in the context of the Apache Cassandra Query Language.
 {{< /note >}}
 
 ### Why are YugabyteDB APIs compatible with popular DB languages?

docs/content/preview/faq/yugabytedb-managed-faq.md

@@ -242,7 +242,7 @@ psql --host=<HOST_ADDRESS> --port=5433 --username=<DB USER> \
 --set=sslrootcert=<ROOT_CERT_PATH>
 ```
 
-For detailed steps for configuring other popular third party tools, see [Third party tools](../../tools/).
+For detailed steps for configuring other popular third party tools, see [GUI clients](/preview/integrations/tools/).
 
   {{% /tab %}}
 

docs/content/preview/integrations/_index.md

@@ -62,15 +62,15 @@ Version refers to the latest tested version of the integration.
 
 | Tool            | Version | Support | Tutorial |
 | :-------------- | :------ | :------ | :------- |
-| Apache Superset |         | Full    | [Apache Superset](../tools/superset/) |
-| Arctype         |         | Full    | [Arctype](../tools/arctype/) |
+| Apache Superset |         | Full    | [Apache Superset](tools/superset/) |
+| Arctype         |         | Full    | [Arctype](tools/arctype/) |
 | DataGrip        | 2023.2.2 | Full   |  |
-| DBeaver         | 23.2.2  | Full    | [DBeaver](../tools/dbeaver-ysql/) |
-| DbSchema        |         | Full    | [DbSchema](../tools/dbschema/) |
-| Metabase        |         | Full    | [Metabase](../tools/metabase/) |
-| pgAdmin         |         | Full    | [pgAdmin](../tools/pgadmin/) |
-| SQL Workbench/J |         | Full    | [SQL Workbench/J](../tools/sql-workbench/) |
-| TablePlus       | 2.18    | Full    | [TablePlus](../tools/tableplus/) |
+| DBeaver         | 23.2.2  | Full    | [DBeaver](tools/dbeaver-ysql/) |
+| DbSchema        |         | Full    | [DbSchema](tools/dbschema/) |
+| Metabase        |         | Full    | [Metabase](tools/metabase/) |
+| pgAdmin         |         | Full    | [pgAdmin](tools/pgadmin/) |
+| SQL Workbench/J |         | Full    | [SQL Workbench/J](tools/sql-workbench/) |
+| TablePlus       | 2.18    | Full    | [TablePlus](tools/tableplus/) |
 
 ### Application frameworks
 

docs/content/preview/integrations/apache-flink.md

@@ -18,7 +18,7 @@ Flink provides various DataStream connectors including one for JDBC to write dat
 
 The following example based on the [Flink documentation](https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/jdbc) describes the Flink connectivity to a YugabyteDB cluster using a JDBC sink connector.
 
-Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../../tools/#yugabytedb-prerequisites).
+Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../tools/#yugabytedb-prerequisites).
 Note that the YugabyteDB cluster you are connecting to is running on localhost.
 
 Create a table named books using [YSQLSH](../../admin/ysqlsh/#starting-ysqlsh) as follows:

docs/content/preview/integrations/ataccama.md

@@ -16,7 +16,7 @@ Because YugabyteDB's YSQL API is wire-compatible with PostgreSQL, DQ Analyzer ca
 
 ## Connect
 
-Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../../tools/#yugabytedb-prerequisites).
+Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../tools/#yugabytedb-prerequisites).
 
 Follow the steps in [Ataccama documentation](https://support.ataccama.com/home/docs/dqa/user-guide/working-with-databases) to connect the database.
 

docs/content/preview/integrations/caspio.md

@@ -17,7 +17,7 @@ You can access your PostgreSQL-compatible databases, such as YugabyteDB, by conn
 
 ## Connect
 
-Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../../tools/#yugabytedb-prerequisites).
+Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../tools/#yugabytedb-prerequisites).
 
 To connect your YugabyteDB database to Caspio:
 

docs/content/preview/integrations/dataedo.md

@@ -16,7 +16,7 @@ Because YugabyteDB's YSQL API is wire-compatible with PostgreSQL, Dataedo can co
 
 ## Connect
 
-Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../../tools/#yugabytedb-prerequisites).
+Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../tools/#yugabytedb-prerequisites).
 
 Follow the steps in [Dataedo documentation](https://dataedo.com/docs/connecting-to-postgresql) to connect the database.
 

docs/content/preview/integrations/hashicorp-vault.md

@@ -23,7 +23,7 @@ For more details, refer to [YSQL plugin for Hashicorp Vault](https://github.com/
 
 ## Setup
 
-Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../../tools/#yugabytedb-prerequisites).
+Your YugabyteDB cluster should be up and running. Refer to [YugabyteDB Prerequisites](../tools/#yugabytedb-prerequisites).
 
 Install Hashicorp Vault. See [Installing Vault](https://developer.hashicorp.com/vault/docs/install).