[EPIC] Improve the user authentication system

[yuqi1129]

Describe the proposal

Currently, we only implement authentication between the Gravitino client and the Gravitino server and the Gravitino server and Hive Metastore, catalogs such as Iceberg, HDFS, and Kafka are left unauthenticated. Additionally, there is no authentication between The Trino connector, Spark connector, and the Gravitino server, we need to improve it.

Task list

• Authentication between Gravitino and specific catalogs
  • [Improvement] Authentication between the Hadoop catalog and Gravitino. #3337
  • Support different level(catalog, schema,fileset) of authentication for Hadoop catalog. #3462
  • Support user authentication for Iceberg with Hive backend. #3463
  • [Improvement] Support multiple metastores for Kerberos Hive catalog #3906
  • Support multiple KDCs for Kerberos Hive catalog
  • Authentication between Iceberg catalog and Gravitino.
  • Authentication between Kafka and Gravitino.
• Trino connector authentication
  • [Imrovement] Support authentication between Gravitino Trino connector and Gravitino Server #4149
  • Support authentication between Trino and Hive/Iceberg
• Spark connector authentication
  • Use authentication between Trino and Gravitino
  • Support authentication between Trino and Hive/Iceberg
• Gravitino Server supports user proxy
• Support e2e test
  • [Improvement] Add Hive user authentication e2e test. #3489
  • [Improvement] Add user authentication e2e tests for Hadoop catalog #3537
  • Add KDC and Hive with security in docker container #3408
• Improvement and possible bugs
  • [#772][0.7] fix(kerberos): cache proxy user ugi to avoid memory leak (#773) incubator-uniffle#824