Drop Databricks 10.4 runtime from CI

[NvTimLiu]

Part of #10429

Drop Databricks 10.4 runtime from CI pipelines, @razajafri will help remove 10.4 related source code.

[NvTimLiu]

build

[NvTimLiu]

Draft this PR first,

I'll update CI scripts to drop Databricks 10.4 nightly build and integration test pipelines!

Will merge this PR alone with our nightly build and integration test CI changes.

[NvTimLiu]

The build/shimplify.py will calculate shim versions from source code via __traverse_source_tree_of_all_shims

So this PR failed as below as not removing 321db shim from source code.

We need to remove sql-plugin/src/main/spark321db/ dir and all the jason string {"spark": "321db"} first to PASS the build.

@razajafri can you help to include this PR into you source change? Thanks!

Error:  Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:3.1.0:run (shimplify-shim-sources) on project rapids-4-spark-sql_2.12: An Ant BuildException has occured: Traceback (most recent call last):
Error:    File "<script>", line 579, in <module>
Error:    File "<script>", line 354, in task_impl
Error:    File "<script>", line 368, in __generate_symlinks
Error:    File "<script>", line 397, in __traverse_source_tree_of_all_shims
Error:    File "<script>", line 375, in __map_version_array
Error:  AssertionError: all.buildvers in pom.xml does not contain 321db
Error:  
Error:  around Ant part ...<shimplify if="shimplify" />... @ 7:33 in /home/runner/work/spark-rapids/spark-rapids/sql-plugin/target/spark312/antrun/build-main.xml
Error:  -> [Help 1]
Error:  

[jlowe]

Superceded by #10474