[BUG] Mortgage test failing with 'JavaPackage' error on AWS Databricks

[jlowe]

AWS Databricks nightly runs failed in mortgage_test.py:

[2023-08-03T13:33:23.625Z] =================================== FAILURES ===================================
[2023-08-03T13:33:23.625Z] ________________________________ test_mortgage _________________________________
[2023-08-03T13:33:23.625Z] 
[2023-08-03T13:33:23.625Z] mortgage = <conftest.MortgageRunner object at 0x7f643ae29340>
[2023-08-03T13:33:23.625Z] 
[2023-08-03T13:33:23.625Z]     @incompat
[2023-08-03T13:33:23.625Z]     @approximate_float
[2023-08-03T13:33:23.625Z]     @limit
[2023-08-03T13:33:23.625Z]     @ignore_order
[2023-08-03T13:33:23.625Z]     @allow_non_gpu(any=True)
[2023-08-03T13:33:23.625Z]     def test_mortgage(mortgage):
[2023-08-03T13:33:23.625Z] >     assert_gpu_and_cpu_are_equal_iterator(
[2023-08-03T13:33:23.625Z]               lambda spark : mortgage.do_test_query(spark))
[2023-08-03T13:33:23.625Z] 
[2023-08-03T13:33:23.625Z] ../../src/main/python/mortgage_test.py:26: 
[2023-08-03T13:33:23.625Z] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[2023-08-03T13:33:23.625Z] ../../src/main/python/asserts.py:569: in assert_gpu_and_cpu_are_equal_iterator
[2023-08-03T13:33:23.625Z]     _assert_gpu_and_cpu_are_equal(func, 'ITERATOR', conf=conf, is_cpu_first=is_cpu_first)
[2023-08-03T13:33:23.625Z] ../../src/main/python/asserts.py:480: in _assert_gpu_and_cpu_are_equal
[2023-08-03T13:33:23.625Z]     run_on_cpu()
[2023-08-03T13:33:23.625Z] ../../src/main/python/asserts.py:466: in run_on_cpu
[2023-08-03T13:33:23.625Z]     from_cpu = with_cpu_session(bring_back, conf=conf)
[2023-08-03T13:33:23.625Z] ../../src/main/python/spark_session.py:116: in with_cpu_session
[2023-08-03T13:33:23.625Z]     return with_spark_session(func, conf=copy)
[2023-08-03T13:33:23.625Z] ../../src/main/python/spark_session.py:100: in with_spark_session
[2023-08-03T13:33:23.625Z]     ret = func(_spark)
[2023-08-03T13:33:23.625Z] ../../src/main/python/asserts.py:212: in <lambda>
[2023-08-03T13:33:23.625Z]     bring_back = lambda spark: limit_func(spark).toLocalIterator()
[2023-08-03T13:33:23.625Z] ../../src/main/python/asserts.py:193: in with_limit
[2023-08-03T13:33:23.625Z]     df = sorted_func(spark)
[2023-08-03T13:33:23.625Z] ../../src/main/python/asserts.py:183: in with_sorted
[2023-08-03T13:33:23.625Z]     df = func(spark)
[2023-08-03T13:33:23.625Z] ../../src/main/python/mortgage_test.py:27: in <lambda>
[2023-08-03T13:33:23.625Z]     lambda spark : mortgage.do_test_query(spark))
[2023-08-03T13:33:23.625Z] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[2023-08-03T13:33:23.625Z] 
[2023-08-03T13:33:23.625Z] self = <conftest.MortgageRunner object at 0x7f643ae29340>
[2023-08-03T13:33:23.625Z] spark = <pyspark.sql.session.SparkSession object at 0x7f645353e490>
[2023-08-03T13:33:23.625Z] 
[2023-08-03T13:33:23.625Z]     def do_test_query(self, spark):
[2023-08-03T13:33:23.625Z]       from pyspark.sql.dataframe import DataFrame
[2023-08-03T13:33:23.625Z]       jvm_session = _get_jvm_session(spark)
[2023-08-03T13:33:23.625Z]       jvm = _get_jvm(spark)
[2023-08-03T13:33:23.625Z]       acq = self.mortgage_acq_path
[2023-08-03T13:33:23.625Z]       perf = self.mortgage_perf_path
[2023-08-03T13:33:23.625Z]       run = jvm.com.nvidia.spark.rapids.tests.mortgage.Run
[2023-08-03T13:33:23.625Z]       if self.mortgage_format == 'csv':
[2023-08-03T13:33:23.625Z]           df = run.csv(jvm_session, perf, acq)
[2023-08-03T13:33:23.625Z]       elif self.mortgage_format == 'parquet':
[2023-08-03T13:33:23.625Z] >         df = run.parquet(jvm_session, perf, acq)
[2023-08-03T13:33:23.625Z] E         TypeError: 'JavaPackage' object is not callable
[2023-08-03T13:33:23.625Z] 
[2023-08-03T13:33:23.625Z] ../../src/main/python/conftest.py:380: TypeError