You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#6969 added support for parse_url. At the time, support was not added to enable fail on error when ANSI mode is enabled.
When fail on error is enabled (i.e. in ANSI mode) on Apache Spark, then the query should fail on parse errors, instead of returning null rows. When a parse_url is attempted on spark-rapids, we see that the query falls off the GPU:
@Expression <Alias> parse_url(a#7, QUERY, a, true) AS parse_url(a, QUERY, a)#10 could run on GPU
!Expression <ParseUrl> parse_url(a#7, QUERY, a, true) cannot run on GPU because Fail on error is not supported on GPU when parsing urls.
This behaviour can be seen when the url_test.py::test_parse_url_query_with_key integration test is run, in ANSI mode.
It would be good to have support for fail on error when ANSI is enabled on Spark RAPIDS.
(Note: This error is observed as part of the investigation into #11017. The failing condition will be disabled for now.)
The text was updated successfully, but these errors were encountered:
FixesNVIDIA#11017.
This commit fixes the tests in url_test.py, so that they don't fail
when ANSI mode is enabled.
All the errant tests fail because `parse_url()` does not currently
support "fail on error" in spark-rapids.
See NVIDIA#11193.
The tests have been modified to explicitly run with ANSI mode disabled.
These tests can be enabled to run in ANSI mode after NVIDIA#11193 has been
addressed.
Signed-off-by: MithunR <[email protected]>
#6969 added support for
parse_url
. At the time, support was not added to enablefail on error
when ANSI mode is enabled.When
fail on error
is enabled (i.e. in ANSI mode) on Apache Spark, then the query should fail on parse errors, instead of returning null rows. When aparse_url
is attempted onspark-rapids
, we see that the query falls off the GPU:This behaviour can be seen when the
url_test.py::test_parse_url_query_with_key
integration test is run, in ANSI mode.It would be good to have support for
fail on error
when ANSI is enabled on Spark RAPIDS.(Note: This error is observed as part of the investigation into #11017. The failing condition will be disabled for now.)
The text was updated successfully, but these errors were encountered: