Fix CPU training issue on non-CUDA system (#2655) #5726

Job	Run time
Code-Quality-Checks	2m 52s
Unit-Test-with-Python3.8	21m 48s
Unit-Test-with-Python3.10	22m 45s
Unit-Test-with-Python3.9	20m 44s
Integration-Test-py310-act / run_tests_in_tox	10m 0s
Integration-Test-py310-all / run_tests_in_tox	9m 42s
Integration-Test-py310-ano / run_tests_in_tox	10m 29s
Integration-Test-py310-cls / run_tests_in_tox	21m 13s
Integration-Test-py310-iseg / run_tests_in_tox	31m 33s
Integration-Test-py310-seg / run_tests_in_tox	13m 26s
Integration-Test-py310-det / run_tests_in_tox	29m 21s
Integration-Test-py310-visprompt / run_tests_in_tox	3m 57s
	3h 17m 50s

Provide feedback