Remove torch.xpu.optimize for semantic_segmentation task

[kprokofi]

Summary

How to test

Checklist

• I have added unit tests to cover my changes.​
• I have added integration tests to cover my changes.​
• I have added e2e tests for validation.
• I have added the description of my changes into CHANGELOG in my target branch (e.g., CHANGELOG in develop).​
• I have updated the documentation in my target branch accordingly (e.g., documentation in develop).
• I have linked related issues.

License

• I submit my code changes under the same Apache License that covers the project.
  Feel free to contact the maintainers if that's a concern.
• I have updated the license header for each file (see an example below).

# Copyright (C) 2024 Intel Corporation
# SPDX-License-Identifier: Apache-2.0

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 80.75%. Comparing base (040e2b1) to head (aa691e4).

Additional details and impacted files

@@                Coverage Diff                 @@
##           releases/1.6.0    #3172      +/-   ##
==================================================
- Coverage           80.75%   80.75%   -0.01%     
==================================================
  Files                 536      536              
  Lines               40408    40406       -2     
==================================================
- Hits                32630    32628       -2     
  Misses               7778     7778              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[kprokofi]

@chuneuny-emily could you please review?