Run compilation even in local execution for dynamic tasks to early detect errors

[wild-endeavor]

TL;DR

Running the compilation step in addition to execution when running a dynamic task locally. This helps to catch issues with illegal dynamic tasks earlier.

For instance without this check,

    @dynamic
    def use_result(a: int) -> int:
        x = t1(a=a)
        if len(x) > 6:
            return 5
        else:
            return 0

this would succeed but it should not since x would be a promise in production.

Type

• Bug Fix
• Feature
• Plugin

Are all requirements met?

• Code completed
• Smoke tested
• Unit tests added
• Code documentation added
• Any pending items have an associated Issue

Complete description

Local execution still proceeds normally though because there's no way to execute a DynamicJobSpec locally.
Couple of our unit tests were actually relying on this behavior so updating those tests.

Also,

• Pulled out the serialization settings object into the top level in tests/flytekit/unit/core/test_dynamic.py

Tracking Issue

flyteorg/flyte#2722

[codecov]

Codecov Report

Merging #1121 (12b5097) into master (96c0b3c) will increase coverage by 0.00%.
The diff coverage is 76.66%.

@@           Coverage Diff           @@
##           master    #1121   +/-   ##
=======================================
  Coverage   68.23%   68.24%           
=======================================
  Files         287      287           
  Lines       25786    25808   +22     
  Branches     2882     2884    +2     
=======================================
+ Hits        17595    17612   +17     
- Misses       7713     7718    +5     
  Partials      478      478           

Impacted Files	Coverage Δ
flytekit/core/python_function_task.py	52.63% <66.66%> (+0.40%)	⬆️
tests/flytekit/unit/core/test_dynamic.py	93.06% <66.66%> (-4.61%)	⬇️
tests/flytekit/unit/core/test_local_cache.py	99.59% <100.00%> (+<0.01%)	⬆️
tests/flytekit/unit/core/test_type_engine.py	98.32% <100.00%> (ø)
flytekit/configuration/__init__.py	36.73% <0.00%> (+0.68%)	⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.