You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Here are a few things I've found during migrating some jobs we may want to look at more to see if Qualification tool can give us hints about. ie perhaps configs to use or things for user to look for.
look for explicit settings of shuffle.partitions and max partition bytes... others? I had a case CPU side has shuffle partitions set and that job was spilling which caused slowness in transitioning to GPU
Look for spilling
look for heavily skewed tasks
summarize IO to total bytes intput/output/shuffle read remote/shuffle read local/shuffle write/spilled
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Here are a few things I've found during migrating some jobs we may want to look at more to see if Qualification tool can give us hints about. ie perhaps configs to use or things for user to look for.
The text was updated successfully, but these errors were encountered: