You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This may not be a .net specific issue, but it is hard to google and applies to .net as much as scala.
Is there any API for setting the description text that is associated with jobs in the Spark UI?
When I open the UI and look at the event timeline, there are jobs numbered 1 to 50 and they all have a similar appearance. The Description column simply says "org.apache.spark.deploy.dotnet.DotnetRunner.main" and there is a link to investigate the job details. After clicking the link, the job details aren't particularly meaningful either. Unless you memorize your driver code, and remember all the jobs and the order in which jobs are submitted, it is very hard to differentiate between the jobs in the Spark UI. Ideally the jobs could be given a short, meaningful descriptions so that and make the diagram much more useful/intelligible.
Is anyone aware of a technique for overriding the default text that is provided as the description of my jobs?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
This may not be a .net specific issue, but it is hard to google and applies to .net as much as scala.
Is there any API for setting the description text that is associated with jobs in the Spark UI?
When I open the UI and look at the event timeline, there are jobs numbered 1 to 50 and they all have a similar appearance. The Description column simply says "org.apache.spark.deploy.dotnet.DotnetRunner.main" and there is a link to investigate the job details. After clicking the link, the job details aren't particularly meaningful either. Unless you memorize your driver code, and remember all the jobs and the order in which jobs are submitted, it is very hard to differentiate between the jobs in the Spark UI. Ideally the jobs could be given a short, meaningful descriptions so that and make the diagram much more useful/intelligible.
Is anyone aware of a technique for overriding the default text that is provided as the description of my jobs?
Beta Was this translation helpful? Give feedback.
All reactions