jobs, sql, ui: Create AutoCreateStats job type
#35651
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
This change is |
|
this is awesome! |
|
This is great! Do currently-running auto-stats jobs still show up in the default view or have they all been moved to this subview? |
With cockroachdb#34279, enabling the cluster setting `sql.stats.experimental_automatic_collection.enabled` has the potential to create many CreateStats jobs, which can cause the Jobs view on the AdminUI to become cluttered. This commit creates a new `AutoCreateStats` job type for these auto-created CreateStats jobs, so that users are able to still see their own manual runs of CREATE STATISTICS, via the pre-existing `CreateStats` type.  Release note (admin ui change): AutoCreateStats type added to Jobs page to filter automatic statistics jobs. Fixes cockroachdb#34377.
celiala
force-pushed
the
AutoCreateStats
branch
from
2958038 to
6c1e1ac
Compare
|
Yep! In the default view (All types, All statuses), you'll still see currently-running auto-stats jobs. |
|
TFTR! bors r+ |
|
|
Build failed (retrying...) |
|
Nice :) Maybe someday auto-stats jobs should be filtered out by default (i.e. you should see everything but them). Not sure what the UI would be tho. Maybe instead of a simple selector dropdown for job type, it's a checkbox dropdown, where by default everything but "auto stats job" is checked? 🤔 Anyway, this is a good step forward 👍 |
|
Agreed with Pete, eventually we should filter out the automated create stats jobs on the default view since the sheer number of them makes it hard to find much without filtering. |
Canceled (will resume) |
craig bot
pushed a commit
that referenced
this pull request
Mar 12, 2019
35321: opt: propagate set operation output types to input columns r=rytaft a=rytaft This commit updates the `optbuilder` logic for set operations in which the types of the input columns do not match the types of the output columns. This can happen if a column on one side has type Unknown, but the corresponding column on the other side has a known type such as Int. The known type must be propagated to the side with the unknown type to prevent errors in the execution engine related to decoding types. If there are any column types on either side that don't match the output, then the `optbuilder` propagates the output types of the set operation down to the input columns by wrapping the side with mismatched types in a Project operation. The Project operation passes through columns that already have the correct type, and creates cast expressions for those that don't. Fixes #34524 Release note (bug fix): Fixed an error that happened when executing some set operations containing only nulls in one of the input columns. 35587: opt: add more cost for lookup joins with more ON conditions r=RaduBerinde a=RaduBerinde This is a very limited fix for #34810. The core problem is that we don't take into account that if we have an ON condition, not only there's a cost to evaluate it on each row, but we are generating more internal rows to get a given number of output rows. I attempted to do a more general fix (for all join types), where I tried to estimate the "internal" number of rows using `unknownFilterSelectivity` for each ON condition. There were two problems: - in some cases (especially with lookup joins) we have an extra ON condition that doesn't actually do anything: `ab JOIN xy ON a=x AND a=10` becomes `ab JOIN xy ON a=x AND a=10 AND x=10` becomes and `a=10` could remain as an ON condition. This results in bad query plans in important cases (e.g. TPCC) where it prefers to do an extra lookup join (due to a non-covering index) just because of that condition. - we don't have the equality columns readily available for hash join (and didn't want to extract them each time we cost). In the future we may split the planning into a logical and physical stage, and we should then separate the logical joins from hash join. For 19.1, we simply simply add a cost for lookup joins that is proportional to the number of remaining ON conditions. This is the least disruptive method that still fixes the case observed in #34810. I will leave the issue open to address this properly in the next release. Note that although hash joins and merge joins have the same issue in principle, in practice we always generate these expressions with equality on all possible columns. Release note: None 35630: storage/tscache: Pick up andy-kimball/arenaskl fix r=nvanbenschoten a=nvanbenschoten Fixes #31624. Fixes #35557. This commit picks up andy-kimball/arenaskl#4. I strongly suspect that the uint32 overflow fixed in that PR was the cause of the two index out of bounds panics. See that commit for more details. The PR also fixes a bug in memory recylcling within the tscache. I confirmed on adriatic that over 900 64MB arenas had been allocated since it was last wiped. 35644: opt: use correct ordering for insert input in execbuilder r=RaduBerinde a=RaduBerinde We were setting up a projection on the Insert's input but we were accidentally using the parent Insert's ordering instead of that of the input. Fixes #35564. Release note (bug fix): Fixed a "column not in input" crash when `INSERT ... RETURNING` is used inside a clause that requires an ordering. 35651: jobs, sql, ui: Create `AutoCreateStats` job type r=celiala a=celiala With #34279, enabling the cluster setting `sql.stats.experimental_automatic_collection.enabled` has the potential to create many CreateStats jobs, which can cause the Jobs view on the AdminUI to become cluttered. This commit creates a new `AutoCreateStats` job type for these auto-created CreateStats jobs, so that users are able to still see their own manual runs of CREATE STATISTICS, via the pre-existing `CreateStats` type. cc @danhhz, @piyush-singh, @rolandcrosby  Release note (admin ui change): AutoCreateStats type added to Jobs page to filter automatic statistics jobs. Fixes #34377. Co-authored-by: Rebecca Taft <[email protected]> Co-authored-by: Radu Berinde <[email protected]> Co-authored-by: Nathan VanBenschoten <[email protected]> Co-authored-by: Celia La <[email protected]>
Build succeeded |
celiala
added a commit
to celiala/cockroach
that referenced
this pull request
Mar 15, 2019
- Fixed spacing for tooltip copy - Fixed styling bug that was introduced in cockroachdb#35651: Job description previously truncated long job descriptions in collapsed view. Tooltip copy - before: <img width="300" alt="jobs before" src="https://user-images.githubusercontent.com/3051672/54454081-0be36e00-472f-11e9-8fc2-7e59b4565d51.png"> Tooltip copy - after: <img width="300" alt="fix tooltip-spacing" src="https://user-images.githubusercontent.com/3051672/54454082-0be36e00-472f-11e9-9683-3b63490fbfe1.png"> Job description - before: <img width="400" alt="broken text-wrapping" src="https://user-images.githubusercontent.com/3051672/54454213-58c74480-472f-11e9-81fd-7e075510d96f.png"> Job description - after: <img width="400" alt="fix text-overflow" src="https://user-images.githubusercontent.com/3051672/54454227-5e248f00-472f-11e9-96b3-2f38a7b6dd6e.png"> Release note: None Fixes: cockroachdb#35604
celiala
added a commit
to celiala/cockroach
that referenced
this pull request
Mar 15, 2019
- Fixed spacing for tooltip copy - Fixed styling bug that was introduced in cockroachdb#35651: Job description previously truncated long job descriptions in collapsed view. Tooltip copy - before: <img width="300" alt="jobs before" src="https://user-images.githubusercontent.com/3051672/54454081-0be36e00-472f-11e9-8fc2-7e59b4565d51.png"> Tooltip copy - after: <img width="300" alt="fix tooltip-spacing" src="https://user-images.githubusercontent.com/3051672/54454082-0be36e00-472f-11e9-9683-3b63490fbfe1.png"> Job description - before: <img width="400" alt="broken text-wrapping" src="https://user-images.githubusercontent.com/3051672/54454213-58c74480-472f-11e9-81fd-7e075510d96f.png"> Job description - after: <img width="400" alt="fix text-overflow" src="https://user-images.githubusercontent.com/3051672/54455816-16076b80-4733-11e9-94e5-f24312ac6ff1.png"> Release note: None Fixes: cockroachdb#35604
craig bot
pushed a commit
that referenced
this pull request
Mar 17, 2019
35797: ui: fix word-wrapping and tooltip spacing on jobs page r=celiala a=celiala - Fixed spacing for tooltip copy - Fixed styling bug that was introduced in #35651: Job description previously truncated long job descriptions in collapsed view. Tooltip copy - before: <img width="300" alt="jobs before" src="https://user-images.githubusercontent.com/3051672/54454081-0be36e00-472f-11e9-8fc2-7e59b4565d51.png"> Tooltip copy - after: <img width="300" alt="fix tooltip-spacing" src="https://user-images.githubusercontent.com/3051672/54454082-0be36e00-472f-11e9-9683-3b63490fbfe1.png"> Job description - before: <img width="400" alt="broken text-wrapping" src="https://user-images.githubusercontent.com/3051672/54454213-58c74480-472f-11e9-81fd-7e075510d96f.png"> Job description - after: <img width="400" alt="fix text-overflow" src="https://user-images.githubusercontent.com/3051672/54455816-16076b80-4733-11e9-94e5-f24312ac6ff1.png"> Release note: None Fixes: #35604 Co-authored-by: Celia La <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
With #34279, enabling the cluster setting
sql.stats.experimental_automatic_collection.enabledhas the potentialto create many CreateStats jobs, which can cause the Jobs view on the
AdminUI to become cluttered.
This commit creates a new
AutoCreateStatsjob type for these auto-createdCreateStats jobs, so that users are able to still see their own manual runs
of CREATE STATISTICS, via the pre-existing
CreateStatstype.cc @danhhz, @piyush-singh, @rolandcrosby
Release note (admin ui change): AutoCreateStats type added to
Jobs page to filter automatic statistics jobs.
Fixes #34377.