[meta] 2018 I/O Burndown

[paulirish]

Channeling our ancestors, we introduce this year's abbreviated I/O burndown list. Also, heads up there are some duplicate checkboxes between here and #4333.

🎯 ✅ Gotta happen

LHR / Config / API [bckenny]

• decide on groups/tags/scoredisplaymode
• Submit lhr-lite CL to oneplatform Resolve LHR differences between master/LHR-Lite/external service #4867
• node module return is {lhr, artifacts} core(runner): split lhr, artifacts return, respect output type #4999
• support 'html'/'csv' output from node module core(runner): split lhr, artifacts return, respect output type #4999
• String/printf displayValue [@phulce] core(lhr): support printf displayValues #5099
• Introduce new details's type:'metric'
• Introduce new details's type:'opportunity' core(lhr): migrate opportunity details to new format #5296
• Update scoreDisplayMode, remove booleans, support null scores core(lhr): drop informative/manual, moving them to scoreDisplayMode #5105
• rename perf-hint => opportunities, perf-info => diagnostics, perf-metric => metrics core(lhr): rename perf-hint, perf-info, etc #5102
• Introduce manualDescription core(category): add manualDescription #5100
• update metrics.js output to be consumable from HTTPArchive. core(metrics): consumable metrics audit output #5101
• LHR extends LHR-lite
• Remove extendedInfo Improve LHR API shape for downstream consumers #4614
  • Initial: exclude it from LHR via createAuditResult but audits still report (so our audit tests don't need massive updates
  • Take inventory of extendedInfo data that's currently not in the associated details block, but should be. (here's what HA uses, what brendan uses)
  • Update all those tests
• Apply necessary LHR-lite naming changes core(lhr): lhr-lite type declaration #4983:
  • initialUrl -> requestedUrl, url -> finalUrl core(lhr): s/initialUrl/requestedUrl, s/url/finalUrl #5127
  • fetchedAt -> fetchTime, remove generatedTime core(lhr): s/fetchedAt/fetchTime #5112
  • reportCategories -> categories, categories from arrays to keyed objects core(lhr): convert reportCategories to categories object #5155
  • reportGroups -> categoryGroups core(lhr): convert reportCategories to categories object #5155
  • runtimeConfig -> simplified settings in LHR and create runtimeConfig in report renderer core(lhr): move runtime config to report, configSettings #5122
  • remove Category.id (maybe don't need)
  • category: name -> title, audits -> auditRefs core(lhr): s/audits/auditRefs, s/category.name/category.title/ #5157
  • audit: name => id, description -> title, helpText -> description
  • debugString -> explanation core(lhr): remove debugString, add explantion/errorMessage #5132
  • debugString sometimes errorMessage instead core(lhr): remove debugString, add explantion/errorMessage #5132
• make score required part of Audit.product instead of rawValue. Get rid of rawValue (if we can agree on place (details?) to put metric raw values)

Breaking core changes/Lanternification [phulce]

• Switch to lantern-run by default core(config): switch to lantern by default, add presets #5041
• make TTI adjustments (FCP-based, network quiet fixes, etc) core(tti): update ignorable network requests and start point #5021
• Lantern-based EIL core(metrics): add lantern EIL #5024
• All opportunities work with Lantern
  • render blocking core: merge render blocking audits to lantern #4995
  • redirects core(redirects): use lantern to compute savings #5081
  • rel preload core(preload): use lantern to compute savings #5062
  • preconnect core(preconnect): use lantern to compute savings #5070
  • use max(TTI, end of load) for savings core(opportunities): take max of savings on TTI, load #5084
  • offscreen images core(opportunities): take max of savings on TTI, load #5084
• Score: apply new scoring Perf Metrics & Scoring vNext #4629 core(scoring): tweak performance weights #5083

Report redesign [paulirish]

see Lantern UX - Google Slides 🔐 and Lighthouse Report - Gallery 🔐

• Revised Score gauges. Category score legend
• Rich tooltips for scores and metrics
• Use rich tooltip for audit errors report: error'd audits get 'Error!' treatment #5077
• Metric display.
  • new table layout. icons.
  • Heading and disclaimer text
• Diagnostics display report: new audit list display, indexes & new icons #5109
  • audit list indexes should be cumulative within categorySections (pass/fail/notApplicable even when there are groups within those)
• Opportunity display report: implement new design for opportunities #5115
• new details table display (toggle arrow and column headers)
• Fix focus outline oddness (toggle-arrow and tooltip interaction)
• Filmstrip?
• Adopt tooltip for learnMore text. Improve the usability of that text.
• Change to branded header
• write renderer tests for all audit/error/displayMode/debugString/warning/explanation combinations.
• warnings/displayValue rendering: Redesign displayValue/warnings #5153

Roll out 3.0 [paulirish@, phulce@]

• Release alpha version of 3.0 prior to I/O for internal testing (sometime during week of 5/2).
• Roll out 3.0 to CLI as a release candidate
• Roll out 3.0 to Chrome Extension as default
• Add Lantern opt-put to Chrome Extension under 'Options' (Hwi to create mock).
• ship 3.0 final to CLI

🌆 ☑️ Nice to have

Core

• Move computed artifacts off artifacts.*. Require them explicitly instead of fs.readdir bizness
• Use LHError for all thrown errors when possible (connections/cri.js for example)
• replace --perf with a real mechanism for using full/perf/mixed-content configs core(config): switch to lantern by default, add presets #5041
• Generate closure externs for reportrenderer for DevTools. Update its JSDoc for TS. Thus, enabling compilation with both TS & CC
• Smoketests work with lantern

LHR

• Fix allowed config representations (config v2 😃 , i.e. no more audits: ['path/my-audit'] -> audits: { 'my-audit': {path: 'path/to/audit'}})
• Use fallbackKey/fallbackValueType for multi-typed columns (code snippets sometimes instead of URLs)?

Report

• Split opportunities by First Paint improvements and "Load Improvements"

🏈 🏖 Punt till after I/O

• Update default device settings
  • Throttling: change the preset Recalibrate proposal for default network preset for LH #4594
  • Change device from Nexus 5X to Pixel?
• Roll out 3.0 to Lighthouse on DT

🐞from I/O

• freezes on https://emojityper.com/
• font display audit shows non-lantern download time
• Unused CSS Rules/Minify Css audit name inconsistent
• tons of warnings on www.ctvnews.ca
• minimum timeline scale should be ~3-10s
• minimum opportunity scale should be ~2s
• first audit is misaligned
• "is on https" audit shouldn't fail if it redirects
• Third party filter in the report
• Third party blame report (to the LH user, or better, at a web-wide level)

[vinamratasingal-zz]

I added stuff for tracking the release process @paulirish @patrickhulce @brendankenny FYI.

Let me know who to assign as the owner.