Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove SGID.TRANSPORTATION.UDOTMileposts from SGID #284

Closed
25 of 27 tasks
gregbunce opened this issue Dec 22, 2023 · 17 comments
Closed
25 of 27 tasks

Remove SGID.TRANSPORTATION.UDOTMileposts from SGID #284

gregbunce opened this issue Dec 22, 2023 · 17 comments
Labels
deprecation Removing data and or a service porter issue related to adding and removing data and services

Comments

@gregbunce
Copy link
Contributor

gregbunce commented Dec 22, 2023 •
edited by rkelson
Loading

Summary

A short summary of the situation.
This layer has been deprecated by UDOT and has been replaced by the following service: Physical Location of Reference Post (RP) Open Data. UGRC's Transportation page points users to this new service.

The replacement data for this dataset is also in the Internal SGID named,
Transportation.UDOT_MileReferencePosts. The basemaps, etc should point to that layer.

Migration Guide

Users should be using UDOT's Physical Location of Reference Post (RP) Open Data as a replacement or Transportation.UDOT_MileReferencePosts who is in Internal SGID.

Action items

  1. Assign a person who should complete the task by replacing name with their github @name.
  2. Check [x] the box when the task is completed and add the date of completion.
  3. Strike out all items that do not apply.

Soft Delete

The purpose of the soft delete is to ensure that all of our users and applications have gracefully migrated off of the dataset. Soft deletes will remain in effect for 14 days. During this time, we will have the ability to restore the dataset to its original SGID offering(s). After these 14 days, the item is then ready for a hard delete.

Note: If this dataset is being replaced, then wait until the new data is publicly available before completing these steps:

  • Append "(Mature Support)" to the end of the item title in the SGID.META.AGOLItems table (@DenisePeterson, completed: 2024/01/03)
  • Remove all tags other than "Deprecated" in the SDE metadata (@DenisePeterson, completed: 2024/01/03)
  • Add note to SDE description noting when layer will be deleted and any replacement layer (@DenisePeterson, completed: 2024/01/03)
  • Update the SGID Index row as deprecated by pasting the related Porter issue URL in the Deprecated field (@gregbunce, completed: 2023/12/22)
  • Change Authoritative field to d in SGID.META.AGOLItems to automatically set the Deprecated AGOL flag. Allow the d to persist through one run of Auditor - currently, Auditor runs daily at 5:00am (@gregbunce, completed: 2023/12/22)
    • After at least one successful run of Auditor:
      • Remove the row from the SGID.META.AGOLItems table. This will trigger the removal of this item in Open SGID (@DenisePeterson, completed: 2024/01/03)
      • Unshare the item from its SGID group, which will remove it from Open Data (@DenisePeterson, completed: 2024/01/03)

Hard Delete

Hard deletes are final. It is recommended to complete the soft delete process before moving on to these steps. If you decide to skip the soft delete, note that you will need to incorporate some of those steps here.

  • Manually remove data from the Internal SGID (@DenisePeterson, completed: 2024/01/18)
  • Remove ArcGIS Online item: (@DenisePeterson, completed: 2024/01/18)
    • Manually delete the AGOL item
    • -OR-
      - Unshare by changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to something other than an Item ID and manaually changing the sharing settings (remove the item from all SGID groups, remove Public sharing),
    • -OR-
      - Shelve the data by copying the row from SGID.META.AGOLItems to the AGOLItems_shelved table in AGOL and changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to shelved or some other note.
      - Deprecated AGOL items can be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > agol_sgid_layers.
      - [ ] Remove Farm from AGOL connection (name, completed: 2023/00/00)
  • Update relevant gis.utah.gov data pages (@gregbunce, completed: 2023/12/21)
  • Add this porter url to the Deprecated field of the Stewardship record (@gregbunce, completed: 2023/12/21)
  • Update SGID.META.AGOLItems table (@DenisePeterson, completed: 2024/01/18)
    - cut and paste row to AGOLItems_shelved table if shelving (see below)
    - set the AGOL_ITEM_ID field to hosted by <agency> for Farm from AGOL
    - set the AGOL_ITEM_ID field to exclude from AGOL to not publish to ArcGIS Online
    - [ ] Delete Google Drive data (name, completed: 2023/00/00)
  • Remove row from SGID.META.ChangeDetection (@stdavis, completed: 2023/00/00)
    • this was already done
  • Remove data from forklift hashing and receiving (@stdavis, completed: 2024/01/29)
  • Remove row from data/hashed/changedetection.gdb/TableHashes (@stdavis, completed: 2024/01/29)

Shelve/Static

Choose one based on situation.

- [ ] Upload to UtahAGRC/AGRC_Shelved folder in AGOL (New shelved item not already in AGOL) (name, completed: 2023/00/00)
- [ ] Move existing AGOL item to AGRC_Shelved AGOL folder (shelving an item already in AGOL) (name, completed: 2023/00/00)
- [ ] Upload to appropriate UtahAGRC/{SGID Category} folder in AGOL (for static datasets) (name, completed: 2023/00/00)

Add record to table.

- [ ] Add record to AGOLItems_shelved table in ArcGIS Online with shelved or static in the CATEGORY field (name, completed: 2023/00/00)

🤖 Automation validation

  1. Assign yourself or someone to check the item by replacing name with their github @name.
  2. Check [x] the box and add the date of verification 2020/01/01 when the task is verified.
  3. Strike out all items that do not apply.
  • Remove data from Open SGID (name on 2024/01/22)
  • sgid-index (@steveoh on 2024/01/22)
  • Auditor sets appropriate Deprecated information (@jacobdadams on 2023/12/23)

Are there service dependencies

  • Are clients querying this data with the WebAPI?
  • Notify Don Jackson (at motorolasolutions.com) if the data is in the Next-Generation 911 Motorola Aware Map? (@gregbunce on 2023/12/022)
  • Does any other application depend on this data?
  • Update base maps (@ZachBeck on 2024/01/30)

Notification

Group Task Assignments

  1. Check [x] the box when you have assigned all the tasks relevant to your group.
@gregbunce gregbunce added deprecation Removing data and or a service porter issue related to adding and removing data and services labels Dec 22, 2023
@gregbunce gregbunce changed the title Remove SGID.TRANSPORTATION.UDOTMileposts from Internal SGID Remove SGID.TRANSPORTATION.UDOTMileposts from SGID Dec 22, 2023
@gregbunce gregbunce mentioned this issue Dec 22, 2023
Closed
6 tasks
@steveoh
Copy link
Member

steveoh commented Dec 22, 2023

Did we want to keep this in opensgid and internal for base maps etc or wipe it all out?

@gregbunce
Copy link
Contributor Author

Good point on the basemaps. I should have made that more clear. Yup, the replacement data for this dataset is also in the Internal SGID named,
Transportation.UDOT_MileReferencePosts. The basemaps, etc should point to that layer.

I’ll update the content above to clarify that.

Thanks.

@agrc-conductor
Copy link

conductor results for tasks - 284

check status
@DenisePeterson has completed 0 out of 9 tasks ⛔
gregbunce has completed 6 out of 6 tasks 👍
@steveoh has completed 0 out of 5 tasks ⛔
@stdavis has completed 0 out of 1 tasks ⛔
@jacobdadams has completed 0 out of 1 tasks ⛔
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for tasks - 284

check status
@DenisePeterson has completed 0 out of 9 tasks ⛔
gregbunce has completed 6 out of 6 tasks 👍
@steveoh has completed 0 out of 5 tasks ⛔
@stdavis has completed 0 out of 1 tasks ⛔
jacobdadams has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for tasks - 284

check status
@DenisePeterson has completed 5 out of 9 tasks ⛔
gregbunce has completed 6 out of 6 tasks 👍
@stdavis has completed 0 out of 3 tasks ⛔
@steveoh has completed 2 out of 3 tasks ⛔
jacobdadams has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

1 similar comment
@agrc-conductor
Copy link

conductor results for tasks - 284

check status
@DenisePeterson has completed 5 out of 9 tasks ⛔
gregbunce has completed 6 out of 6 tasks 👍
@stdavis has completed 0 out of 3 tasks ⛔
@steveoh has completed 2 out of 3 tasks ⛔
jacobdadams has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for TRANSPORTATION.UDOTMileposts

check status
internal sgid ⛔
meta table 👍
stewardship
- deprecation issue link 👍

@stdavis
Copy link
Member

stdavis commented Jan 15, 2024

@ZachBeck Should I add a task for you to update the base maps before this dataset is removed from internal? Or is it something that a GIS-monkey like me could do?

@ZachBeck
Copy link
Member

Either way.... I think this layer uses a python label expression so it might be a little more involved than repointing to a new data source.

@agrc-conductor
Copy link

conductor results for tasks - 284

check status
DenisePeterson has completed 9 out of 9 tasks 👍
gregbunce has completed 6 out of 6 tasks 👍
@stdavis has completed 0 out of 3 tasks ⛔
@steveoh has completed 2 out of 3 tasks ⛔
jacobdadams has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for TRANSPORTATION.UDOTMileposts

check status
internal sgid 👍
meta table 👍
stewardship
- deprecation issue link 👍

@agrc-conductor
Copy link

conductor results for tasks - 284

check status
DenisePeterson has completed 9 out of 9 tasks 👍
gregbunce has completed 6 out of 6 tasks 👍
@stdavis has completed 0 out of 3 tasks ⛔
steveoh has completed 3 out of 3 tasks 👍
jacobdadams has completed 1 out of 1 tasks 👍
@ZachBeck has completed 0 out of 1 tasks ⛔
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for TRANSPORTATION.UDOTMileposts

check status
internal sgid 👍
meta table 👍
stewardship
- deprecation issue link 👍

@agrc-conductor
Copy link

conductor results for tasks - 284

check status
DenisePeterson has completed 9 out of 9 tasks 👍
gregbunce has completed 6 out of 6 tasks 👍
stdavis has completed 3 out of 3 tasks 👍
steveoh has completed 3 out of 3 tasks 👍
jacobdadams has completed 1 out of 1 tasks 👍
@ZachBeck has completed 0 out of 1 tasks ⛔
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for TRANSPORTATION.UDOTMileposts

check status
internal sgid 👍
meta table 👍
stewardship
- deprecation issue link 👍

@agrc-conductor
Copy link

conductor results for tasks - 284

check status
DenisePeterson has completed 9 out of 9 tasks 👍
gregbunce has completed 6 out of 6 tasks 👍
stdavis has completed 3 out of 3 tasks 👍
steveoh has completed 3 out of 3 tasks 👍
jacobdadams has completed 1 out of 1 tasks 👍
ZachBeck has completed 1 out of 1 tasks 👍
rkelson has completed 1 out of 1 tasks 👍

@agrc-conductor
Copy link

conductor results for TRANSPORTATION.UDOTMileposts

check status
internal sgid 👍
meta table 👍
stewardship
- deprecation issue link 👍

@steveoh steveoh closed this as completed Feb 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
deprecation Removing data and or a service porter issue related to adding and removing data and services
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@steveoh @stdavis @ZachBeck @gregbunce @agrc-conductor