add sitemaps for mvp

[jason-upchurch]

Summary (required)

• Resolves Guidance doc search MVP #3599
• adds sitemaps for searches

Impacted areas of the application

• guidance doc search

[jason-upchurch]

@dorothyyeager @patphongs cc @AmyKort @PaulClark2 my portion of the MVP is ready for review (added Dorothy and Pat as reviewers on the sitemap. Dorothy might check the list matches what is needed, and perhaps Pat can do a technical review?).

example search showing that only the guidance docs are returned in search, to include pdf and html.

https://search.usa.gov/search?utf8=%E2%9C%93&affiliate=fec_content_s3&sort_by=&query=legal&commit=Search

cc @pkfec @JonellaCulmer

[dorothyyeager]

Missing one URL from the list - please add https://webforms.fec.gov/wfja/form99

One question - instead of the https://fec-prod-proxy.app.cloud.gov part of the adddress for the pdf files, shouldn't it be https://www.fec.gov/? cc: @patphongs (If yes, please replace.)

[jason-upchurch]

Missing one URL from the list - please add https://webforms.fec.gov/wfja/form99

One question - instead of the https://fec-prod-proxy.app.cloud.gov part of the adddress for the pdf files, shouldn't it be https://www.fec.gov/? cc: @patphongs (If yes, please replace.)

@dorothyyeager thank you, I will add that one! It may take time because of the additional domain, but will confirm. For the MVP I do not suggest we change the proxy to fec.gov domain. I suggest we work with search.gov to implement this in the second issue as a refinement (cc @patphongs)

[jason-upchurch]

Missing one URL from the list - please add https://webforms.fec.gov/wfja/form99

One question - instead of the https://fec-prod-proxy.app.cloud.gov part of the adddress for the pdf files, shouldn't it be https://www.fec.gov/? cc: @patphongs (If yes, please replace.)

@patphongs Can we double check that url @dorothyyeager is providing? I don't think we want the top level domain in the search. Should it be "https://www.fec.gov/updates/"?

[patphongs]

@jason-upchurch @dorothyyeager I think this would satisfy the MVP for now, in terms of making both HTML and PDF pages indexable using search.gov. We need to think more about the domain strategy. We don't want to use the proxy domain, but let's think about what we can use on the fec.gov domain instead, it could be subdomain

[codecov-io]

Codecov Report

Merging #3614 into develop will not change coverage by %.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop    #3614   +/-   ##
========================================
  Coverage    74.91%   74.91%           
========================================
  Files          120      120           
  Lines         7398     7398           
  Branches       652      652           
========================================
  Hits          5542     5542           
  Misses        1856     1856           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5c2d9a1...cd91c82. Read the comment docs.

[patphongs]

Changes look good @jason-upchurch, thank you!

[dorothyyeager]

Looks great! Thanks @jason-upchurch