Develop www.fec.gov sitemap

[patphongs]

Summary

What we're after:
We want to use sitemap.xml for both search engines and the specializations for search.gov. This ticket is to have a POC on a non-Prod space, and to do its initial QA

Related issues:
Research into ways to create the sitemap: #5499
Document searech.gov sitemap requirements #5501 (comment)
Policy and Guidance sitemap changes: #5595

Completion criteria

• sitemap.xml prototype has been rolled out on Feature
• QA on Feature has been completed
  • We have a plan for Production rollout or
  • we've created tickets for fixes/changes

Tech steps or considerations

• Set up a search.gov sandbox for testing (to keep QA interactions separate from Production)
• QA - Make sure global site search results do not appear in guidance search results
• Decide purpose of various sitemaps (e.g. which will go to search engines, which will be used for search.gov)
• Do we want to show robots.txt on Production? (its default content is only to block everything for non-Prod) If so, we could link robots.txt to include /sitemap.xml
• Any complications in using /sitemap.xml to link to other specialized sitemaps? (/sitemap.xml could link to /sitemap-search.xml, /sitemap-legal.xml, /sitemap-transition.xml, etc)

Future work

Other future work that may be needed following this issue's completion.

[dorothyyeager]

Closing, seems to be a duplicate of #5775

[johnnyporkchops]

Since this issue includes sitemaps for search engiines other than search.gov, we are keeping it open so we don't forget that work.