Code

Support custom robots.txt#5086

Code

Merged

humitos merged 10 commits intomasterreadthedocs/readthedocs.org:masterfrom humitos/custom-robots-txtreadthedocs/readthedocs.org:humitos/custom-robots-txtCopy head branch name to clipboardJan 16, 2019

+161-1

Commits

Commits on Jan 16, 2019

• Support custom robots.txt

  Show description for 3fc254f
  humitos

  committed
  3fc254f

  Copy full SHA for 3fc254f

• Proper URL formatting

  humitos

  committed
  5d2c24c

  Copy full SHA for 5d2c24c

• Explicit Allow/Disallow instead of 404

  humitos

  committed
  65c8904

  Copy full SHA for 65c8904

• FAQ documentation for robots.txt file

  humitos

  committed
  52588a3

  Copy full SHA for 52588a3

• Use return for HttpResponse

  humitos

  committed
  988c46b

  Copy full SHA for 988c46b

• Do not serve the robots.txt file if private or version not active/built

  humitos

  committed
  5ccc878

  Copy full SHA for 5ccc878

• Rephrase question

  Show description for 38d8120
  

  ericholscher

  and

  humitos

  committed
  38d8120

  Copy full SHA for 38d8120

• Add content_type to default response

  humitos

  committed
  4724811

  Copy full SHA for 4724811

• any() call fixed

  humitos

  committed
  19b5209

  Copy full SHA for 19b5209

• Tests for serving default and custom robots.txt file (public/private)

  humitos

  committed
  3e4b1a4

  Copy full SHA for 3e4b1a4