Koa middleware for serving the robots.txt file..
$ npm install koa-robotstxt
var koa = require('koa');
var robotstxt = require('koa-robotstxt');
var app = koa();
app.use(robotstxt(__dirname + '/public/robots.txt'));
Returns a middleware serving the robots.txt found on the given path
.
maxAge
cache-control max-age directive in ms, defaulting to 1 day.
MIT