Simple robots.txt middleware for Express

Features

• Generates a robots.txt at /robots.txt
• Includes the default function with configuration from the application config

Bootstrap

Config

No config implemented

Implementation

const robotsTxt = require('./middleware/robotsTxt');

this.server.use(robotsTxt(this, this.config.robotsTxt));

Usage

Config

{
  "robotsTxt": {
    "disallowAll": true,
    "useDrupalRobots": false,
    "disallowRules": []
  }
}

Links

No links available