pub / newsplanet

Planet-Style Newsfeed generated with perlanet
git clone https://src.jayvii.de/pub/newsplanet.git
Home | Log | Files | Exports | Refs | README | RSS

robots.txt (147B)

      1 # Allow all bots to poll the RSS & OPML endpoints
      2 User-Agent: *
      3 Allow: /*.xml$
      4 
      5 # Disallow all bots anywhere on the site
      6 User-agent: *
      7 Disallow: /