# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Disallow: /admins/password/new Disallow: /admins/sign_in Disallow: /users/password/new Disallow: /users/camapigns/new Disallow: /campaigns/embed Disallow: /projects/embed Disallow: /places/embed Disallow: /followers/new Disallow: /get_involveds/new Disallow: /donations/new User-agent: GPTBot Disallow: /