# llms.txt > A proposal that those interested in providing LLM-friendly content add a /llms.txt file to their site. This is a markdown file that provides brief background information and guidance, along with links to markdown files providing more detailed information.

Everyone is permitted to copy and distribute verbatim copies. of this license document, but changing it is not allowed. Preamble. The GNU General Public License is a free, copyleft license for. software and other kinds of works. The licenses for …

:Product: Daily Solar Data DSD.txt :Issued: 0225 UT 04 Feb 2025 # # Prepared by the U.S. Dept. of Commerce, NOAA, Space Weather Prediction Center # Please send comments and suggestions to [email protected] # # Last 30 Days Daily Solar Data # # Sunspot Stanford GOES15 # Radio SESC Area Solar X-Ray ----- Flares ----- # Flux Sunspot 10E-6 …

# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources.

``.txt`` File Formats ===== Files described in this section that have ``.txt`` extensions have a simple lexical format consisting of a sequence of text lines, each line terminated by a linefeed character (regardless of platform).

# robots.txt file for YouTube # Created in the distant future (the year 2000) after # the robotic uprising of the mid 90's which wiped out all humans.

# robots.txt for www.espn.com User-agent: claritybot Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow ...

# Our robots.txt is for search engines # 80legs User-agent: 008 Disallow: / # 80legs' new crawler User-agent: voltron Disallow: / User-Agent: bender Disallow: /my ...

# robots.txt for https://www.imdb.com properties # See https://m.imdb.com/robots.txt for the mDot equivalent User-agent: * Disallow: /OnThisDay Disallow: /*/OnThisDay ...

21,986 names (names.txt) This database contains the most common names used in the United States and Great Britain. Spelling checkers may want to supplement their basic word list with this one.