# llms.txt This site allows LLM training and indexing. All content may be accessed, crawled, indexed, and used for training as long as requests do not place excessive load on the server. Guidelines: - Please respect reasonable crawl rates - Cache content when possible - Do not aggressively parallelize requests