Skip to content

About

Free WordPress plugin that publishes /llms.txt and /llms-full.txt for language models (per language with WPML or Polylang) and manages AI crawlers in robots.txt.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

4 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Threecommerce LLMs.txt: llms.txt and llms-full.txt for WordPress, per language, with AI crawler control

A WordPress plugin that publishes /llms.txt and /llms-full.txt, the files designed for language models (ChatGPT, Claude, Perplexity, Gemini...) following the llmstxt.org specification, and lets you allow or block AI crawlers in robots.txt from the admin. Unlike the built-in feature of other SEO plugins, the files are generated on the fly and per language, with no duplicate URLs between translations.

The generated /llms.txt file with title, summary, pages, articles and optional links

Compatibility: WordPress 6.0+ · PHP 8.1 – 8.4 · Works with WPML and Polylang License: free · Current version: see Releases

Features

  • /llms.txt: title, summary, intro text and sections listing public pages, posts and other content types (custom post types too, for example WooCommerce products) with one description per line; optionally categories; an Optional section with the sitemap and extra links.
  • /llms-full.txt: the same content in full, converted to Markdown (headings, links, lists, tables, code). Maximum size 2 MB.
  • Multilingual with WPML or Polylang: every language has its own file (/en/llms.txt) with only its content and, if you want, its own title, summary, intro and extra links.
  • Descriptions: manual excerpt, otherwise the Yoast SEO meta description, otherwise the first 30 words.
  • Exclusions: pages and posts with noindex (Yoast SEO) and password-protected ones are always excluded; extra IDs can be excluded from the panel.
  • AI crawlers: for each major bot (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, Applebot-Extended, meta-externalagent, CCBot) choose Not specified, Allow or Block; the plugin adds the User-agent groups to the WordPress robots.txt.
  • Cache: files are cached by type and language and rebuilt when content, a category or the settings change. Response is text/plain; charset=utf-8 with X-Robots-Tag: noindex, no BOM.
  • Developer hooks: wp_llmstxt_query_args, wp_llmstxt_post_html, wp_llmstxt_full_max_bytes.

Plugin settings page: content types, exclusions, title, summary, introduction and extra links

Requirements

  • WordPress 6.0 or newer
  • PHP 8.1 – 8.4
  • PHP extensions dom and mbstring
  • Pretty permalinks enabled (no need to regenerate them)

Installation

The plugin is free. Get the zip from the product page (free order, then download it from My Account), then in WordPress go to Plugins → Add New → Upload Plugin, upload the zip and activate it.

Configuration

WordPress admin → Settings → LLMs.txt: enable the two files, content types and categories to include, maximum per type, IDs to exclude, title, summary, intro text, extra links, per-language texts and the AI crawler policy. If a physical llms.txt exists in the site folder (for example the one generated by Yoast SEO) the web server serves it instead of the plugin: disable that feature and delete the file; the plugin panel warns you when it finds it.

Documentation and support


This repository is the public showcase of the plugin. The source code is kept in a private repository.

About

Free WordPress plugin that publishes /llms.txt and /llms-full.txt for language models (per language with WPML or Polylang) and manages AI crawlers in robots.txt.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors