Prompt: LLMs emit URLs that do not exist

[amotl]

Problem

LLMs hallucinate, in this case about URLs. The question was:

"CrateDB does not seem to provide an AUTOINCREMENT feature?"

Details

Both text fragments include URLs that don't exist, or are wrong. The correct URL would be https://cratedb.com/docs/guide/performance/inserts/sequences.html.

CrateDB does not offer automatic incrementing IDs due to distributed scaling concerns. Use UUIDs, timestamps, or an application-managed sequence as needed. See the CrateDB documentation: Autogenerated sequences and PRIMARY KEY values for examples and best practices.

CrateDB: Autogenerated sequences and PRIMARY KEY values

CrateDB Community: Sequences in distributed databases

Reproduce

The command was:

uvx llm --model gpt-4.1 \
  --fragment https://cdn.crate.io/about/v1/llms-full.txt \
  --system-fragment https://cdn.crate.io/about/v1/instructions-general.md \
  "CrateDB does not seem to provide an AUTOINCREMENT feature?"

[amotl]

More non-existing URLs.

ask "Please tell me how CrateDB stores data."

• CrateDB Feature: Hybrid Index
• CrateDB Feature: Storage Layer
• CrateDB Guide: Sharding Performance Guide