Skip to content
MyDSHMy DSH Field Notes
中文
Independently maintained; not affiliated with DeepSeek. No association with mydsh.dev or other MyDSH sites.

Home/AI Exchange/AI Q&A

Asking an AI to compare two rc versions on plugin loading without getting fabrication

Wanting to know what actually changed between 0.2.1-rc.5 and 0.2.2-rc.1 and asking an AI directly.

VerifiedVersion and environmentChecked 2026-11-14
Host version
0.2.1-rc.5 / 0.2.2-rc.1
Checked
2026-11-14

Copyable command

npm view @deepseek-ai/[email protected] engines && npm view @deepseek-ai/[email protected] engines

An uncomfortable verdict first: asking 'what is the difference between these two rc versions' is the phrasing most likely to produce fabrication. RC changelogs are often thin or unpublished, so with no reliable basis the model supplies something plausible.

Ask yourself first: is there checkable evidence

Checkable evidenceWhereWhat it answers
The engines field on npmengines per version at registry.npmjs.orgWhether the node requirement changed (genuinely checkable)
Publish times on npmthe registry time fieldWhich shipped first (corrects 'bigger version is newer')
Dependency versionseach @deepseek-ai package version under dependenciesWhether internal components moved generation
CHANGELOG and release notesthe repo's releases pageOfficial notes on changes (often incomplete for rc)
MeasurementInstall both and run each onceBehavioural difference, the only trustworthy behavioural evidence

The checkable part: hard evidence

Item0.2.1-rc.50.2.2-rc.1
engines.nodenot declared>=24.9.0
Published2026-10-292026-11-04
bindsh to lib/bin.jsdsh to lib/bin.js
dsh-hmr and friendssame generationthe 0.2.2-rc.1 generation

This part belongs on a page, because it comes from files rather than memory.

The uncheckable part: make the AI admit ignorance

I want to know how @deepseek-ai/dsh behaves differently in 'plugin loading' between 0.2.1-rc.5 and 0.2.2-rc.1.

Answer in this format:
1. Differences you can confirm from publicly checkable sources: one line each with the source (which file, page, or field)
2. Parts you cannot confirm and can only infer: label them INFERRED and state the basis
3. What you do not know: write 'no reliable information'; do not fill with 'may' or 'usually'

Do not output anything like 'rc versions generally...' 
The load-bearing sentence is do not fill with may or usually. Without it you get three paragraphs of true-but-empty talk about rc versions being more stable, which looks like an answer and says nothing.

Most reliable: stop asking, start measuring

# Run the same plugin-loading task once per version and record actual behaviour
npm i -g @deepseek-ai/[email protected] && dsh --version
npm i -g @deepseek-ai/[email protected] && dsh --version

A behavioural difference counts only once you run it. Asking an AI gives you what others said; measuring gives you what happens here. Config also changes across the upgrade, so pair this with the config-diff page.

General principles for this class of question

  • Do not ask what can be looked up: engines, publish times, dependency versions come faster and truer from the registry.
  • For behaviour, run it: there is no reliable memory of a specific rc's runtime behaviour.
  • Require confirmed-versus-inferred separation; it is the only instruction that makes an answer honest.
  • Stop at 'usually': that word marks where it started filling blanks.

What counts as working

Check every line. All of them pass or the job is not done.

  • The checkable parts were looked up, not asked
  • The answer separates inferred from confirmed
  • 'rc versions are usually more stable' was not accepted as a conclusion

Where it fails

Symptom, cause, what to do — written in the order it actually happens.

SymptomCauseWhat to do
The AI produced a very plausible diffIt filled blanks without a reliable basisDemand a source per line; strike out whatever has none
Dependencies look identicalOnly top-level dependencies were readCheck whether each @deepseek-ai subpackage moved generation

Sources

Verified means measured here. Compiled means every line carries a source.