Readme Trial
A README tester app idea: find out whether anyone can follow your README. One week build with Next.js, Docker and Claude API, for open-source maintainers and teams with setup docs.
Why now
"I paid people to try and follow my README" drew 431 points and 206 comments on Hacker News on Oct 11. Plenty of tools generate READMEs, but far fewer check whether the instructions work. An agent in a clean sandbox is a cheap first tester.
- Oct 12The README looked harmless. The model saw a hidden instruction. (opens in a new tab)Dev.to
- Oct 11I paid people to try and follow my README (431 points, 206 comments) (opens in a new tab)Hacker News
- Oct 6Your GitHub README Isn't a Profile. It's a Storefront. (Here Are the 5 Rules I Used (opens in a new tab)Dev.to
Checked at the source on Nov 2, 2026. Points, comments, and stars are from that day. GitHub counts are keyword matches, so treat them as a rough guide.
The spec
Have an agent follow your README step by step in a clean sandbox, then get a report on where it got stuck, what was missing, and suggested fixes for each step.
Build time
One weekAuth, storage, or AI · Level 4 of 5Audience
Open-source maintainers and teams with setup docs.
Stack
- Next.js
- Docker
- Claude API
Fun factor
Your project gets a tester who never pretends it worked.
Core features
- Connect a public repo
- Runs each setup step in a sandbox
- A report of failures by step
- Suggested README edits
AI features
- Follows the instructions as a newcomer would
- Writes a fix for each step that failed
Stretch goals
- Run on every pull request
- Test on several operating systems
- Open a fix as a pull request
First version
Run the install and start commands from a README in a container and report the first failure.
Build plan
4 milestones, in the order you would build them. Saved ideas get this plan with checkboxes and notes.
The build prompt
Paste this into ChatGPT, Claude, Codex, or Cursor, then build the first version before anything else.
# Build Readme Trial You are a senior full-stack engineer pairing with me on a side project. Build a working first version of the product described below. Read the whole brief before writing any code, then follow "How to work" at the end. ## The idea **Readme Trial.** Have an agent follow your README step by step in a clean sandbox, then get a report on where it got stuck, what was missing, and suggested fixes for each step. **Why now:** "I paid people to try and follow my README" drew 431 points and 206 comments on Hacker News on Oct 11. Plenty of tools generate READMEs, but far fewer check whether the instructions work. An agent in a clean sandbox is a cheap first tester. **Who it is for:** Open-source maintainers and teams with setup docs **What makes it fun:** Your project gets a tester who never pretends it worked. ## Scope - **Build time:** One week. Size every decision to ship a working first version inside this window. - **Technical ambition:** Level 4 of 5, "Auth, storage, or AI". Real accounts, stored user data, and model calls. Design the data model, auth, and access rules before the UI, and keep every secret server-side. - **First version only.** Ship the core features below end to end. Stretch goals are listed so you can design around them, not build them. ## Core features (each must work end to end in the first version) 1. Connect a public repo 2. Runs each setup step in a sandbox 3. A report of failures by step 4. Suggested README edits ## AI features - Follows the instructions as a newcomer would - Writes a fix for each step that failed How to build them: - Put every model call behind one server-side module with a typed interface, so the provider can change without touching the UI. - Read API keys from environment variables only, and document each one in `.env.example`. - Write prompts as versioned constants with clear instructions and an example of the expected output; parse and validate responses before using them. - Handle timeouts, rate limits, and malformed output with a graceful fallback the user can understand. Stream responses where a wait would exceed a couple of seconds. - Never let a feature depend on the model being perfect. Show the result, let the user edit or retry. ## Stretch goals (later, not in the first version) - Run on every pull request - Test on several operating systems - Open a fix as a pull request Leave clean seams for these (a module boundary, a nullable column, a feature flag), but do not implement them unless I ask. ## Tech stack Use exactly: Next.js, Docker, Claude. Stay on current stable versions, follow each tool's official conventions, and add a library only when the standard library or the chosen stack cannot do the job cleanly. If part of this stack is a poor fit for a specific requirement, say so and propose the smallest change. ## Owner's notes Written by me, the project owner. Treat these as requirements and preferences that override the generated material above when they conflict. The first version should be exactly this, and no bigger: Run the install and start commands from a README in a container and report the first failure. ## Build plan (with saved progress) 0 of 4 steps complete. Resume at step 1: Read the README. Before you start it, check what is already implemented so you do not repeat finished work. 1. **Read the README** [not started] Pull out the setup steps. 2. **Run in a sandbox** [not started] One clean container, with strict limits. 3. **Report** [not started] Where it failed, and the output. 4. **Suggest fixes** [not started] An edit for each broken step. ## Definition of done for the first version - [ ] Connect a public repo works end to end, with real data, not a placeholder. - [ ] Runs each setup step in a sandbox works end to end, with real data, not a placeholder. - [ ] A report of failures by step works end to end, with real data, not a placeholder. - [ ] Suggested README edits works end to end, with real data, not a placeholder. - [ ] Every screen handles loading, empty, and error states. - [ ] Typecheck, lint, and any tests pass, and the main user flow was exercised by hand. - [ ] A README explains setup, environment variables, and how to run it locally. ## Quality bar - Responsive from a phone to a desktop, keyboard-accessible, semantic HTML, visible focus states, labelled inputs, and sensible contrast. - Loading, empty, and error states for every screen that reads or writes data. Errors say what happened and what to do next. - Validate on the server, never trust the client, and keep secrets in environment variables with a committed `.env.example`. - Type-safe end to end. No `any` without a comment explaining why. - Small, readable modules named after what they do. No premature abstraction, no dead code, no TODOs left for later without a note. - Sensible defaults over settings. If a choice is not in this brief, pick the simplest option that keeps the product coherent and say what you chose. ## How to work 1. **Read, then restate.** Summarize the product in three sentences and list your assumptions. Ask only the questions that block implementation. For everything else, decide and note the decision. 2. **Plan before code.** List the files and modules you will create, in build order, mapped to the core features. If a build plan is included above, use it instead: resume at the first step not marked done and check what already exists before touching it. 3. **Set up.** If a project already exists, inspect its code, instructions, and conventions first and build on them. Otherwise scaffold the stack above with linting, formatting, a typecheck script, `.env.example`, and a README stub. 4. **Model the data first.** Define the types, schema, and any migrations before the UI, so the shape of the product is settled early. 5. **Build in vertical slices.** Finish one core feature end to end (data, logic, UI) before starting the next. Keep the app runnable after every slice and commit each slice with a message that says what changed and why. 6. **Then the interface.** Apply the quality bar above to each screen as it lands, not as a final pass. 7. **Verify.** Run typecheck, lint, and tests. Exercise the main user flow by hand. Check each item in the definition of done and each acceptance criterion. 8. **Report.** Tell me what works, what you tested and how, what is not done, every setup step I must complete myself, and the three most useful next steps. Never claim a service, test, or flow was verified when it was not. If you can edit and run the project, start implementing right after the short plan. If you cannot, give me concrete code and the exact commands to run for the next step. Rules: keep the product name and the scope as written, do not invent features, prefer boring and proven choices, and stop to ask me when a decision would be expensive to reverse.
How to use
- Copy the prompt above.
- Open ChatGPT, Claude, or your AI editor and paste it into a new conversation.
- Build milestone one, run it, then move to the next. Add stretch goals only after the first version works.
Want ideas built around you instead? Generate four from your own interests, time, and stack.
FAQ
Frequently asked questions
Answers on what Readme Trial is, how to build it, and where example ideas come from.
Similar to Readme Trial
More developer tools ideas, then a few from other categories.
Ready to generate yours?
Four ideas per round, shaped by your interests, skill level, and how much time you have.