Bank & QC
Item bank status and quality control
The bank holds 31 verified spots (155 items) of the 225-spot blueprint. Unverified items are never presented as finished. The checks below run on every build, so each new batch is checked automatically.
Quality-control report
- PASS All per-item checks
- PASS Blueprint totals 225/225 spots
- OPEN Domain 1: 1/22 spots filled
- OPEN Domain 2: 1/29 spots filled
- OPEN Domain 3: 1/25 spots filled
- OPEN Domain 4: 1/27 spots filled
- OPEN Domain 5: 0/36 spots filled
- OPEN Domain 6: 0/34 spots filled
- OPEN Domain 7: 1/16 spots filled
- OPEN Domain 8: 26/36 spots filled
- PASS Stored keys A/B/C/D: 40 / 39 / 38 / 38 balance
- INFO Items: 155 | Spots: 31 of 225
Writing rules for every batch
- All five variants test the same concept, each in a different clinical or applied setting.
- The stem rules out every distractor that could otherwise be defended (for example, “takes no antipsychotic” rules out NMS).
- Rationales refer to option content, never letters, because options are shuffled when a form is built.
- Diagnosis items cite StatPearls or SAMHSA/NCBI Bookshelf summaries, never DSM text.
- Legal items name the jurisdiction and the holding, because duty-to-protect statutes differ by state.
- Every spot has one free, non-Wikipedia https source and a verbatim excerpt under 20 words that justifies the key.
- Each batch gets a writer pass, then a separate reviewer pass that reopens every URL, before it is added here.
Batch 2 notes (Ethics, October 2026)
- 24 spots (120 items) across KN61, KN63, KN64, KN68, KN69 and KN70. Three writers worked in parallel. A separate reviewer re-checked each writer's file against the sources and fixed or replaced weak items before QC.
- APA standards were checked against DC Health's published copy of the 2010-amended code, because apa.org blocks automated access. The 2016 amendment changed only Standard 3.04, which this batch does not test. Two excerpts correct obvious scanning errors in that copy (“ha1m” → “harm”, “( 1)” → “(1)”).
- Case law and HIPAA items were checked on Cornell LII, with eCFR as a cross-check. Legal stems name the court and year and test only the named holding or federal rule.
- A reviewer flagged the Batch 1 note on Standard 1.05 (D8-KN61-01). The Code requires substantial harm and that informal resolution is inappropriate or has failed. That note is still pending an edit.
Batch 1 notes
- Discarded before writing: the major depressive disorder spot (“5 symptoms / 2 weeks”). The only full-criteria text found was a reproduced DSM-5 PDF. It will be rebuilt from StatPearls Major Depressive Disorder (NBK559078).
- Sources checked but not yet written into items: Griggs v. Duke Power Co., 401 U.S. 424 (1971), for KN63 disparate impact; APA Standard 2.02, Providing Services in Emergencies, for KN61.
- The StatPearls lithium excerpt was checked against NCBI's search-indexed text. Confirm the wording on the page by hand.
- Writing and review for Batch 1 were not done by separate reviewers. An independent second review still needs to run on this batch and on every later one.
- If APA adopts a revised Ethics Code, 20 spots will need their citations re-keyed: KN61 (8), KN64 (4), KN69 (3), KN70 (3), KN71 (2).
To add a batch, append spots to src/data/bank.ts in the same format: o[0] is the keyed answer, and each variant's k is the stored letter position. Then run npm run qc.