test(rectification): lock holdout cards, style-kind scoring, and strong B conflicts
Independent Staging Quality Gate / validate (push) Successful in 15m6s
Independent Staging Quality Gate / publish (push) Successful in 16m19s

Ask-holdout now requires a renderable choice frame. Scoring uses the same effective contrast kind as rendering, because the engine-varga.d9/d10 fork was live. varga_style weak_yes counts as a strong conflict; existence weak_yes still does not.

Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
Jesse_Chen
2026-08-29 01:45:39 +08:00
parent a3f4e7128b
commit 87f32d596f
5 changed files with 94 additions and 12 deletions
+8 -8
View File
@@ -6449,14 +6449,14 @@
- 状态:resolved
- 首次发现:2026-08-28
- 最近更新:2026-08-28
- 最近更新:2026-08-29
- 影响面:`ConflictProbe.choice_kind``conflictProbesFromContrast``applyProbeOutcome` / `directionFor`
- 用户现象:D9/D10 风格点选里,选项是并列的盘面风格,不是“有/弱有”。选后一组只得一半分,更早分钟被系统性抬高。
- 触发条件:剩余候选按 varga 风格分组出题;组 0 映射 `yes`(±2),组 1 映射 `weak_yes`(±1)。
- 根因:`directionFor` 只看 `answer_class`。风格题复用 `weak_yes` 当第二组标签,却走了存在题的半权。
- 修复:探针带显式 `choice_kind``varga_style` 各组满权 ±2`unsure` 仍为 0。存在题 / `event_quality``weak_yes` 仍半权且一次作答不淘汰。缺字段的旧收据保持旧分。不改 `SCORE_DELTA` 数值。
- 验证:`rectification-varga-style-weight` 锁定两组/三组风格等权、旧收据无 `choice_kind` 仍半权、replay 时 `candidate_set_id` 不变且 `revision` 单调。`rectification-distinguish-contract` 锁定存在题 `weak_yes` 半权。`rectification-coverage-collect` 锁定分数已拉开且家人/职业未覆盖时仍停在采集,且采集下一问是未覆盖的 blocking method;补齐或拒绝家人+职业后离开采集;`canConfirmExactMinute === false`
- 防复发:不得从 `semantic_key` 前缀猜测风格题权重。不得把存在题 `weak_yes` 改成淘汰或反向。旧收据缺 `choice_kind` 必须仍能加载。不得打开 unique-minute 门。
- 根因:`directionFor` 只看 `answer_class`。风格题复用 `weak_yes` 当第二组标签,却走了存在题的半权。引擎若发来无 `style_options``varga.d9`/`varga.d10` 题,打分仍用原始 `choiceKind`,渲染已降为 `existence`
- 修复:探针带显式 `choice_kind``varga_style` 各组满权 ±2`unsure` 仍为 0。存在题 / `event_quality``weak_yes` 仍半权且一次作答不淘汰。缺字段的旧收据保持旧分。不改 `SCORE_DELTA` 数值。`conflictProbesFromContrast` 改用 `effectiveContrastChoiceKind`,与渲染降级一致。
- 验证:`rectification-varga-style-weight` 锁定两组/三组风格等权、旧收据无 `choice_kind` 仍半权、replay 时 `candidate_set_id` 不变且 `revision` 单调`varga_style``weak_yes` 计入 `strong_conflict_count` 且连答 3 次可淘汰对面分组;引擎 `varga.d9`/`varga.d10``style_options` 时打分 `choice_kind` 与渲染 effective kind 一致`rectification-distinguish-contract` 锁定存在题 `weak_yes` 半权。`rectification-coverage-collect` 锁定分数已拉开且家人/职业未覆盖时仍停在采集,且采集下一问是未覆盖的 blocking method;补齐或拒绝家人+职业后离开采集;`canConfirmExactMinute === false`
- 防复发:不得从 `semantic_key` 前缀猜测风格题权重。不得把存在题 `weak_yes` 改成淘汰或反向。`varga_style` 的 B 选项 `weak_yes` 必须与 A 一样计入强冲突。打分用的 `choice_kind` 必须等于渲染用的 effective kind。旧收据缺 `choice_kind` 必须仍能加载。不得打开 unique-minute 门。
- 相关记录:BUG-419、BUG-410
- 复发自:无
- 修复版本:待发布
@@ -6465,14 +6465,14 @@
- 状态:resolved
- 首次发现:2026-08-28
- 最近更新:2026-08-28
- 最近更新:2026-08-29
- 影响面:`holdoutStatusFromInference` / `holdoutStatusFromState``decideFromDossier`、holdout 点选卡
- 用户现象:保留的 holdout 后来变成未知精度、没有年份后,决策仍要 `ask_holdout_validation`,出题计划却给不出可渲染卡片。
- 触发条件:`stickyHoldoutEvents` 把已保留 holdout 钉住;该事件 `year === null``precision: "unknown"`;或 `validate_holdout` 时既没有 `oosBlindPrompts` 也没有带年份的 holdout。
- 根因:holdout 状态只看 `usage === "holdout"`。能否出题看的是带年份的事件或 oos 提示。两套口径不一致。
- 修复:抽出共用 helper:能问(oos 提示或 dated holdout)才是 `not_started`;否则 `unavailable``unavailable` 且用户未停走既有 `adopt_representative`,不当成 `passed`。带年份 holdout 追问补上存在题选项和 `probe_year`,好渲染 choice frame。不改 `applyHoldoutAnswer`,不改 stickiness。
- 验证:`rectification-holdout-renderable` 锁定未知精度 sticky holdout 不进入 `ask_holdout_validation` 且可 `ready_to_adopt`;带日期 holdout 有可渲染 `choice_frame`;通过为 `validated_range`;失败路径不变;`nextAction === ask_holdout_validation` 时 followup 非空。`canConfirmExactMinute === false`
- 防复发:不得只凭 `usage === "holdout"` 打开核对。不得把 `unavailable` 当成已通过。不得打开 unique-minute 门。
- 验证:`rectification-holdout-renderable` 锁定未知精度 sticky holdout 不进入 `ask_holdout_validation` 且可 `ready_to_adopt`;带日期 holdout 有可渲染 `choice_frame`;通过为 `validated_range`;失败路径不变;`nextAction === ask_holdout_validation` 时 followup `choice_frame`非空。`canConfirmExactMinute === false`
- 防复发:不得只凭 `usage === "holdout"` 打开核对。不得把 `unavailable` 当成已通过。`ask_holdout_validation` 必须能渲染出卡(`next_followup``choice_frame` 均非空)。不得打开 unique-minute 门。
- 相关记录:BUG-424、BUG-410
- 复发自:无
- 修复版本:待发布
@@ -591,6 +591,7 @@ export function conflictProbesFromContrast(
...row.conflictsCandidateIds,
]))];
if (candidateIds.length < 2) return [];
const choiceKind = effectiveContrastChoiceKind(probe);
return [{
id: probe.probeId,
semantic_key: probe.semanticKey,
@@ -602,10 +603,10 @@ export function conflictProbesFromContrast(
expected_outcomes: outcomes,
information_gain: probe.informationGain,
source: "varga_contrast",
...(probe.choiceKind === "varga_style"
|| probe.choiceKind === "event_quality"
|| probe.choiceKind === "existence"
? { choice_kind: probe.choiceKind }
...(choiceKind === "varga_style"
|| choiceKind === "event_quality"
|| choiceKind === "existence"
? { choice_kind: choiceKind }
: {}),
}];
});
@@ -207,6 +207,7 @@ test("ask_holdout_validation is only returned when the same dossier can build a
if (decision.nextAction !== "ask_holdout_validation") continue;
const plan = holdoutFollowup(dossier);
assert.ok(plan.next_followup, "ask_holdout_validation requires a holdout followup");
assert.ok(plan.next_followup.choice_frame, "ask_holdout_validation requires a renderable card");
assert.equal(decision.canConfirmExactMinute, false);
}
});
@@ -6,6 +6,7 @@ import { buildInferenceState } from "../src/lib/rectification-agentic/core/build
import {
buildCandidateContrastPacket,
conflictProbesFromContrast,
inspectDiscriminatorProbes,
} from "../src/lib/rectification-agentic/core/candidate-contrast-packet.ts";
import { asInferenceState } from "../src/lib/rectification-agentic/core/compose-receipt.ts";
import { decisionStateFingerprint } from "../src/lib/rectification-agentic/core/decision-fingerprint.ts";
@@ -118,6 +119,79 @@ test("old ConflictProbe receipts without choice_kind keep half-weight weak_yes",
assert.equal(loaded.revision, state.revision);
});
test("varga_style B-option weak_yes counts as strong conflict; existence weak_yes does not", () => {
const style = styleProbeFrom(twoGroupStylePacket());
assert.equal(style.choice_kind, "varga_style");
const styleConflicted = style.expected_outcomes.find((row) => row.answer_class === "weak_yes")?.conflicts[0];
assert.ok(styleConflicted);
let styleScores = Object.fromEntries(style.candidate_ids.map((id) => [id, 10]));
let styleCounts: Record<string, number> = {};
let eliminated = new Set<string>();
for (let round = 0; round < 3; round += 1) {
const applied = applyProbeOutcome(styleScores, style, "weak_yes", {
strongConflictCounts: styleCounts,
eliminatedIds: eliminated,
});
styleScores = { ...applied.scores };
styleCounts = { ...applied.strong_conflict_counts };
eliminated = new Set(applied.eliminated_ids);
}
assert.equal(styleCounts[styleConflicted], 3);
assert.equal(eliminated.has(styleConflicted), true);
const existencePacket = buildCandidateContrastPacket({
candidateSetVersion: "05:00-05:04",
candidateTimes: ["05:00", "05:04"],
transitions: [{ layer: "d9", at: "05:04" }],
});
const existence = conflictProbesFromContrast(existencePacket).find((item) => item.choice_kind === "existence");
assert.ok(existence);
const existenceConflicted = existence.expected_outcomes.find((row) => row.answer_class === "weak_yes")?.conflicts[0];
assert.ok(existenceConflicted);
let existenceScores = Object.fromEntries(existence.candidate_ids.map((id) => [id, 10]));
let existenceCounts: Record<string, number> = {};
for (let round = 0; round < 3; round += 1) {
const applied = applyProbeOutcome(existenceScores, existence, "weak_yes", {
strongConflictCounts: existenceCounts,
});
existenceScores = { ...applied.scores };
existenceCounts = { ...applied.strong_conflict_counts };
assert.equal(applied.eliminated_ids.length, 0);
}
assert.equal(existenceCounts[existenceConflicted], 0);
});
test("engine varga.d9/d10 without style_options scores with the render effective kind", () => {
for (const semanticKey of ["varga.d9", "varga.d10"] as const) {
const packet = {
candidateSetVersion: "05:00-05:04",
vargaDifferences: [],
probes: [{
probeId: `contrast:${semanticKey}.engine-no-signs`,
candidateSetVersion: "05:00-05:04",
question: "那几年相处更接近哪一种?",
expectedOutcomes: [
{ outcomeId: "supports_05:00", supportsCandidateIds: ["05:00"], conflictsCandidateIds: ["05:04"] },
{ outcomeId: "supports_05:04", supportsCandidateIds: ["05:04"], conflictsCandidateIds: ["05:00"] },
],
candidateSplitHash: `05:00-05:04:${semanticKey}.engine-no-signs`,
informationGain: 1.2,
sourceFeatures: [{ technique: semanticKey.slice(6).toUpperCase(), calculationResultId: null }],
domain: "relationship",
year: null,
semanticKey,
choiceKind: "varga_style" as const,
}],
};
const scored = conflictProbesFromContrast(packet);
const rendered = inspectDiscriminatorProbes(packet).selected;
assert.equal(scored.length, 1, semanticKey);
assert.ok(rendered, semanticKey);
assert.equal(scored[0]?.choice_kind, rendered.choiceKind, semanticKey);
assert.equal(rendered.choiceKind, "existence", semanticKey);
}
});
test("replaying a varga_style probe keeps candidate_set_id and a monotonic revision", () => {
const probe = styleProbeFrom(twoGroupStylePacket());
const before = buildInferenceState({
+6
View File
@@ -1054,3 +1054,9 @@
- 校验器:带曝光记录不得过盲测/密封用途;只有 `fresh_biography_audit` 满足人审安全条款。intake 在缺少该字段时不能把案例写成已审。
- 队列:盲测可用 0 例,已曝光/待人工复审 4 例。`production_tuning_allowed``verified_minute_claim_allowed` 仍为 false。
- 防复发:结果已被看过的案例不得再计入盲测;人审安全条款不得由自动化脚本自行置真。
## 2026-08-29 - D4: 补三条缺失断言;打分 kind 与渲染 effective kind 分叉已修
- holdout 遍历断言补上 `choice_frame` 非空。
- 引擎 `varga.d9` / `varga.d10``style_options` 时,断言打分 `choice_kind` 等于渲染 effective kind。断言先红(打分 `varga_style`、渲染 `existence`),已让 `conflictProbesFromContrast` 改用 `effectiveContrastChoiceKind`
- `varga_style` 的 B 选项 `weak_yes` 计入 `strong_conflict_count`,连答 3 次可淘汰对面分组;存在题 `weak_yes` 仍不计入强冲突(BUG-419)。