Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generation

Abstract

Reverse Chain-of-Thought Generation (RCG) synthesizes reasoning traces from query-answer pairs, but answer-visible generation can justify a pre-committed answer rather than derive it. This post-hoc rationalization creates a train-inference mismatch because student models are trained on answer-conditioned traces but must reason without answer access at inference time. We quantify this mismatch through lexical, trajectory, and probabilistic anchoring, measuring surface overlap, answer-conditioned generation dynamics, and answer recoverability from the trace, respectively. We find that semantic suppression, a seemingly intuitive mitigation, reduces lexical overlap but increases trajectory anchoring: avoiding the answer requires continually tracking it, thereby strengthening its influence on generation. We therefore propose Structural Skeleton-guided Reasoning (SSR), which replaces suppression with structural decoupling by first generating an abstract functional skeleton and then using it to guide the full reasoning trace. Anchoring analyses show that SSR reduces all three forms of answer dependence. Across in-domain and out-of-distribution benchmarks, its distilled variant, SSR-D, improves performance by up to 10 points over suppression baselines and better preserves out-of-distribution performance. Code is available at https://github.com/viniferagy/SSR.