We recently used DeepSeek V4 Flash as a teacher for finance tasks with GPT-OSS-120B. Distillation works well on this problem. At a constrained 8k token budget, our self-distilled 120B scores 83.
Source: [Hacker News](https://www.ctgt.ai/research/distillation-censorship-transfer)