Hey - released this PyPi library after getting annoyed most agent evals only focus on outcomes, and the tool calling path is just as important in recognizing the outcome decision. So defined decision agreement rates, trajectory agreement rates etc etc Most tell us whether the final answer was ri...
Source: [Hacker News](https://github.com/ibm-client-engineering/output-drift-financial-llms)