vibehacker
News
Hugging Face ·

Microsoft ThinkingBox: grades agents on DB state, not chat replies

Microsoft and Hugging Face released ThinkingBox: 507 stateful business workflows graded on terminal backend state and side effects across 20 repeats—not tool-call trails or final replies. Run it via OpenEnv; Claude Opus 5.5 leads pass@1 (~67%), and ~80% of failures are tool-handling, not reasoning.

More news

View all

Darktrace MCP Server now generally available

Announced Nov 13, the server lets AI assistants query security alerts, pull Cyber AI Analyst findings, and run triage actions across licensed Darktrace products. A read only mode hides tools that change data…

Darktrace

Spotted something we missed? Start a thread.