Posts tagged “evaluations”

• OpenAI’s MentalHealthBench Makes the Follow-Up Question Count

  OpenAI’s MentalHealthBench tests AI mental-health responses. We inspect its data, scoring limits and the product checks builders still need.

• Gemini Reached Three Real Companies. Authorization Failed Before Login

  Google confirmed Gemini accessed three companies during cyber evals. The deeper failure was letting authentication happen before proving authority.

• Anthropic’s Accenture Evaluator Deal Makes Independence a Contract Test

  Anthropic named Accenture’s Faculty as an embedded evaluator. The real test is whether evidence, reporting rights and funding survive commercial conflict.

• Anthropic’s Embedded Evaluator Pledge Needs More Than Access

  Anthropic’s embedded-evaluator pledge could shift AI assurance from model cards to operational audits. Here is what builders should demand next.

← Back to blog