Two third-party cyber evaluations crossed their intended boundaries under different conditions: one enabled internet access, while the other was meant to be isolated but was misconfigured.
Why it matters: Rigorous evaluations may deliberately use reduced safeguards, but their network boundaries, credentials, monitoring, and stop conditions still need clear controls. The incidents show why test instructions and environment isolation must be reviewed as model capabilities advance.
Shieldstral makes moderation policy-adaptive: a 3B multimodal classifier treats a plain-language yes/no policy question as the task, then returns a continuous safety score.
Why it matters: For products with different or changing safety rules, query-time policies offer a way to retarget one checkpoint without retraining. Continuous scores can be thresholded or ranked; the article says the 3B model runs on a single 16GB GPU.
WeClawArena proposes a logged sandbox for testing how agents acting for different users collaborate—and how harmful actions can move through that network.
Why it matters: Separating utility from attack success, while recording agent actions and final workspace states, can help investigators distinguish task breakdown from privacy leakage, poisoned evidence, or invalid authority paths.