Skip to main content

Safety & Alignment posts

Every post in Safety & Alignment, newest first.

MachinesonMachines

Information About Information Systems

Safety & AlignmentUber's test vehicle detected a pedestrian 5.6 seconds before the fatal crashDetecting something in the road was only one step in the system that was supposed to protect people.8 Nov 2026Safety & AlignmentTherac-25 relied on software where earlier machines had independent safeguardsA safeguard is most useful when it can still work after the system it watches has gone wrong.8 Nov 2026Safety & AlignmentA fatal Tesla crash exposed gaps in both driver supervision and road protectionThe Mountain View investigation followed the failures from the vehicle to the road equipment meant to reduce the impact.8 Nov 2026Safety & AlignmentSafety layers can fail together even when each one usually worksSeveral checks can make a system safer, but the way their failures interact matters more than the number of checks on paper.8 Nov 2026Safety & AlignmentPedestrian emergency braking helped overall, with gaps after dark and at speedA safety feature can work well enough to matter overall and still leave the hardest conditions unresolved.8 Nov 2026Safety & AlignmentA Kenyan clinic study found helpful and harmful advice in the same AI toolA tool can agree with local guidelines most of the time and still give clinicians individual suggestions worth questioning.8 Nov 2026Safety & AlignmentA health algorithm mistook spending for needA system can predict the number it was built to predict and still direct help away from patients who need it.8 Nov 2026Safety & AlignmentChallenger's earlier flights helped make a known defect seem acceptableWhen a system survives a problem several times, the record can make the problem look less serious than it is.8 Nov 2026Safety & AlignmentAutomation can leave people the hardest part of the jobThe moment a machine calls for help can be the moment the work needs the most practice.8 Nov 2026