Discussion
Loading...

Post

  • About
  • Code of conduct
  • Privacy
  • About Bonfire
datum (n=1)
@datum@zeroes.ca  ·  activity timestamp 3 days ago

I feel like the general populace might not realize the importance of this idea that @pluralistic shares:

what Dan Davies calles an "accountability sink." The radiologist's job isn't really to oversee the AI's work, it's to take the blame for the AI's mistakes.

this human (sometimes only nominally) in the loop is central to law as a whole not being broken

it's also of utmost importance for weapons of war, where AI actually is having life and death impact right now, with non-hypotheticals like "how do we make sure the system doesn't kill innocents without repercussions"

because if there's no repercussions the system will end up externalizing on the way to maximizing other metrics

https://pluralistic.net/2025/12/05/pop-that-bubble/

#AI #accountability

https://pluralistic.net

Pluralistic: The Reverse-Centaur’s Guide to Criticizing AI (05 Dec 2025)

  • Copy link
  • Flag this post
  • Block
Rachel
@rachel@transitory.social replied  ·  activity timestamp 3 days ago

@datum@zeroes.ca @pluralistic@mamot.fr

Moral crumple zones, basically ways to assign blame to replaceable employees or end users
https://estsjournal.org/index.php/ests/article/view/260

  • Copy link
  • Flag this comment
  • Block
Subjacent Banana
@subjacentish@zeroes.ca replied  ·  activity timestamp 3 days ago

@datum @pluralistic It's like "self-driving" and "computer controlled aircraft" - they always kill the autopilot the minute there's a problem. Boom. Pilot Error.

That Air France flight was a nice case study. Airplane was on auto pilot, pitot tubes froze and confused the autopilot, autopilot dumps off, sleepy crew has to make quick decision abt what the data means, takes the plane into a death stall. Pilot Error.🤡

https://en.wikipedia.org/wiki/Air_France_Flight_447

Air France Flight 447 - Wikipedia

  • Copy link
  • Flag this comment
  • Block
Hendrik Pfaff 🇪🇺:verified:
@HendrikPfaff@ioc.exchange replied  ·  activity timestamp 3 days ago

@datum @pluralistic Pharmaceutical companies in the #EU are required by law to have a "qualified Person" (QP). Their sole purpose is to sign of the entire (incredible complex) manufacturing process of the drugs the company produces every day and take the blame (i.e. get fired) in case of errors or costly product recalls.

Overseeing and signing of #ai processes however, sounds even worse, as it is literally impossible for a person to understand the inner workings of the black box...

  • Copy link
  • Flag this comment
  • Block
Log in

Bonfire Dinteg Labs

This is a bonfire demo instance for testing purposes. This is not a production site. There are no backups for now. Data, including profiles may be wiped without notice. No service or other guarantees expressed or implied.

Bonfire Dinteg Labs: About · Code of conduct · Privacy ·
Bonfire social · 1.0.0 no JS en
Automatic federation enabled
  • Explore
  • About
  • Code of Conduct
Home
Login