What is Automated Decision-Making?
The use of algorithms and AI systems to make decisions about individuals — including credit approval, hiring, insurance pricing, benefits eligibility, criminal sentencing, and content moderation — often without human oversight, transparency, or the ability to appeal.
Also known as: Algorithmic Decision-Making, AI Decision Systems, Automated Decisions
Algorithms now decide whether you get a loan, a job, insurance, or bail. These systems operate as black boxes — making life-altering decisions with no explanation, no transparency, and often no way to challenge the outcome.
Where Automated Decisions Affect You
Financial
- Credit scoring — Algorithms determine creditworthiness using hundreds of data points
- Insurance pricing — Premiums set by predictive models (driving behavior, health data, social media)
- Fraud detection — Automated systems freeze accounts based on "unusual" patterns
- Loan approvals — AI evaluates applications in milliseconds
Employment
- Resume screening — AI filters out 75%+ of applicants before a human sees them
- Video interview analysis — AI evaluates facial expressions, word choice, and tone
- Employee monitoring — Algorithms track productivity, predict flight risk, and flag behavior
- Gig economy — Uber, DoorDash algorithms control earnings, deactivation, and visibility
Criminal Justice
- Predictive policing — Algorithms direct police to "high-crime" areas (often minority neighborhoods)
- Risk assessment — COMPAS and similar tools recommend bail and sentencing decisions
- Facial recognition — Automated identification of suspects from surveillance footage
Government Benefits
- Welfare eligibility — Automated systems approve or deny benefits
- Immigration — Algorithms flag visa applications and travel documents
- Child welfare — Predictive models identify families for investigation
Content & Information
- Social media algorithms determine what you see (and what you don't)
- Search engine ranking shapes access to information
- Content moderation — Automated removal of posts, accounts, and content
The Problems
Bias
- Algorithms trained on historical data inherit historical biases
- Amazon's AI hiring tool penalized resumes containing the word "women's" (discontinued)
- COMPAS risk assessment tool predicted Black defendants were twice as likely to reoffend compared to white defendants with similar records
Opacity
- Most algorithmic systems are proprietary black boxes
- Even the companies that build them often can't explain specific decisions
- Individuals have no way to know why they were rejected, flagged, or penalized
No Due Process
- You can't argue with an algorithm
- Appeals processes (when they exist) are often automated too
- No human in the loop for many consequential decisions
Your Rights
Under GDPR (EU)
- Right to explanation — You can demand an explanation of how an automated decision was made
- Right to human review — You can request that a human review an automated decision
- Right to opt out — You can object to solely automated decision-making
Under US Law
- No comprehensive federal right to explanation or appeal of automated decisions
- Fair Credit Reporting Act — Right to know factors in credit decisions
- Equal Credit Opportunity Act — Right to know why credit was denied
- Some state laws address algorithmic discrimination (Illinois BIPA, NYC Local Law 144)
Under EU AI Act
- High-risk AI systems (hiring, credit, justice) must meet transparency and accuracy requirements
- Must include human oversight mechanisms
- Users must be informed when AI makes decisions about them
Related Terms
AI Hiring Discrimination
The use of AI in hiring processes that can systematically discriminate against candidates based on protected characteristics inferred from resumes, video interviews, social media, and other data.
Dark Patterns
Deceptive user interface designs that trick people into giving up privacy, making purchases, or agreeing to terms they didn't intend — such as hiding opt-out buttons, using confusing language, or making cancellation deliberately difficult.
EU AI Act
The European Union's comprehensive regulation on artificial intelligence — the world's first major AI law — that categorizes AI systems by risk level and bans certain uses including real-time biometric surveillance, social scoring, and emotion recognition in workplaces and schools.
Predictive Policing
The use of algorithms and data analysis to predict where crimes will occur or who will commit them, raising concerns about bias, surveillance, and civil liberties.
Surveillance Capitalism
An economic system where personal data is systematically collected, analyzed, and sold to predict and influence human behavior for profit.
Have more questions?
Use our guided flow to get the right next privacy step for Automated Decision-Making.
Open Guided Flow