An AI system used by a municipal welfare agency to score citizens' eligibility for housing subsidies based on…
In accordance with our privacy statement.
This municipal welfare agency is a public authority deploying an in-house AI system that explicitly includes a social-scoring component evaluating "lifestyle patterns" of residents applying for housing subsidies. Because housing subsidy eligibility is a social context materially different from the financial and employment data's original collection purpose, and because the scoring drives primary benefits decisions with caseworkers rarely overriding, the system sits squarely in the conduct Art. 5(1)(c) targets: a state actor using a mass evaluation system to produce detrimental treatment (benefit denial or reduction) based on behaviorally derived scores in a domain unrelated to the underlying data's origin.
- 1Immediately audit the 'lifestyle patterns' scoring component to determine whether it constitutes social scoring of natural persons by a public authority as described in Art. 5(1)(c), and document that analysis before any further deployment.
- 2Isolate the lifestyle-pattern sub-score from the housing eligibility output and obtain a legal opinion on whether removing or disabling it would bring the remaining financial-history and employment components within the lawful credit/risk-modelling carve-out recognized in the February 2025 Commission Guidelines.
- 3Conduct a benefits-denial case review to identify residents who received unfavourable housing decisions where the lifestyle-pattern score was a material input, given the risk that those decisions may have been based on prohibited scoring.
- 4Formalize and document the caseworker override process so that the AI score functions as a decision-support input rather than the primary determinant, reducing the operational weight of the scoring system while the legal question is resolved.
- 5Brief the municipal data protection officer and legal counsel on the specific prohibition trigger before the next intake cycle, since placing a prohibited system into service is itself a violation regardless of whether harm to a specific individual is demonstrated.
- 6Prepare a disclosure and remediation plan for the supervisory authority in the event that an internal review concludes the system has been operating in violation of Art. 5(1)(c), given that enforcement risk grows with each additional benefits cycle run on the current configuration.
Interpretive points where reasonable counsel would disagree, applied to the specifics above.
- Does the 'lifestyle patterns' component, as actually implemented, evaluate behaviors that fall outside the scope of the original financial and employment data collected, or does it derive solely from that same dataset in a way that might be characterized as risk modelling rather than social scoring?
- The February 2025 Commission Guidelines draw a narrower line around lawful credit scoring. Does the housing-subsidy eligibility context, which involves public benefit allocation rather than creditworthiness assessment, take this system outside that carve-out even if the lifestyle component were removed?
- Because the model is proprietary and in-house rather than procured from a private vendor, there is no procurement-structure ambiguity, but the municipality must still determine whether any third-party data processors or scoring-model contributors are acting 'on behalf of' the authority in a way that affects liability allocation under the prohibition.
If the lifestyle-pattern scoring component is found to violate Art. 5(1)(c), the municipality faces not only regulatory enforcement and potential fines under the EU AI Act but also the prospect of having to void or reopen a large volume of housing benefit decisions, with significant operational, fiscal, and reputational consequences for the agency and affected residents.
Why this was triggered›
You indicated deployment in EU, the deployment is public sector, and your use-case description mentions social scoring.
The provision text›
Prohibits placing on the market, putting into service, or using AI systems for social scoring of natural persons by public authorities (or on their behalf) where the scoring leads to detrimental or unfavourable treatment in social contexts unrelated to the data's original collection, or where the treatment is unjustified or disproportionate to the underlying behaviour.
Where this is broadly unsettled›
Open interpretive points in the corpus, not yet tied to a specific launch.
- The line between prohibited public-authority social scoring and lawful credit/insurance risk modelling is contested where private deployers act under public-authority contracts.
- Whether private-sector deployers acting on behalf of public authorities fall within the prohibition depends on procurement structure and contractual control.
AI laws that may apply
2 surfaced across 1 lensGrouped by legal lens. Click any provision to see how it applies to this launch specifically.
other
2Requires certain deployers of high-risk AI systems to perform a Fundamental Rights Impact Assessment (FRIA) before first use. Applies to public bodies, private entities providing public services, and deployers of high-ri…
Grants data subjects the right not to be subject to a decision based solely on automated processing (including profiling) which produces legal effects or similarly significantly affects them. Three exceptions: contract n…
Not legal advice. Structured analysis of what a thoughtful counsel would consider given the inputs above. Does not substitute for counsel review or certify compliance.