BALTIMORE COUNTY, Md. —Last week, armed police detained and searched a Kenwood High School student after the school’s AI-driven security system mistakenly identified an empty bag of chips as a possible firearm.
The student, Taki Allen, was waiting for a ride home with friends after football practice when the weapons detection system flagged a bag of Doritos he was carrying, reports The Banner. The subsequent response involved handcuffing Allen, despite the school’s safety officials quickly determining beforehand that there was no weapon.
Officials Call for Review of School District’s AI Weapons Detection System
In response to the incident, Baltimore County officials are calling for a thorough review of the AI security system used in the school. This system, operational since 2023, analyzes footage from over 7,000 security cameras installed throughout the district.
Related Article: Survey Reveals Strong Public Support for Gun Detection Technology in Schools and Workplaces
Kenwood High School Principal Kate Smith noted that the school district’s security department had reviewed and canceled the gun detection alert shortly after realizing there was no threat. However, a spokesperson for Baltimore County Public Schools acknowledged that Principal Smith was initially unaware of the alert’s cancellation, leading to the involvement of local police.
Omnilert, the company behind the AI system, expressed regret over the situation, reports CNN.
Blake Mitchell, a spokesperson for Omnilert, explained that the system flagged the Doritos bag due to “the peculiarity of the lighting, the coloration on the bag, and the way it was being held.” The incident was resolved “within moments” after human verification, he added.
Community Response and AI Security Concerns
The erroneous alert has sparked outrage within the community, with Allen’s grandfather, Lamont Davis, demanding accountability for the distress caused to his grandson.
Baltimore County Councilman Izzy Patoka also voiced his concerns, stating, “No child in our school system should be accosted by police for eating a bag of Doritos.”
Related Article: When the Alarm Is Real, But the Threat Isn’t: How AI Can Help Schools Respond Smarter to Swatting
He called upon the school district to reassess its procedures surrounding the AI-powered weapon detection system.
