capstone

CS 426 Senior Project in Computer Science, Spring 2024 at UNR (University of Nevada, Reno) CSE Department

A Multi-Layered Biometric Access Control Device That Detects Duress Of An Authenticated User

Team 11 (Team Awesome): Alexander Ram, Hayden Coffing, Owen Boxx, Roohan Amin Instructors: David Feil-Seifer, Devrin Lee, Sara Davis TAs: Vinh Le, Zach Estreito Advisor(s): Ignacio Astaburuaga, CSE Instructor

Our group, motivated by multiple reports of pharmaceutical drugs being stolen or replaced, sought to create a new kind of drug cabinet. We are implementing a drug cabinet that will combine facial recognition, facial emotion recognition, and heart rate analysis to determine if a user is under duress and is verified. We expect this implementation to decrease loss in pharmacy and hospital settings, in addition to preventing more pernicious attacks by, say, swapping fentanyl with saline.

We are taking great lengths to make sure the software and hardware components of our project are open source and available, so it may be of greatest use to those who need it. The platform the team has settled upon is deploying a Python program on a powerful, CUDA accelerated project board. We plan on using off the shelf facial recognition and facial emotion recognition libraries, combined with bespoke heart rate analysis software to determine duress. The hardware of our project will consist of a central nVidia Jetson project board, which will control our display, webcam, and heart rate monitors.

Our project is significant in its novelty and application. No such product has ever been made that combines biometric and facial emotion recognition to determine if a user is under duress. Furthermore, no such device has been used to secure drugs in a pharmacy setting.We expect our product to stand as a unique application of novel technologies, and we hope to have it lead the way for further innovation and research into securing the most dangerous drugs in hospitals. We also hope to provide an open source solution for those hoping to emulate our project’s functionality in other applications. The project will be completely open source, and schematics will be made available upon completion. We hope that the project will be extended and expanded on in the future.

Problem Domain Book: The excellent “Deep Learning” by Ian Goodfellow Et Al. book image

Analysis of Heart Rate Physiology

Video Based Stress Detection

Analysis of HRV on Physiological Stress

PyQt6 Documentation PyQt6 logo