Project / product name: VitalWatch
Link to the project: https://github.com/roman-dusek/VitalWatch/tree/main
Team leader: Roman Dušek
Challenge: 3. ICU Surveillance System
Problem: In ICUs, there are hundreds of existing surveillance cameras in place, but this data is not used for anything. Real-time insights are lacking, impeding swift responses to emergencies.
Solution: Open-Vocabulary Model: An agile open-source pre-annotation system ensures adaptability to emerging classes. Human-in-the-Loop (HITL) System: Integrating HITL refines the model in real-time, fine-tuning accuracy to real-world healthcare nuances. Real-Time Insights: Utilizing YOLO, VitalWatch immediately identifies critical events, providing healthcare professionals with swift responses.
Impact: The VitalWatch can provide real-time monitoring and comprehensive patient activity logging, addressing critical healthcare needs. Leveraging YOLO for object detection and a human-in-the-loop system ensures accuracy and reliability. This project significantly enhances patient care by empowering medical professionals with timely event detection.
Feasibility & financials: Our open-source pipeline not only ensures technical viability but also aligns with financial considerations. With the capability to run on-premises, the project provides a cost-effective solution by minimizing cloud infrastructure expenses. The efficiency of the system further contributes to financial feasibility, optimizing resource utilization and reducing operational costs.
What is new about your solution?: Our approach introduces a paradigm shift by unlocking untapped potential in healthcare data—utilizing previously unused information crucial for patient care. The incorporation of pre-annotation makes human annotators work faster. Moreover, our system pioneers continuous improvement through a human-in-the-loop mechanism, ensuring real-time refinements and a dynamic response to the nuances of ever-evolving healthcare scenarios.
What you have built at the hackathon - text explanation + code (e.g. GitHub link): everything
What you had before the hackathon, please mention open source as well: nothing, except the knowledge of open source models and annotation tools
What comes next and what you wish to achieve: We would like to discuss with doctors the next steps for implementation ASAP.