3D Sensing Algorithms Towards Building an Intelligent Intensive Care Unit Colin Lea

PhD Student Computer Science Johns Hopkins University

Suchi Saria

James Fackler

Greg Hager

Russell Taylor

March 21, 2013

preliminary work
Automatic analysis of ICU workflow
Gather data passively Develop/evaluate techniques for task recognition Summarize staff activity

Hundreds of tasks
Checkups Emptying tubes Documentation

Benefits

Safety Workflow Optimization Resource Allocation

Task Comple-on Concept Sketch

2

safety and compliance

Many reoccurring events!

Compliance Central line infections Ventilator-Associated Events Turning patients

setup

example depth video

challenges in an icu
Difficult Environment
Clutter Varied layouts Monitors Staff

Little written direction

Which nurse is doing what? Hierarchy of staff

Cognitive load

Too many hard tasks Inefficient process Infant Movable Equipment

6

task analysis approach

Actions:
1) Checking vitals 2) Documenting 3) Observing 4) Performing procedures 5) Changing Foley Catheter 6) Ventilator use 7) Other

action sequences
=
Classification is function of action sequence Problem: Changing Dimensionality!
Variable event duration, people count

Terminology:
Action: semantic label Action sequence: composed of a set of segmentations for each individual in an event
8

feature extraction

Motion Statistics

Virtual Proximity Sensors

Histogram of Orientations

Interaction Coefficient
9

experimental setup
Johns Hopkins Medical Institute Pediatric Intensive Care Unit 5.5 hours of data 122 Action Sequences Annotations by the attending Single Kinect

10

analytics

Pediatric ICU dataset

results
Evaluate with:
Support Vector Machines Decision Forests
Kernel = RBF, C =100 Max Features = 5 Trees = 20
SVM Accuracy (%) 54.5 70.2 64.3 42.9 80.0 40.0 50.0 60.6 Decision Forest Accuracy (%) 63.6 83.8 74.2 37.1 100.0 33.3 55.0 69.5

Actions Documenting Observing Checking vitals Performing procedures Changing Foley Catheter Using Ventilator Other Overall Average

Samples 11 47 28 14 5 9 8

12

analytics

Most common: Checking vitals Most time per task: Procedures Nurse time: 25 min/hour

Pediatric ICU dataset

analytics

Most common: Checking vitals Most time per task: Procedures Nurse time: 25 min/hour

Pediatric ICU dataset

average action locations

Early PICU dataset

future work
Target specific actions Compliance Scale up Increase feature fidelity

16

questions

Colin Lea
Johns Hopkins University colincsl@gmail.com www.colinlea.com

Suchi Sar ia

James Fackler

Greg Hager

Russell Taylor