It’s been about six weeks since a number of college students flooded the walls of the Jump Trading Simulation & Education Center to begin their summer internships with OSF Innovation. Now, half way through their projects, our student teams have plenty to report.
2021 summer intern projects
PNC VR STEAM Library
Emmy Baker (Bradley University), Meredith Buchen (Saint Francis Medical Center College of Nursing), Dustin Clark (Southern Illinois University), Charli Kerr (Bradley University) and Rachael Schulte (Bradley University)
In an effort to continue expanding access to Jump Science, Technology, Engineering, Art and Math programming, this team is in the process of building a virtual reality-based STEAM library to promote health care careers for middle and high school students.
Since June, this group has researched a number of medical professions and interviewed clinicians to create a minimum of 10 courses that young people will be able to explore. The team has created scripts, lesson plans and asset lists that have been plugged into VR software for three courses so far. Education will also be available to view on a laptop or computer.
The intent is to build 10 courses altogether, featuring nurses, phlebotomists, pharmacists, various assistive technicians, catheterization lab technicians, surgeons, pre-hospital professionals, sports medicine clinicians, anesthesiologists, optometrists and various non-clinical careers.
Based on user feedback, the team plans to provide tutorials and an education guide for instructors on the use of VR software and controls. The goal is make this digital library available to schools at no cost.
PNC Interactive Augmented Reality
Eli Adams (University of Illinois College of Medicine Chicago), Ian Conger (Drury University), Connor Davey (Southern Illinois University), Bradley Goss (Dakota State University) and Matthew Sciarabba (Bradley University)
The Advanced Imaging and Modeling Lab has mastered the art of segmenting anatomy from MRI and CT scans into 3D digital images that can be viewed in a number of technologies such as virtual or augmented reality formats. Jump engineers have passed this knowledge onto interns to help them develop an AR-based app introducing this concept to young people. The goal is to get middle and high school students excited about possibilities in non-clinical health care careers, such as bioengineers.
This group of interns has researched possible competition, and developed anatomical models, art and interactive design into their app. They aim to introduce the concept of segmentation, educate, allow users to interact with it and then understand.
Based on feedback, the group plans to increase complexity of their game, allowing users to trace the heart out of an MRI scan. If a player fails to find and trace the heart five times, guidelines will pop up to help the user get through the process. They’ve also decided to use camera-based plane tracking for the app which allows users to point and shoot at any flat surface for their AR model to appear.
Next steps include implementing levels of difficulty, in-game tutorials and interactive AR where students can select different areas of the heart. The app will also teach young people what an MRI is, how to read one and its purpose. The group plans to test what they’ve developed at the Peoria Riverfront Museum and the OSF HealthCare Children’s Hospital of Illinois.
Pulmonary Acoustic Sensor Telemetry Array ”PASTA”
Genevieve Kerns (University of Illinois at Urbana-Champaign) and Madison Ray (Ohio State University)
Current methods for pulmonary disease diagnosis are imaging which can be harmful or using a stethoscope which can have low accuracy. Physician time can also be limited when they are overseeing busy floors. This group is developing a wearable, adhesive device made up of sensors that will continuously monitor lung function while also classifying sounds that can indicate respiratory changes.
The team has developed a prototype design that includes eight sound sensors that will feed into a central signal processing box. The box would be attached to either a necklace or belt, allowing patients to move around freely. The group is also in the process of developing an algorithm to sort sounds heard by the sensors in order to accurately diagnose lung disease.
Moving forward, the team intends to build a smaller prototype of the central processing signal. They also are collecting feedback from clinicians on whether they can hear the audio files produced from the sensors and can make diagnoses from them. If successful, that audio will be used in the algorithm.
The team is also looking at different adhesive methods to avoid allergic reactions to the sensors while also ensuring they stay on the patient. The goal is to make the sensors disposable, cost effective and durable without causing extra discomfort for a patient.
Improving Vaccination Rates
Matthew Selvaraj (University of Illinois Chicago), Kyle St. John (Bradley University) and Spencer McDaniel (Bradley University)
Vaccination rates for children and adolescents plummeted last year as a result of the COVID-19 pandemic, and have not quite rebounded from that time. The Centers for Disease Control and Prevention believes this could lead to an increase of vaccine-preventable diseases as more young people head back to school in the fall.
This team of interns is working to prevent that with the creation of artificial intelligence (AI) software that will identify areas of under-immunized children. They will the use the data gleaned from that software to direct a mobile vaccination program, which provides free routine vaccinations to children in high-risk areas.
The group has been working with a computer science team at the University of Illinois to build a risk model that will predict where pockets of unvaccinated children are. Using a variety of available data, the group is labeling data points by county and zip code, creating presentable reports and meeting with potential OSF HealthCare users to gain their input on the model.
Additionally, this team is developing a hybrid predictive model, at both county and state levels, for COVID-19 hospitalizations and fatalities. The goal is to use this information to target certain populations for outreach programs and educational materials on the COVID-19 vaccination. So far, the group has made a prototype of the dashboard.
In about a month, the summer interns will give their final presentations. We look forward to seeing their final designs.