NannyVision

Team Name

The Alpha’s

Timeline

Summer 2019 – Fall 2019

Students

• Christian Diaz
• Sigmund Koenigseder
• William Bozarth
• Chimere Akujor
• Olivier Ndikumana

Sponsor

N/A

Abstract

A house for a family symbolizes a “safe place.” A place that provides security for everyone living in it. Parents want to make sure that their kids are safe at all times, especially, in the confines of their own home. There can be times though where a parent is in one room and the child is in another room and the parent is not aware of what is happening in the room where the child is at. Furthermore, if something dangerous happens to the child, the parent might not be alerted in time and the outcome could be fatal for the child. NannyVision will help be the “second pair of eyes” in the room watching over the child. Users of NannyVision can rest easy knowing that their child is always being monitored and will always be alerted in a situation where the child could be in danger.

Background

According to studies, children have the highest risk for accidents or injuries to occur at home. Furthermore, accidental injuries are the highest cause of death for any child over the age of one [1]. “More than 3.4 million children experience an unintentional household injury every year and 2,300 children under 15 die from these unintentional injuries” [2]. Some of the accident that children experience while being at home are choking, suffocation, slips, and falls [2]. Even while at home, parents at times can be careless and not pay attention to their children. This could be for a number of reasons, but the fact of the matter is that it does happen to all parents.

Though most of these accidents are avoidable, they are still prevalent in today’s world. With children not having the mental capacity that an adult has, it is almost certain that children will end up having accidents. Children are often absorbed in their own immediate interest and this can cause them to be completely oblivious to their surroundings. Can these accident be avoided? Some will argue that they can be avoided, others will argue that they can’t be avoided based on the age old saying, “kids will be kids.” But wouldn’t it be nice if there were a second pair of eyes monitoring the child so that if an accident occurred, a parent can act as quickly as possible to ensure nothing fatal happens. At the end of the day, parents want to make sure that their children are safe at all times, especially when they are in the confines of their own home. NannyVision will provide the services that will not only alert parents of any accidents to their child, but will decrease the amount of fatalities due to parent not reacting fast enough to the accidents that occur to their child.

Project Requirements

• Detect child and surrounding object through object detection algorithm.
• Create a mobile application that the parent can use to watch their child through a live stream
• Parent will create an account for the application in order to use the app.
• Send notifications through the mobile application when an accident has occurred or when the child is crying

System Overview

The client’s phone for NannyVision allows the user to interact with the system through a user friendly app. The app will have access to the middleware and SBC layer of NannyVision. When the client first logs into the system, they will provide a user account name of the child being monitor for cloud storage purposes. The app will also allow the user the ability to modify the camera for better resolution of the video feed.

Results

Object Detection Demo

 

Final Demo Video

The final demo video is located in a private google drive account. To watch the final demo video, click the link above and select the download button to download the video. Because the video file is too large to scan for viruses, you will have to click the “downloads anyways” button in order to view the video.

Future Work

• Begin to learn the child’s habits that could potentially be dangerous
• Beginning alerting parents before a possible accident is about to occur
• Detect when the child is crying through sound detection algorithm
• Start expanding to areas inside the house as well as outside the house.
• Eliminate false positives in the system to ensure algorithm is functioning properly.

Project Files

Project Charter (link)

System Requirements Specification (link)

Architectural Design Specification (Link)

Detailed Design Specification (link)

Poster

References

[1] ML | What is Machine Learning.

[2] What Is Artificial Intelligence.

[3] Jason Brownlee. A Gentle Introduction into Computer Vision, 2019.

[4] Daniel Cooper. Nanit the AI nanny tries to unravel the mysteries of a restless baby, 2017.

[5] Ed Oswald. What is Artificial Intelligence? Here’s everything you need to know, 2019.

[6] World’s fastest maker board upsquared.

[7] Tesych. Azure kinect dk hardware specification.