Sitting Posture Identifier using AI

A beginner thought process while completing my final year project and using YOLO for this task

Image by author

A little intro

My Final Year Project (FYP) for my degree started just when the COVID-19 pandemic hit. While online classes started and people started working from home, I realized my sitting posture declined over time as I continue sitting in front of my PC. We know what bad postures leads to over the years. This made me wonder, what if there was someone who could constantly monitor my posture and let me know once it starts declining (you get the idea). At the same time, I was keen to explore and contribute to the healthcare sector.

Use cases that I can imagine of (Why, What)

Before thinking too hard about actually building the system, a few things usually would come to my mind. What values would this system bring? Does it benefit not only me?

Image by author

What approaches can we take

Now that we identified our problem and potential use case, I think it is safe to proceed with building the system. Of course, it is essential to do some literature review and see what the experts in this subject have explored for this problem.

Data collection

Now with that draft approach of using machine learning established, data collection is a necessity for training the machine to learn. However, before blindly going around digging for data, the question would be: what data are we looking for.

Image by author

Approaches in machine learning

This section would be the interesting one for most beginners! So many acronyms, what are they even? CNN? RCNN? SSD?

neck_good
neck_bad
backbone_good
backbone_bad
buttocks_good
buttocks_bad
legs_crossed
legs_straight
Image by author
Image by author

Results

YOLO performed excellently. I quickly built a front-end web interface using VueJS for posting images to a Python web server. That Python web server will then pass the image to YOLO and return the results in a JSON format back to the front end.

Image by author

Considerations

User privacy is the highest priority here. Remember that we are processing images of the user from their webcam. The concept of not storing any data on the system is applied here. Images that are sent for processing are processed and immediately returned to the user.

What’s next

Even after the goal of the project is achieved (and my FYP is completed), there is a lot that can be worked on. Bringing the model for offline usage, a better modeling of what a good posture is, and many more.

--

--

I'm Jonathan Law Hui Hao, a Business Intelligence analyst in Malaysia who enjoys working with tech, RPA and Machine Learning!

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Jonathan Law

I'm Jonathan Law Hui Hao, a Business Intelligence analyst in Malaysia who enjoys working with tech, RPA and Machine Learning!