MWH03a-21 Emotion health monitoring using RGB-Thermal cameras and embedded machine learning

Subscribe
Notify of
15 Comments
Inline Feedbacks
View all comments
ZHANG, Jun(@eejzhang)
January 19, 2022 3:09 pm

You mentioned about training a model for thermal image recognition, but in the end this project is to monitor the “emotion health”. Any plan on collecting dataset for this purpose, and what kind of machine learning method you’re going to use?

MOW, Wai Ho(@eewhmow)
January 19, 2022 3:17 pm
Reply to  ZHANG, Jun

Good question! The team should explain how the thermal cam is used for emotion detection.

LAM, King Hei(@khlamas)
January 19, 2022 3:37 pm
Reply to  ZHANG, Jun

We are still thinking about it, maybe we will mostly focus on the temperature. For example, if a person is angry, his temperature should be higher.

LAM, Tsz Lai(@tllamac)
January 19, 2022 3:42 pm
Reply to  ZHANG, Jun

Our initial idea is that the temperature reading alone would supplement the RGB image result. If the result from RGB image is ‘angry’, then the temperature would likely be higher, as King Hei mentioned. If we are taking an approach purely using thermal image, we need to produce our own dataset thermal images with emotion labels, since we could not find any online. We chose not to do this, as we think it is not feasible to create this dataset along with all our other tasks.

MOW, Wai Ho(@eewhmow)
January 19, 2022 2:35 pm

Why choose the thermal cam sensor MLX80640 instead of other brands like FLIR or SEEK ones?

LAM, King Hei(@khlamas)
January 19, 2022 2:43 pm
Reply to  MOW, Wai Ho

When we are doing the research, we try to find the thermal camera for raspberry pi on the internet. Many websites recommend Thermal camera MLX90640 as it is a cheap and high-resolution camera.
In order to match our project objectives, we choose this low-cost and effective thermal camera.

MOW, Wai Ho(@eewhmow)
January 19, 2022 2:55 pm
Reply to  LAM, King Hei

How much is it? What’s its resolution and frame rate?

LAM, King Hei(@khlamas)
January 19, 2022 3:00 pm
Reply to  MOW, Wai Ho

Around 500 hkd. Resolution is 32×24 pixels, frame rate is 16Hz.

MOW, Wai Ho(@eewhmow)
January 19, 2022 3:03 pm
Reply to  LAM, King Hei

Cheap but not that high resolution. What is the max distance that one can still take temperature from the kit?

ZHANG, Jun(@eejzhang)
January 19, 2022 3:06 pm
Reply to  MOW, Wai Ho

The resolution is also my concern. Is such low resolution sufficient for this application?

MOW, Wai Ho(@eewhmow)
January 19, 2022 3:15 pm
Reply to  ZHANG, Jun

Guess not. 🙂

LAM, Tsz Lai(@tllamac)
January 19, 2022 3:16 pm
Reply to  ZHANG, Jun

We think the same. Our plan is to simply use the temperature reading as an input to the system. We will likely also revert to using the FLIR cams for thermal, as they have been used successfully in previous projects.

LAM, King Hei(@khlamas)
January 19, 2022 3:10 pm
Reply to  MOW, Wai Ho

up to 7m

MOW, Wai Ho(@eewhmow)
January 19, 2022 3:14 pm
Reply to  LAM, King Hei

Must be very inaccurate (like +/10degrees) at 7m.

LAM, King Hei(@khlamas)
January 19, 2022 3:21 pm
Reply to  MOW, Wai Ho

We will change to use the FLIR thermal camera.