Deep learning-based restaurant scoring system based on customer's facial expression

View at publisher
Authors: Swapna Mandu, R Hamsaveni, Akshita Mekala, N Sneha Abhinaya, Gunda Pranathi, Bobbili Dennies Wilson
Cited by: 0

Abstract

In today's automated dining environments, collecting authentic customer feedback has become increasingly challenging due to reduced human interaction. Traditional feedback mechanisms, such as surveys and touchscreen kiosks, are often underutilized and fail to capture genuine emotional responses. This project introduces a non-intrusive, real-time facial expression recognition system designed to assess customer satisfaction based on facial cues. Utilizing pre-trained deep learning models such as EfficientNet and MobileNet, the system classifies customer expressions into three categories: satisfied, neutral, and unhappy. A camera captures facial data post-meal, and the model processes it instantly to provide feedback without requiring active user participation. The system is optimized for kiosks and embedded devices, offering a contactless, hygienic, and intelligent alternative to conventional methods. Experimental results demonstrate that EfficientNet achieves a classification accuracy of 96.2%, outperforming MobileNet's 93.7%, while maintaining real-time processing capabilities suitable for deployment in commercial restaurant settings.

Fields of Study & Subjects

Emotion and Mood Recognition Face recognition and analysis Face and Expression Recognition

Publication details

Journal / source
CRC Press eBooks
Pages
659–667
Publication date
12 February 2026
Language
EN
Document type
Book chapter