Shibie: An Embedded Restaurant Auto Pricing System

Android application to process pictures of the blackboards.

Shibie consists of a server and several terminal devices. The terminal device collects the photos of the food customers buy in the cafeteria through the camera, uploads them to the server, and uses the YOLO algorithm to detect and price the food.

Customers can pay by scanning the code directly on the camera. Consumption data will be written to the database. The back-end management system on the web page can count the sales data and display the menu data for the back-end managers to view and edit. This system can realize automatic billing, reduce the labor consumption of canteen price statistics, reduce canteen operating costs, and improve the dining experience of canteen customers while facilitating canteen managers to optimize business models.

As the team leader of this project, I am responsible for the implementation of the target detection code and the communication between the ESP32 micro-controller and the server.

References