Applying Machine Learning and Computer Vision for Planogram Compliance Evaluation in Retail Environments
DOI:
https://doi.org/10.61591/jslhu.22.714Keywords:
Machine Learning, Computer Vision, Planogram, Compliance, Retail, YOLO, DBSCAN, Hungarian AlgorithmAbstract
This research investigates the limitations of manual approaches in evaluating planogram compliance in retail settings and proposes an automated solution leveraging machine learning and computer vision. The primary objective is to design a system capable of accurately and efficiently assessing planogram compliance. The methodology encompasses the collection and preprocessing of real-world image data from retail stores in Vietnam, followed by detailed product annotation using the Roboflow platform. Subsequently, object detection models—YOLOv11 and YOLOv12—are trained for product recognition and classification tasks. Detected products are grouped into rows via the DBSCAN clustering algorithm, and layout alignment with predefined planograms is performed using the Hungarian algorithm. Experimental evaluations indicate that the proposed system achieves high precision in product detection and offers reliable planogram compliance assessment. The findings highlight the system's potential to reduce human error, improve shelf space utilization, and enhance operational efficiency in retail environments.
References
Planogram Compliance Control via Object Detection, Sequence Alignment, and Focused Iterative Search
Laitala, J.; Ruotsalainen, L. Computer Vision Based Planogram Compliance Evaluation. Appl. Sci. 2023, 13, 10145
N. V. Nguyen, T. M. Nguyen, and V. H. Le, “Deep learning for planogram compliance verification in retail environments,” in Proc. 2022 International Conference on Advanced Technologies for Communications (ATC), Hanoi, Vietnam, 2022, pp. 89–94.
Giulia Pazzaglia, Marco Mameli, Emanuele Frontoni, Primo Zingaretti, Rocco Pietrini, Davide Manco, Valerio Placidi (2021)
Mehwish Saqlain, Saddaf Rubab, Malik M. Khan, N. Ali, Shahzeb Ali (2022). Hybrid Approach for Shelf Monitoring and Planogram Compliance (Hyb-SMPC) in Retails Using Deep Learning and Computer Vision. Mathematical Problems in Engineering Volume 2022, Article ID 4916818, 18 pages
Julius Laitala (2021). Computer vision based planogram compliance evaluation. Master’s thesis, Master’s Programme in Computer Science
Z. Li, Y. Chen, X. Wang, and Q. Zhao, “An Efficient Retail Product Recognition System with YOLO-based Architecture,” J. Visual Communication and Image Representation, vol. 85, p. 103578, 2022.
D. Zhang, J. Zhang, and Q. Guo, “Retail shelf monitoring using deep learning and planogram matching,” in Proc. IEEE International Conference on Image Processing (ICIP), 2021, pp. 345–349.
M. R. Amer, E. S. Al-Masri, and M. I. Khalil, “Computer Vision for Retail Planogram Compliance,” Procedia Computer Science, vol. 65, pp. 786–793, 2015.
Z. Chen, Y. Hu, L. Xu, Y. Wang, and L. Jin, “Retail product recognition in shelf images using sparse features and deep learning,” 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), pp. 2082–2090, 2019.
R. Giri, V. Mittal, and M. Srivastava, “Shelf Monitoring Using Object Detection and Semantic Segmentation,” 2021 6th International Conference on Signal Processing, Computing and Control (ISPCC).
Y. Yang, K. Sheng, Y. Zhang, and X. He, “Planogram Compliance Checking with Deep Learning and Planar Object Tracking,” arXiv preprint arXiv:1907.00573, 2019.
M. V. Baraban, S. V. Poslad, and D. C. Greenhill, “A Deep Learning Framework for Planogram Compliance Checking,” Electronics, vol. 9, no. 2, 2020.
