Smart Library: Identifying books on library shelves using supervised deep learning for scene text reading (Digital Libraries, 2017)

Link

https://ieeexplore.ieee.org/abstract/document/7991581/

Citation

Xiao Yang, Dafang He, Wenyi Huang, Alexander G. Ororbia II, Zihan Zhou, Daniel Kifer, and C. Lee Giles. 2017. "Smart Library: Identifying books on library shelves using supervised deep learning for scene text reading." Proceedings of the ACM/IEE Joint Conference on Digital Libraries. 2017. 1-4DOI: 10.1109/JCDL.2017.7991581

 

Abstract

Physical library collections are valuable and long standing resources for knowledge and learning. However, managing and finding books or other volumes on a large collection of bookshelves often leads to tedious manual work, especially for large collections where books or others might be missing or misplaced. Recently, deep neural-based models have been successful in detecting and recognizing text in images taken from natural scenes. Based on this, we investigate deep learning for facilitating book management. This task introduces further challenges including image distortion and varied lighting conditions. We present a library inventory building and retrieval system based on scene text reading. We specifically design our text recognition model using rich supervision to accelerate training and achieve state-of-the- art performance on several benchmark datasets. Our proposed system has the potential to greatly reduce the amount of manual labor required for managing book inventories.