Text line segmentation from struck-out handwritten document images

In the case of freestyle everyday handwritten documents, writing, erasing, striking out, and overwriting are common behaviors of the writers. This not cleanly-written text poses significant challenges for text line segmentation. Accurate text line segmentation in handwritten documents is essential to the success of several real-world applications, such as answer script evaluation, fraud document identification, writer identification, document age estimation and writer gender classification, to name a few. This paper proposes the first, to the authors’ best knowledge, text line segmentation approach that is applicable in the presence of both cleanly-written and struck-out text. The approach consists of three steps. In the first step, components - at the word level - are detected in the input handwritten document images (containing both cleanly-written and struck-out text) based on stroke width information estimation, filtering of noise, and morphological operations. In the second step, the struck-out components are identified using the DenseNet deep learning model and treated differently to clean text in further analysis. In the third step, geometrical spatial features, the direction between candidate components and the overall text line, and the common overlapping region between adjacent components are evaluated to progressively form text lines. To evaluate the proposed steps and compare the proposed method to the state-of-the-art, experiments have been conducted on a new problem-focused dataset containing instances of struck-out text in handwritten documents, as well as on two standard datasets (ICDAR2013 text line segmentation contest dataset and ICDAR2019 HDRC dataset) to show the proposed steps are effective and useful, with superior performance compared to existing methods.