dhSegment: A generic deep-learning approach for document segmentation

Format: online event in 3 sessions 

Instructors:  Frédéric Kaplan | EPFL; Rémi Petitpierre | EPFL

Moderators: Isabella di Lenardo | EPFL, Local Time Machines Coordinator TMO; Ilaria Manzini | University of Amsterdam, Local Time Machines Manager TMO

About dhSegment

In recent years, there have been multiple successful attempts tackling document processing problems separately by designing task specific hand-tuned strategies. Yet the diversity of historical document processing tasks prohibits solving them one at a time and shows a need for designing generic approaches in order to handle the variability of historical series. In this Academy, we introduce and show the functioning of dhSegment, an open-source implementation of a CNN-based pixel-wise predictor, coupled with task dependent post-processing blocks. We show that a single CNN-architecture can be used across tasks with competitive results. Moreover most of the task-specific post-processing steps can be decomposed in a small number of simple and standard reusable operations, adding to the flexibility of our approach.

Programme

Thursday, 20 May, 2021 – 14:00 to 16:00 CEST | Introduction to semantic segmentation and annotation

Theoretical part: What is semantic segmentation? How do I make a document digitally intelligible? What steps in my project are covered by dhSegment? How do I define my problem and annotate effectively?

Practical part: Presentation of the functioning of the CVAT software.

Thursday, 27 May, 2021 – 14:00 to 16:00 CEST | Training an artificial neural network with dhSegment

Theoretical part: What is an artificial neural network and how do they work? What are the applications of deep learning? How can I train a neural network with dhSegment to speed up my research and process larger corpora?

Practical part: Introduction to notebooks and Google Colab. Installation, setup and parameterization of dhSegment for training.

Thursday, 3 June, 2021 – 14:00 to 16:00 CEST | Validation and inference for concrete implementation

Theoretical part: How to verify the machine learning process on dhSegment? How to quantify its performance? How to infer the results and extract them for the next steps of my project?

Practical part: Presentation of tensorboard. Inference and extraction of results from dhSegment.

 

Registration

We are grateful to our community for the great interest shown in our first Academy! We have already reached the maximum number of participants for this event and, unfortunately, we can not accept more registrations at this time. We are collecting pre-registrations for a second round of this Academy (date TBD). Would you like to pre-register? Please fill in the form at this link.

Participation is free and open to TMO members and professionals from the broader GLAM and Digital Humanities sector.