Corpus Conversion Service: A Machine Learning Platform to Ingest Documents at Scale by Michele Dolfi, Christoph Auer, Peter W J Staar and Costas Bekas (IBM Research Zurich) Over recent decades, the number of scientific articles and technical publications have been increasing exponentially, and as a consequence there is a great need for systems that can ingest these documents at scale and make their content discoverable. Unfortunately, both the format of these documents (e.g. the PDF format or bitmap images) as well as the presentation of the data (e.g. complex tables) make the extraction of qualitative and quantitative data extremely challenging. We have developed a platform to ingest documents at scale which is powered by machine learning techniques and allows the user to train custom models on document collections. There are roughly 2.5 trillion PDFs in circulation, such as scientific publications, manuals, reports, contracts and more. However, content encoded in PDF is by its nature reduced to streams of printing instructions purposed to faithfully present a visual layout. The task of automatic content reconstruction and conversion of PDF documents into structured data files has been an outstanding problem for over three decades. We have developed a solution to the problem of document conversion, which at its core, uses trainable, machine learning algorithms. The central idea is that we avoid heuristic or rule-based conversion algorithms, using instead generic machine learning algorithms, which produce models based on gathered ground-truth data. In this way, we eliminate the continuous tweaking of conversion rules and !$ !$%&' %&' !" !"## ;> ;>,2>?'.,$F$1.$0.' ,2>?'.,$F$1.$0.' ()*%$+*,*')*-+'..&/, ()*%$+*,*')*-+'..&/, 01*2$3,12$4'&,5, 01*2$3,12$4'&,5, .16'-3$*7& .16'-3$*7& let the solution simply learn how to correctly convert documents by providing enough training data. This approach is in stark contrast to current state-of-the-art conversion systems (both open-source and proprietary), which are all rule-based. While a machine learning approach might appear very natural in the current era of AI, it has serious consequences with regard to the design of such a solution. First, one should think at the level of a whole document collection (or a corpus of documents) as opposed to individual documents, since an ML model for a single document is not very useful. Second, one needs efficient tools to gather ground-truth via human annotation. These annotations can then be used to train the ML models. Hence, one has to provide the ability to store a collection of documents, annotate these documents, store the annotations, train models and ultimately apply these models to unseen documents. This implies that our solution cannot be a monolithic application, rather it was built as a cloudbased platform, which consists of micro-services that execute the previously mentioned tasks in an efficient and scalable way. We call this platform Corpus Conversion Service (CCS). Using a micro-services architecture, the CCS platform implements the pipeline depicted in Figure 1. The microservices are grouped into five components: (1) the parsing of documents, (2) applying the ML model(s), (3) assembling the document(s) into a structured data format, and additionally it provides the (optional) lower branch which allows (4) annotating the parsed documents and (5) training the models from these annotations. If a trained model is available, only the first three components are needed to convert the documents. In the parsing phase of the pipeline, we focus on the following straightforward but non-trivial task: Find the bounding boxes of all text-snippets (named cells) that appear on each pdf-page. In Figure 2 we show the cells obtained from the title-page of a paper. The job of the subsequent components is to associate certain semantic classes (called <33.=,2>?'. <33. =,2>?'. C>?'.,$F$1.$0.' C>?'.,$F$1.$0.' <&&'20.' <&&'20.' E> E>6&*%A+*, 6&*%A+*, &*%A+*A%'?,?$*$, &* %A+*A%'?,?$*$, @1.',@%>2,3$%&'?, @1 .',@%>2,3$%&'?, @1.',$6?,CD, .',$6?,CD, @1 3%'?1+*1>6&& <33.=,?'@$A.*,$6?B>%, <33.=,?'@$A.*,$6?B>%, *' 23.$*',&3'+1@1+,CD, *'23.$*',&3'+1@1+,CD, 2> ?'.,>6,3$%&'?, 2>?'.,>6,3$%&'?, ?> ?>+A2'6* '6* G&',6'I,2>?'.,3%'?1+*1>6& , , ,3%'?1+*1>6& 89 89:; :; , G3?$*',2>?'. <66>*$*' <66>*$*' H%$16 <66> *$*',*7', <66>*$*',*7', 3$ %&'?,3$4'&,, 3$%&'?,3$4'&,, I1 *7,.$=>A*, I1*7,.$=>A*, &'2 $6*1+,.$0'.&J &'2$6*1+,.$0'.&J H%$16,?'@$A.*,$6?B>%, H%$16,?'@$A.*,$6?B>%, .$=>A*,&3'+1@1+,2>?'.&,, .$=>A*,&3'+1@1+,2>?'.&,, @>%,&'2$6*1+,.$0'., @>%,&'2$6*1+,.$0'., 3%'?1+*1>6, 3%'?1+*1>6, Figure 1: A sketch of the Corpus Conversion Service platform for document conversion. The main conversion pipeline is depicted in blue and allows you to process and convert documents at scale into a structured data format. The orange section is (optionally) used for training new models based on human annotation. ERCIM NEWS 114 July 2018 35