40

Parsr – A toolchain to transform documents in usable structured text

 4 years ago
source link: https://github.com/axa-group/Parsr
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

ARBVZjf.png!web

Turn your documents into data!

Français | 中文

Parsr, is a minimal-footprint document (image, pdf) cleaning, parsing and extraction toolchain which generates readily available, organized and usable data for data scientists and developers.

It provides users with clean structured and label-enriched information set for ready-to-use applications ranging from data entry and document analysis automation, archival, and many others.

Currently, Parsr can perform:

  • Document Hierarchy Regeneration - Words, Lines and Paragraphs
  • Headings Detection
  • Table Detection and Reconstruction
  • Lists Detection
  • Text Order Detection
  • Named Entity Recognition (Dates, Percentages, etc)
  • Key-Value Pair Detection (for the extraction of specific form-based entries)
  • Page Number Detection
  • Header-Footer Detection
  • Link Detection
  • Whitespace Removal

Parsr takes as input an image (.JPG, .PNG, .TIFF, ...) or a PDF generates the following output formats:

  • JSON
  • Markdown
  • Text
  • CSV (for tables), or Pandas Dataframes (see here )
  • PDF

Table of Contents

  • Turn your documents into data!

Getting Started

Installation

-- The advanced installation guide is available here --

The quickest way to install and run the Parsr API is through the docker image :

docker pull axarev/parsr

If you also wish to install the GUI for sending documents and visualising results:

docker pull axarev/parsr-ui-localhost

Note: Parsr can also be installed bare-metal (not via Docker containers), the procedure for which is documented in the installation guide .

Usage

-- The advanced usage guide is available here --

To run the API , issue:

docker run -p 3001:3001 axarev/parsr

which will launch it on http://localhost:3001 .

Consult the documentation on the usage of the API .

  1. To use the Jupyter Notebook and the python interface to the Parsr API, follow here .
  2. To use the GUI tool (the API needs to already be running), issue:
    docker run -t -p 8080:80 axarev/parsr-ui-localhost:latest
    Then, access it through http://localhost:8080 .

Refer to the Configuration documentation to interpret the configurable options in the GUI viewer.

The API based usage and the command line usage are documented in the advanced usage guide.

Documentation

All documentation files can be found here .

Contribute

Please refer to the contribution guidelines .

Third Party Licenses

Third Party Libraries licenses for its dependencies :

  1. QPDF : Apache http://qpdf.sourceforge.net
  2. GraphicsMagick : MIT http://www.graphicsmagick.org/index.html
  3. ImageMagick : Apache 2.0 https://imagemagick.org/script/license.php
  4. Pdfminer.six : MIT https://github.com/pdfminer/pdfminer.six/blob/master/LICENSE
  5. PDF.js : Apache 2.0 https://github.com/mozilla/pdf.js
  6. Tesseract : Apache 2.0 https://github.com/tesseract-ocr/tesseract
  7. Camelot : MIT https://github.com/camelot-dev/camelot
  8. MuPDF (Optional dependency): AGPL https://mupdf.com/license.html
  9. Pandoc (Optional dependency): GPL https://github.com/jgm/pandoc

License

Copyright 2019 AXA Group Operations S.A.

Licensed under the Apache 2.0 license (see the LICENSE file).


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK