By: Shereef PT

SEP 11,2017

Docparser Integration with Odoo ERP

Functional

What is Docparser?

Docparser is a well-known third-party application for document analysis. It's based on Lisp systems and a great tool to analyze a number of documents in a specified manner. In other words, when we need well-structured data information (e.g. Date, Register Number, Date, Address,) from a number of pdf, we can use Docparser to parse it so easily. It can be integrated with trending ERP solutions like Odoo for document analysis. This blog describes the Docparser usage and its integration with Odoo using python API calls.

To use Docparser, we have to define a parser and it consists of one or more parsing rules to handle the incoming documents. Parser rules are nothing but a position with its data type. It can be defined based on the way of output data. So the basic thing is that we can upload a number of the document to Docparser and retrieve (with the help of parser) the data as per our needs.

Parsing Rules:

The user can define some rules for fetching data from an uploaded document. Normally this can be defined by the user by selecting an area on an uploaded document from the document parser user interface. This parser rule will save the positions with a custom label and when a document comes to parse, it will fetch the data from the input document based on the selected position and it will save the content to the user-defined label (if data exist in that area). A number of parsing rules can configure under a single parser.

Parsers:

These are the moto engines in Docparser. Parsers may exist in a number of parsing rules. The user can configure the number of parsers based on their usage. Docparser has its own inbuilt/ready-made general-purpose parser like invoice parser.

e.g. for parsers:

* Invoice Details Parser

* Student Details Parser

* Etc.

Now, we are going through Docparser account creation & the parser creation:

We can create a Docparser account for free of cost with a username and password. After that, we have to create a parser.

1) Create Parser:

The colored area (the given below image) shows you a button to create a user-defined parser.

doc-parser-integration-with-odoo-erp-1-cybrosys

Image 1: Creating User-defined Parser.

Then, we can select any inbuilt type for our parser or select the “Miscellaneous” as below.

doc-parser-integration-with-odoo-erp-2-cybrosys

Image 2: Selecting Parser type and naming (e.g.: Applicant Mark sheet).

2) Upload File:

This is the next step, we have to upload a model document to create parsing rules.

doc-parser-integration-with-odoo-erp-3-cybrosys

Image 3: Uploading Documents

3) Create Parsing Rule:

We created a parser here (Image 1). Now as we mentioned earlier, we have to define some parsing rules for the parser. Here we can select the type of rule. Let's go through with an example.

Eg: Extracting Date field from Uploaded Document:

doc-parser-integration-with-odoo-erp-4-cybrosys

Image 4: Creating rule-1 for the parser, selecting data area with the mouse. You can see uploaded pdf in the background.

As above, we can create so many rules as per our needs, Here we created.

+ Rule 1: Application Date (image 4)

+ Rule 2: Applicant (follow activities just like image 4 by selecting “Name” area)

+ Rule 3: Mark Table (This is a tabular data, see the image below)

doc-parser-integration-with-odoo-erp-5-cybrosys

Image 5: Creating rule 3, selecting tabular/matrix data type and its area

doc-parser-integration-with-odoo-erp-6-cybrosys

Image 6: You can see now, a number of parsing rules under the parser “Applicant Mark sheet”

4) Download the Output Data:

This is the next step, getting output from the Docparser. So we have to click on “Create Download Link” button from the Download Data window.

doc-parser-integration-with-odoo-erp-7-cybrosys

Image 7: Creating download link.

We can choose the generating file format here.

doc-parser-integration-with-odoo-erp-8-cybrosys

Image 8: Select the download data format.

We can download last parsed files or Recent files as below.

doc-parser-integration-with-odoo-erp-9-cybrosys

Image 9: able to get all parsed data or last data.

Giving the name of the output file and we can tick/untick the parsed details fields (Id, Remote ID, Received at etc.). From advanced configuration.

doc-parser-integration-with-odoo-erp-10-cybrosys

Image 10: able to get all parsed data or last data.

The last stage is opening/saving download file from the link. Here we have edit/delete/deactivate options on parsing the file.

doc-parser-integration-with-odoo-erp-11-cybrosys

Image 11: Download Link.

So, Here we can conclude the Docparser working as below:

+ Login to Docparser. Click here to start a free trial

+ Create a parser.

+ Upload document.

+ Define parsing rules over the uploaded document.

+ Get the output in the desired format.

Now, we can go through Odoo Perspective. We already know Odoo using Python language, we can use Docparser in Odoo for document analyzing. If we clear with Python as codes with Docparser, we can create some forms and settings in Odoo, then add api keys, its parser keys and analyze thousands of documents within minutes. The Python stuff is describing below:

Docparser Python api:

we can use Docparser api for:

To list Document Parsers.

To upload documents to a Document Parser with its ID.

To obtain our parsed data in the desired format.

These are described below with python code.

1) Authentication:

An authentication process is the first process with api, It can be done with our Docparser account’s secret api key. See the code below:

Python Code:

INPUT:

r = requests.get('https://api.docparser.com/v1/ping', auth=('<your Api key from docparser>', ''))
print r.json()

OUTPUT:

{u'msg': u'pong'}

2) Uploading Data:

Just give the file to a variable and upload it as below:

INPUT:

file_name ='filename.pdf'
with open(file_name) as f:
    r = requests.post('https://api.docparser.com/v1/document/upload/<parser key>', files={'file':f},auth=('<your Api key from docparser>', ''))
print r.json()

output:

{u'quota_used': 59, u'quota_refill': u'1970-01-01T00:00:00+00:00', u'quota_left': 91, u'id': u'183152530562c23026a3a485e586153d', u'file_size': 33398}

in the case of a number of documents to upload, better using any handlers or signal function. Otherwise, the response will be “Document is not ready” or something else like that.

3) Get Parsed Data:

INPUT:

r = requests.get('https://api.docparser.com/v1/results/<parser  id>/<file id from upload command>',auth=('<your Api key from docparser>', ''), timeout=5)
print r.json()

OUTPUT:

"page_count":1,"uploaded_at":"2017-07-29T07:38:46+00:00","processed_at":"2017-07-29T07:50:41+00:00","application_date":null,"applicant":{"first":":","last":"Nilmar Shereef"},"mail_id":{"email":"shereef@cybrosys.in"},"mark_table":[{"key_0":"Rank","key_1":"Mark","key_2":"Weightage"},{"key_0":"11","key_1":"927\/1000","key_2":"9"}],"cat":": Technical"}]

These are the basic api operations in Python for managing Docparser. So this blog concludes that Odoo can use Docparser for the document management industry, OMR analysis, feedback marking system, any other industry that processes a wide range of documents for running efficiently and automatically.

Click here for more features