Overview Of Power Platform AI Builder - Power Platform AI Builder Series - Part One

Overview

 
Welcome to the Power Platform with AI series. During this entire series, we will talk about one of the most important components of AI Builder which is – “Form Processing”.
 
I have divided this entire series into the following parts,
So, now let’s get started!
 
Prerequisites
 
AI Builder feature is available only for specific regions. If you want to know if your region is supported by the AI Builder feature or not please refer to the below link.

What is Form Processing?

 
AI Builder Form Processing allows us to create an AI model that uses machine learning to identify the exact key-value pairs and table data from the form document.
 
Real-life Use Case
 
Let’s say, for example, your organization is managing some form filling procedure manually from the end-users. Some of the examples are:
 
HR Interviews
 
When interviewer came for an interviewer they will be provided with the form to fill in. Now, with the form processing model, we can scan that form using Power Apps, identify the Key-Value Pairs and store the information to our SharePoint list.
 
Rent Processing System
 
Property owner generates a rent receipt every month to their tenant. They are doing this procedure manually. Now, with the form processing model, we can scan that form using Power Apps, identify the Key-Value Pairs and store the information to our SharePoint list and do further analysis for the data.
 

What will be covered during this entire series?

 
We have taken an example of the Rent Processing System. We have a rent receipt like below.
 
Overview Of With Power Platform AI Builder - Power Platform AI Builder Series
 
We will build our model and Train our model with different forms.
 
Overview Of With Power Platform AI Builder - Power Platform AI Builder Series 
 
Once our model is trained, we will create one PowerApps, which scan the pdf file and store the data to the SharePoint list.
 
Overview Of With Power Platform AI Builder - Power Platform AI Builder Series
 
Download Sample Forms for Practice
 
You can download Test Lab material for this series using my GitHub and the Power Apps demo which we are going to perform in this entire series is available here.
 
Important Points to Remember for Form Processing Input Document
  • Extension Supported: PDF, PNG, JPG
  • File Size: Combined file size should not exceed 50 MB and should not more than 500 pages for PDF.
  • Dimensions: For Images, dimensions must be 530 x 100 and 4200 x 4200 pixels.
  • For scanned documents – Recommends high-quality Images.
  • Must use English characters.
  • Must have Key-value Pair (Example: “Phone: +91 9537981467”).
  • Without a key label, the value will not be detected.
  • Keys can appear above or to the left of the values, but not below or to the right.
  • Use forms with different fields' value. The form template should be the same.
Limitations
  • Complex tables – Nested tables, merged headers are not supported.
  • Checkboxes and radio buttons not supported.
  • PDF documents larger than 50 pages are not supported.
  • Fillable PDFs are not supported.

Conclusion

 
This is how the basics of Form Processing works with the AI model. We will be discussing more about this with my next article.
 
Stay connected with me.
 
Happy Power Apping.