OCR In Xamarin.Forms By Using Cognitive Services

M Munib

8y46.7k12100Article

Xamarin Cognitive ServicesOCR In Xamarin.Forms

12 Comments

Join the conversation! Your thoughts help the community grow.

ayaz shaikh5y ago
Package Microsoft.ProjectOxford.Vision.DotNetCore 1.1.0 is not compatible with netstandard2.0 (.NETStandard,Version=v2.0). Package Microsoft.ProjectOxford.Vision.DotNetCore 1.1.0 supports: netcoreapp1.1 (.NETCoreApp,Version=v1.1)
- M Munib5y ago
  Might be updations doesnt work for it.
ayaz shaikh5y ago
It's not working
Muhammad Zubair6y ago
It's not working on some new versions of visual studio like 2019 , can you please this article again with latest sample source and output.
- M Munib5y ago
  Yes sure i will update with latest changes soon.
Suraj Binorkar7y ago
Hey I am facing issue with the package installation of Microsoft.ProjectOxford.Vision (OCR) , do you have any solution on this, here is the error.Severity Code Description Project File Line Suppression StateError NU1202 Package Microsoft.ProjectOxford.Vision.DotNetCore 1.1.0 is not compatible with netstandard2.0 (.NETStandard,Version=v2.0). Package Microsoft.ProjectOxford.Vision.DotNetCore 1.1.0 supports: netcoreapp1.1 (.NETCoreApp,Version=v1.1) ReadTextOnImage C:\Users\Suraj\source\repos\ReadTextOnImage\ReadTextOnImage\ReadTextOnImage\ReadTextOnImage.csproj
- M Munib7y ago
  You have to upgrade .net standard version for compatibility
Liêm Nguyễn7y ago
Is Cognitive Services free??
- M Munib7y ago
  It can be free for just 7 days .If you want it for regular use then you have to pay few dollars for it
Ahsan Siddique8y ago
Can you add the output of solution??
- Ahsan Siddique8y ago
  Okay but, why not here?
- M Munib8y ago
  Yup i can show you . Kindly share your email address

Cognitive Services

In the world today, we need our applications to be more intelligent and exciting so that we can attract more users to our applications, so for that purpose, we use different kinds of services and APIs, Microsoft, Google, Amazon, etc.

Microsoft has provided us with some sort of cognitive services which make our applications more intelligent to make decisions and these services are called Azure Cognitive Services. It changes the theme of how to make our application more intelligent by just using cognitive services and few lines of code.

OCR (Optical Character Recognition)

OCR stands for optical character recognition. OCR help us to recognize text through images, handwriting and any texture which is understandable by mobile device's camera.

We can recognize text through OCR in seconds by capturing the image or selecting the images. OCR helps a lot in the real world to make our life easy. Like for the blind person, he/she can’t see, but by capturing an image of a bill they can listen about the bill by using the combination of OCR and Text to Speech which I will explain in my next article.

Vision API

The main question is, how can we use OCR in our Xamarin.Forms application for that purpose? We will use vision API that will help us to utilize the features and attributes of OCR. Vision API is one of the APIs of Microsoft Cognitive Services. It has a seven day trial period to use the Vision API in which testing can be performed and after that, you can buy the subscription. For that purpose, all the easy steps are mentioned below,

Steps

First of all, we need the Subscriber Key which is free for the testing phase. You can get your Vision API key from the given link.

We have to consume the rest API in Xamarin Forms by using the Vision NuGet Package. For that purpose, we will use Visual Studio 2017.

First of all, we will install the following NuGet Packages.

Xam.Plugin.Media (For Camera)
Microsoft.ProjectOxford.Vision (OCR)
Newtonsoft.Json (API)

After installing all the packages it’s time to write a few lines of code.

Create new project

Add a few XAML lines to your XAML files:

<StackLayout Padding="50">
<Button x:Name="RealOcr" Clicked="RealOcr_Clicked" Text="OCR"></Button>
<Image x:Name="Img" WidthRequest="200" HeightRequest="200" />
<Label x:Name="LblResult" FontSize="32" />
</StackLayout>

Now, initialize the Camera for accessing the Camera of the devices. We will call Vision client just like HttpClient and add a few lines of codes which are given below for accessing the Cognitive Services calling and get the response into the label.

private async void RealOcr_Clicked(object sender, EventArgs e) {
OcrResults text1;
var media = Plugin.Media.CrossMedia.Current;
await media.Initialize();
var file = await media.TakePhotoAsync(new StoreCameraMediaOptions {
SaveToAlbum = false
});
Img.Source = ImageSource.FromStream(() => file.GetStream());
var visionclient = new VisionServiceClient("Subscription Key", "https://westcentralus.api.cognitive.microsoft.com/vision/v1.0");
text1 = await visionclient.RecognizeTextAsync(file.GetStream());
foreach(var region in text1.Regions) {
foreach(var line in region.Lines) {
foreach(var word in line.Words) {
LblResult.Text += Convert.ToString(word.Text);
}
}
}
}

Results

Hence, by utilizing the above instruction, you can perform OCR in your Xamarin.Forms application. This article is specially dedicated to my trainer Mr. Asfand Yar Hamid (MVP Microsoft), C# Corner, and TechStep (IT Training Centre Sahiwal).