Building Intelligent Bots Using The Microsoft Bot Framework

Scope

The following article introduces the concept of bots, demonstrates the basics of the Microsoft Bot framework, and showcases how Microsoft Cognitive Services can be used to power the intelligent bots.

Introduction

Conversational Applications or bots is a hot topic right now. Is it really useful or is it just hype? To answer this question, let’s look at scenarios where bots are useful.

Messaging Applications

We all notice that Text Messaging is the most used smartphone feature and for the first time in history, people are using more messaging apps than social networks.


Source - http://www.businessinsider.com/the-messaging-app-report-2015-11?IR=T

What if you could interact with your application via this interface? This is possible via bots! Moreover, bots can adapt and work on most devices and platforms like desktop, mobile, or social media like Facebook, WhatsApp, or Skype. This will give your app a totally new selling point by interacting with your users using its favorite communication method and using his/her favorite platform!

Repetitive Tasks

In scenarios, there are repetitive tasks such as a call center, bots can be used, since there are lots of generic answers. The flow as described below would be perfect to handle the generic and most common requests and when there’s a more difficult query, the bot transfers the call to a human.

Getting Started

One of the tools to quickly build bots is the Microsoft Bot Framework which is Open Source. Bot Builder SDKs allow you to build simple to sophisticated dialogs; Cognitive Services enable your bot to see, hear, interpret and interact in more human ways. This will also be used in this article. To get started with the Microsoft Bot Framework, you must first download the Bot Builder SDK here.

Create the project

To set up the bot framework connector SDK .NET template in the Visual Studio 2015, this is a step-by-step guide.

2. Install Visual Studio 2015 (latest version).
3. Download bot application template from this download link here.
4. Save the zip file to your Visual Studio 2015 templates directory which is traditionally in "%USERPROFILE%\Documents\Visual Studio 2015\Templates\ProjectTemplates\Visual C#\". For example, “C:\Users\USERXX\Documents\Visual Studio 2015\Templates\ProjectTemplates\Visual C#”.
   
   
   
   In the Web.Config file, make sure that the keys are as follows for debugging and runing the project. These will be changed when deploying the bot.
   
   1. <appSettings>
   2. <!-- update these with your BotId, Microsoft App Id and your Microsoft App Password-->
   3. <add key="BotId" value="YourBotId" />
   4. <add key="MicrosoftAppId" value="" />
   5. <add key="MicrosoftAppPassword" value="" />
   6. </appSettings>
5. Download & Configure the Bot Emulator.
   
   https://download.botframework.com/botconnector/tools/emulator/publish.htm

Once the emulator is installed, copy the link of the running application in your browser and paste it in the emulator, leave the ID and password blank, and click on Connect.

The URL in the emulator must be in the format http://xxx:port/api/messages

Once you click on connect, when you check the Log, it should return status 200, meaning that the connection has been established.

Microsoft Bot Framework Basics

Let’s go back to the Bot Framework project to examine the code. The class here is the MessageController; this is where all the communication between the bot and the user will be handled.

All the input received from the user will go through the Post method where the type of the activity will be identified which will decide how to reply the user.

The main types of activities are,

1. Message - A simple communication between a user <-> bot
2. ConversationUpdate - Your bot was added to a conversation or other conversation metadata changed
3. ContactRelationUpdate - The bot was added to or removed from a user's contact list
4. Typing - The user or bot on the other end of the conversation is typing
5. Ping - An activity sent to test the security of a bot.
6. DeleteUserData - A user has requested for the bot to delete any profile / user data

Therefore, in the post method, you will ensure that ActivityType is checked. If it is of type message, the bot will send a reply to the user and output the length of the text that he sent.

Let’s amend the code to send a welcome message to the user when he joins the conversation and triggers a ConversationUpdate activity.

Now, let’s run the code and see the results in the emulator.

Adding Language understanding Capability to the Bot

Microsoft’s Language Understanding Intelligent Service (LUIS) offers a fast and effective way of adding language understanding to applications. With LUIS, you can use pre-existing, world-class, pre-built models from Bing and Cortana whenever they suit your purposes – and when you need specialized models, LUIS guides you through the process of quickly building them.

Before proceeding, it is important that you understand the basic concepts of LUIS.

1. Intents
   Consider intent as an intention or action. What action should a sentence trigger? Search for news? Look for help? Proceed with sign up? Those can be examples of Intents.
   
   Intents match user requests with the actions that should be taken by your app.
   
   
2. Utterances
   Utterances are sentences representing examples of user queries or commands that your application is expected to receive and interpret. LUIS learns from these utterances and your app is able to generalize and understand similar contexts.
   
   For each intent, add example utterances that trigger this intent and include as many utterance variations as you expect users to say.
   
   
3. Entities
   An entity represents a class including a collection of similar objects (places, things, people, events or concepts). Entities describe information relevant to the intent, and sometimes they are essential for your app to perform its task.

Imagine a news bot that searches for news. How will the bot know which work in the sentence he should use to search for news? This item that he should search about is called the Entity.

Example, from the sentence search for news about Mauritius. Mauritius will be the entity.

Now, that you understand the basic concepts of LUIS, let’s go and create your LUIS application.

Creating a LUIS App

To create a LUIS application, go to www.luis.ai, register and click on create a new App.

Once you click "Create", you are redirected to the bot dashboard where you can see statistics about the bot.

In this example, we’ll create a bot that allows us to search for news, register for news, and get help.

Later in this article, we’ll build and enhance the bot to understand the sentiment of the news, therefore our bot will be able to detect whether a news has a positive or negative sentiment.

Intents

Therefore, the bot will have 4 intent, namely, SearchNews, AskHelp, Register and None.

All LUIS application has a None intent created which represents any text that it cannot interpret.

Next, click on intent on the dashboard and select Add Intent to add the 4 intents.

Define the Utterances and Entities

For each of the Intents, we now need to add the Utterance and Entities. Click on each of the Intents and start adding the Utterance.

In the example below, we add the utterance “What are the news in Mauritius”. Now, who will the bot identify what is the word he needs to search for? This is the entity.

Then, from the Utterance, we select the word news which represents the entity. We need to do the same for a few utterance which will be used to train the model.

Now, we also need to be able to identity the good and the bad news. How will the bot know which words to identify good and bad news? For this purpose, we also need to train our bot by adding utterances referencing good and bad news.

The next step is to add the utterance and entity for other Intents such as register for news or to ask for help.

Train the model

The next step is to train the model. To do so, from the left menu, click on Train & Test and click on Train Application.


Test the Application

Once the model is trained, you can now type in sample sentences and see if it find the intent and entities correctly.

Once done, click on publish and you'll be able to call the LUIS app from the Bot.

Setting up the LuisDialog

Now that the LUIS service is setup, we now need to add it in the bot project to be able to recognize each intents of the user.

What will happen now is that whenever the user input a text, this will be sent to the LUIS model to identify each Intent and their Entities.

To proceed, create a new class RootDialog which implements the LusDialog Object and is specialized to handle intents and entities from LUIS,

You also need to add the keys of your LUIS App Id and Subscription key as above. Both can be retrieved in the Publish tab of the LUIS model.

Now, it’s time to map the LUIS intents to the code in out bot. To do so, we need to add specific functions in the class RootDialog and decorate each function having the name of the intent in the LUIS model.

Proceed with the same steps for all the other intents, also, always create the “none” intent for cases where the LUIS model could not map the utterance to any intent.

Let’s see how the bots behave. As you run the program and ask the bots questions related to the intents, you will see that the bot will now reach the code as per the intent and the entities.

Adding the Bing News API

At this stage, we have setup our project and we have successfully implemented Language Understanding in our bot. It’s now time to build the search functionality using the Bing News API.