Create an Amazon Kendra Gen AI index with OneDrive

Introduction

Amazon Kendra GenAI index enhances semantic search by combining traditional search relevance with Large Language Model (LLM)-powered scoring to deliver accurate, contextual results. This feature extends beyond keyword matching to understand the semantic meaning of queries and documents, enabling natural and precise information retrieval. This article demonstrates how to create an Amazon Kendra GenAI index using Microsoft OneDrive as a data source.

Data source

Microsoft OneDrive is a secure cloud storage platform that allows users to store, share, and collaborate on documents from any device. For this demonstration, OneDrive accounts contain documents that will be indexed using Amazon Kendra GenAI. The OneDrive connector in Amazon Kendra enables direct integration with user accounts, supporting authentication via OAuth 2.0 to access files for indexing and searching.

Pre-requisites

An AWS account with permissions to.
- Create and manage an Amazon Kendra index
- Configure AWS Secrets Manager
- Set up IAM roles and permissions
Application Developer permission role or the Global Administrator permission role to register a Microsoft Entra ID app.

Register an app in Microsoft Entra ID

We will use OAuth 2.0 authentication to connect to the Microsoft OneDrive data source. The following values will be required and should be securely stored in AWS Secrets Manager.

clientId: OAuth app client ID
clientSecret: OAuth app client secret

Perform the following steps to register an application in Microsoft Entra ID.

Navigate to the Microsoft Azure Portal.
Search for and click App registrations.
Click New registration.
Enter a name for your application, select who can use this application, and click Register.
An application will be created. You will see a page like the following screenshot. Note the application (client) ID and the directory (tenant) ID.
Select Certificates & secrets in the navigation pane. Select Client secrets and then click New client secret. Note the secret value.
Enter the description, select expiry, and choose Add.
Select API permissions in the navigation pane and click Add a permission. Select Microsoft Graph from the list of applications.
Select Application permissions and then select the following permissions.
- Files.Read.All
- User.Read.All
- Group.Read.All
- Notes.Read.All
Click Add permissions.
Click Grant admin consent and select Yes for confirmation.

Create a Gen AI index in Amazon Kendra

Create an index in Amazon Kendra to add Microsoft OneDrive as the data source.

Navigate to the Amazon Kendra service in the AWS Console.
Select Indexes in the navigation pane. Select Create index.
Enter the index name, select the Create a new role (Recommended) option, and enter the Role name. Click Next.
Select GenAI edition and click Next.
Leave the default values for user access control and click Next.
Review the index details and click Create.

Add OneDrive data source to the index

Once the index is provisioned, configure the OneDrive data source.

Navigate to the Amazon Kendra service in the AWS Console.
Select Indexes in the navigation pane.
Select the newly created index and click on Add data sources.
Select the OneDrive connector and click Add connector.
Enter the name for the data source and click Next.
Enter the Tenant ID.
Under the Authentication section, select Create and add a new secret.
Enter the secret name, client ID and client secret values. Click Add Secret.
Select Create a new role (Recommended) and enter the role name. Click Next.
Select Add user names here as the sync scope and add a few OneDrive accounts.
Select Full sync as the sync mode and run on demand as the sync run schedule. Click Next.
Click Next. Review the data source configuration and click Add data source.
Once the data source is created successfully, click Sync now.
Verify the sync completion and status.
Select Search indexed content in the navigation pane, search for content stored in your OneDrive account, and review the results.

Conclusion

In this article, you learned how to create and configure an Amazon Kendra GenAI index using Microsoft OneDrive as a data source.