Enriching SharePoint Image Libraries with Azure Cognitive Services

The ability to locate content in SharePoint via search has been continually improving over the years, seeing big jumps in impact with the release of features such as Delve and OCR in OneDrive for Business.

Indexing file content from Document Libraries has improved no end, but one item I see as a gap is extracting inferred meta-data out of images stored in SharePoint.

In this post, and the associated screencast, I’ll take a look at how we can utilise several of the capabilities of Azure Cognitive Services and Azure Logic Apps to quickly add value to image data that you upload to SharePoint.

Baseline Services

In order to use this solution you will need:

Building the Logic App

The best thing about Logic Apps is not only are they serverless, but they are almost entirely “codeless” as well. Rather than me describe in detail the steps, I’ve included the following items to help you get going.

1. The designer view of the Logic App

Click on the image to view an enlarged version.

Logic App

2. The Logic App exported to GitHub

Grab the code from here: https://github.com/sjwaight/SharePointCognitiveServices.

Note: this doesn’t come with the Connections which you will need to manually recreate using your own SharePoint and Cognitive Services API details.

In the image below you can see how to retrieve the GUID for a List in SharePoint Online – get to this page by clicking on “Library settings” from the settings menu (the cog) that is near your username in the Office 365 header.

SharePoint List GUID

3. A Screencast showing how this all hangs together

Note that in the screencast there’s a slight difference to my published Logic App above… see if you can find it 😉

Well, there we have it – how you can (fairly) easily add more value to the image data you store in SharePoint. Note that you could apply this approach to documents stored in Google Drive or Dropbox, as well as using many of other categories of Azure’s Cognitive Services to enrich data you already have!

One final item before I wrap up – if you want to learn more about Azure Cognitive Services then you can do it for free and without the need for an Azure Subscription. Microsoft Learn has a range of modules you can complete that covers this area. Access them online using just a browser.

Happy Days 😎

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s