Tailwind Traders has a lot of legacy data that they’d like their developers to leverage in their apps – from various sources, both structured and unstructured, and including images, forms, pdf files, and several others. In this session, you'll learn how the team used Cognitive Search to make sense of this data in a short amount of time and with amazing success. We'll discuss tons of AI concepts, like the ingest-enrich-explore pattern, skillsets, cognitive skills, natural language processing, computer vision, and beyond.
| Resources | Links |
|---|---|
| PowerPoint | - Presentation |
| Videos | - Dry Run Rehearsal - Microsoft Ignite Orlando Recording |
| Demos | - Demo 1 - Azure Cognitive Search - Demo 2 - Forms Recognizer Service - Demo 3 - Creating a Custom Invoice Reader Skill - Demo 4 - Tying it all Together - Demo 5 - Knowledge Store |
In this solution we develop a process whereby we take a set of unstructured pdf invoices and generate structured tabular output using Azure Cognitive Search with a customized Form Recognizer Skill.
When creating this solution there are a few Azure resources (free trial here if you need it) that are created. The following tables list each resource, its purpose, and any special instructions needed to implement the solution fully (I use the names as presented during the talk but they will need to be renamed for your particular solution):
| Name | Type | Purpose |
|---|---|---|
| ttcognitivesearch | Resource Group | Groups services together |
| ttinvoicestorage | Storage Account | Used to store invoices |
| ttinvoicesearch | Search Service | Featured service |
| ttinvoiceintelligence | Cognitive Services (All-In-One) | Used in the search service |
| ttinvoicereader | Form Recognizer Service | This service will eventually end up in the All-In-One sevice. For right now it is in limited-access preview. To get access to the preview, fill out and submit the Form Recognizer access request form. |
| readerskillstorage | Storage Account | Storage used for Azure Function |
| readerskill | Function App | Cognitive Skill App |
| readerskill | App Insights | Adds insights to Function App |
| EastUS2LinuxDynamicPlan | App Service Plan | Consumption based plan for running Function App |
This talk consisted of the 5 demonstrations listed below.
- Demo 1: Azure Cognitive Search
- Demo 2: Form Recognizer Service - this demo requires access to the Form Recognizer Preview. To get access to the preview, fill out and submit the Form Recognizer access request form.
- Demo 3: Creating a Custom Invoice Reader Skill
- Demo 4: Tying it all together
- Demo 5: Knowledge Store
- Enter the Azure Portal and delete the Azure Resource Group you created to remove all resources for this project
Microsoft Learn:
Azure Documentation
Do you have a comment, feedback, suggestion? Currently, the best feedback loop for content changes/suggestions/feedback is to create a new issue on this GitHub repository. To get all the details about how to create an issue please refer to the Contributing docs
To become a trained presenter, contact [email protected]. In your email please include:
- Complete name
- The code of this presentation: aiml10
- Link to a video of you presenting (~10 minutes in length)(ex: unlisted YouTube video).
It doesn't need to be this content, the importance is to show your presenter skills
A mentor will get back to you with information on the process.
Thanks goes to these wonderful people (emoji key):
 Seth Juarez 📢 📖 |