Azure Document Intelligence > How to ingest EML and MSG files ??

[kachihro]

Within the parser, and indexer, is there a way to also include Email Messages - EML and MSG file types ??

The DI parsers can use additional formats ;
https://learn.microsoft.com/en-au/azure/search/search-how-to-index-azure-blob-storage#supported-document-formats

But - the doco for this project only lists SOME of these - not all ;
https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/docs/data_ingestion.md#supported-document-formats

How would I include the parsing for EML and MSG ??

[mattgotteiner]

@kachihro Unfortunately that 1st list you shared is not the DI parser, it's the default parser mode of Azure Search.

This the full list of supported formats for Document Intelligence
https://learn.microsoft.com/en-us/azure/ai-services/document-intelligence/prebuilt/layout?view=doc-intel-4.0.0&tabs=rest%2Csample-code#supported-file-types

We use some functionality only available in Document Intelligence for table extraction but we can definitely look into supporting EML and MSG files through text extraction only, similar to default parsing in Azure Search

[mattgotteiner]

You can add write your own parser

Example of a custom parser here:
https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/app/backend/prepdocslib/jsonparser.py

How to integrate it

azure-search-openai-demo/app/backend/prepdocslib/servicesetup.py

Line 248 in 5edb536

def build_file_processors(

[kachihro]

Thanks - yes, I've been able to include a new parser - and update within the source Python files - this is working for me.

I'll update the project & include the parser for other people - just doing further testing within my own environment.

(and - my code version is before the 'serviceSetup' was included - I'll need to refactor a little)