Hmm #CognitiveServices can now tell you if text has profanity or derogatory terms.https://t.co/2dumIM2dkR

Waiting on @onedrive #ContentServices to return docx as txt then it'd be two @MicrosoftFlow actions.

Make a great O365 scanner that would flag docs to follow up

— John Liu 劉 (@johnnliu) March 28, 2018

I also happen to know (this one is not a guess) from the good old days that SharePoint search uses IFilter to get file content as text then store this text in the index. I tried to do it in a different way.

So I figured how about doing this document to text conversion myself, I found Tika text extraction library  handy apache open source tool which has been ported as .NET nuget package

I’ve create a simple Azure function using Visual studio, It has been a while since I used the full fledged Visual studio as I’ve been using mostly Visual studio code lately, as you guys can see the azure function is pretty straight forward just 4 lines of code to convert the docx files to text representation so we can use any text analysis techniques on our SharePoint documents.

using System.Linq;
using System.IO;
using System.Net;
using System.Net.Http;
using System.Threading.Tasks;
using Microsoft.Azure.WebJobs;
using Microsoft.Azure.WebJobs.Extensions.Http;
using Microsoft.Azure.WebJobs.Host;
using TikaOnDotNet.TextExtraction;

namespace doc2text
{
    public static class Convert
    {
        [FunctionName("Convert")]
        public static async Task<HttpResponseMessage> Run([HttpTrigger(AuthorizationLevel.Anonymous, "post", Route = null)]HttpRequestMessage req, TraceWriter log)
        {
            log.Info("C# HTTP trigger function processed a request.");           
            byte[] data = await req.Content.ReadAsByteArrayAsync();
            var textExtractor = new TextExtractor();            
            return req.CreateResponse(HttpStatusCode.OK, textExtractor.Extract(data).Text);

        }
    }
}

Now let’s hook this to a simple Flow which been triggered when a new file been uploaded to specific SharePoint library.
The flow will start then it will trigger the azure function which will extract the text representation of the office document and send it to a web-service to do some text analysis and return the document classification value.

Then within the flow itself we can update the SharePoint document and update the classification as per the text analysis result.