Category Archives: Azure

Disappearing Azure Data Lake Files?

tl;dr If you upload files from the Azure Data Lake Explorer in Visual Studio, it will set an expiration time on the uploaded files. That expiration time looks to be about one week from the upload time. Once that time … Continue reading

Posted in Azure, Data Lake, U-SQL | Leave a comment

U-SQL – Extracting Information From a Column Containing JSON

There are plenty of examples on how to parse JSON files using U-SQL, but what if one of the columns of a TSV contains JSON like this example: ID Name Vehicle 1 Joe “{“”Year””:””2017″”,””Make””:””Ford””,””Model””:””Fusion””}” 2 Bob “{“”Year””:””2016″”,””Make””:””Kia””,””Model””:””Sorento””}” We can adapt … Continue reading

Posted in Azure, Big Data, JSON, U-SQL | 2 Comments

Using Azure Functions to Replace Cloud Workers

When looking at options for replacing Worker Roles in Azure Cloud Services, more and more, Azure Functions look to fit the bill. I like the idea of just writing code that focuses on what needs to be done and not … Continue reading

Posted in Azure, Azure Functions | Leave a comment