Category Archives: U-SQL

Disappearing Azure Data Lake Files?

tl;dr If you upload files from the Azure Data Lake Explorer in Visual Studio, it will set an expiration time on the uploaded files. That expiration time looks to be about one week from the upload time. Once that time … Continue reading

Posted in Azure, Data Lake, U-SQL | Leave a comment

U-SQL – Extracting Information From a Column Containing JSON

There are plenty of examples on how to parse JSON files using U-SQL, but what if one of the columns of a TSV contains JSON like this example: ID Name Vehicle 1 Joe “{“”Year””:””2017″”,””Make””:””Ford””,””Model””:””Fusion””}” 2 Bob “{“”Year””:””2016″”,””Make””:””Kia””,””Model””:””Sorento””}” We can adapt … Continue reading

Posted in Azure, Big Data, JSON, U-SQL | 2 Comments