Tulsa TechFest 2018
Tulsa TechFest 2018

Developing Custom Extractors for Azure Data Lake

Start Time: Friday, July 20, 2018 2:45 PM
Querying csv files is easy using built in extractors on Azure Data Lake. However, to query less structured files or files with other structures requires developing custom extractors using C#.

Azure Data Lake Analytics provides a set of built in extractors to process well-structured delimited text files. U-SQL uses these extractors to parse these files But U-SQL is not limited to processing delimited files. Using Custom Extractors you can parse JSON or XML files. You can use Custom Extractors to work with irregularly formatted delimited files. Custom Extractors can even parse image files. Developers have created Custom Extractors for these and other file formats and made them available on the U-SQL GitHub site. We will look at two of these Custom Extractors: Flexible Schema Extractor and the JSON Extractor. We will look at how to deploy these Extractors and extend them.

Russ Loski, Microsoft Business Intelligence Developer, Baylor

RussLoski, Russ Loski

Russ Loski is a database and application developer working with Microsoft products. He has developed custom applications for a variety of businesses from the Dallas Cowboys to an alarm monitoring company. His specialty is developing ETL applications to move data into SQL Server as well as developing applications to communicate between legacy programs.

Currently Russ is contracting with Baylor, Scott and White, working with an external partner to populate their data warehouse.

Specialties: Database developer, technical trainer, web application developer, ETL developer