Hello everyone, my name is Shounak Joshi and I am an incoming third-year computer science student at the University of Florida. Prior to UF, I lived in Boynton Beach, Florida, which is where I am staying for my internship period. In addition to studying computer science, I enjoy playing soccer, making music, learning how to cook new dishes, and spending quality time with friends and family.

Poster Abstract

In this project, I am exploring the Azure Synapse Analytics platform to integrate it with the HPCC Platform endpoints.

Microsoft's Azure Synapse Analytics is a limitless analytics service that combines enterprise SQL data warehousing and big data analytics services.

Purpose: This project aims to understand the benefits that Azure Synapse offers to the HPCC functionality. Azure Synapse - as a cloud service that provides insight - has potential benefits to the HPCC Platform such as enhanced visualization, exposure to varied data analysis, and establishing an integrated product with the Azure platform.

Integration: Many Synapse Analytics tools can connect to an external database/service such as the ""Linked Service"" option. This Linked Services feature offers an in-built path to a large variety of data sources for data ingestion. Leveraging this could prove beneficial as a connector to the HPCC Systems Landing Zone.

Once data is ingested, we can SQL query data within Synapse SQL Pools to generate the insight we are looking for. Essentially, a user could ""Copy Data"" on a schedule as data is updated to the Linked Service source connection to the destination data lake storage file system on Synapse. From there, they can leverage the querying capacity of Synapse Analytics.

Overall, this project offers a good way to explore how third-party environments can work with the HPCC Platform and its capabilities.

Presentation

In this Video Recording, Shounak provides a tour and explanation of his poster content.

Integrating HPCC Systems with Azure Synapse Analytics:

Click on the poster for a larger image.