Integrate Hub - Create and manage data pipelines.

Develop Hub - Develop and run notebooks, data flows and SQL scripts.

Data Hub - Explore data inside the workspace and in linked storage accounts.

Synapse studio is divided into Activity Hubs, which organize the tasks needed for building analytics solutions. Synapse studio allows you to execute all data tasks with a simple UI and unified environment. This will open the Synapse Studio in a new tab. Synapse Analytics Workspaceįrom the deployed resource group open the Synapse Workspace resource then click on Open Synapse Studio. Now that you have successfully deployed the resources needed for this solution, the remainder of this article will look at how we load the data into the storage account, transform the data and finally load it into the SQL Data warehouse.

There are different ways to building this data solution, but we'll go with one that allows you to interact with most of the services on Azure synapse.īefore proceeding check the set-up instructions as explained in this GitHub repository: on how to deploy the resources needed for this solution to azure.

Unstructured data - these are the images in the dataset and the zipped files that contain the metadata of the images.

Semi-structured data - these are Json files that contain the split of the dataset into train, test, and validation sets.

This article describes a solution that combines a range of Azure services to ingest, store, transform, and serve data and insights from different sources: īy the end of this series, you will have learned how to transform and analyze the data, and use it to train a classification machine learning model capable of classifying camera trap images into one of the 48 species in the dataset. The dataset used in this solution is the Snapshot Serengeti dataset, which consists of a large-scale collection of camera trap images. To learn more about this dataset, please visit the following link. This will be the first article in a four-part series on building an end-to-end data analytics and machine learning solution on Azure Synapse Analytics.

Azure snapshot