Monday, October 3, 2022

 Implement Azure Data Factory Demo: 

In this research, we will go thru steps to create Azure Data Factory to copy data from SQL to Blob. We will create storage account, container, SQL DB table, Data Factory and pipelines to copy data

Azure Data Factory is a Microsoft cloud service that allows data integration from different sources by building hybrid extract-transform-load (ETL/ELT) and data integration pipelines.

a) Go to URL https://portal.azure.com and Login to the account. On the Azure portal menu or from the Home page, select Create a resource and search for Storage Account and click create with default settings and select the resource group.

b) Next go to storage resource and copy the access keys. Next create new container Add.

c) Next step is to create SQL Server Database. For test, set SQL authentication with admin user

Using SSMS, connect to the SQL Server and create new Database and one small table with few rows

d) Create a Data Factory with git configuration as later.



Go to Data Factory resource and open Data factory studio. Create pipeline and copy data.
Define Source data store, Select Blob as destination with below as summary



No comments: