{"id":12279,"date":"2017-02-21T12:11:00","date_gmt":"2017-02-21T12:11:00","guid":{"rendered":"https:\/\/viewmyprojects.com\/winwirewp\/?p=12279"},"modified":"2024-03-05T09:12:13","modified_gmt":"2024-03-05T09:12:13","slug":"azure-data-factory","status":"publish","type":"post","link":"https:\/\/viewmyprojects.com\/winwirewp\/blog\/azure-data-factory\/","title":{"rendered":"Extract Data and Load using Azure Data Factory"},"content":{"rendered":"\n

Azure Data Factory is a Microsoft cloud-based data integration service which helps to transfer data to & from Azure Data Lake, HDInsight, Azure SQL Database, Azure Machine Learning (Cognitive Services), Azure Blob Storage<\/a> etc. It organizes & automates the movement and transformation of data. Azure Data Factory works across on-premises, cloud data sources as well as SaaS to extract, transform and finally load the data.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Pipelines and activities in Azure
<\/strong>
Azure Data Factory allows you to create data pipelines that move and transform data, and then run the pipelines on a specified schedule (hourly, daily, weekly, etc.).<\/p>\n\n\n\n

What is a data pipeline?<\/strong><\/p>\n\n\n\n

A very attractive feature of ADF is that the service offers a holistic monitoring and management experience over these pipelines In a Data Factory solution, you create one or more data pipelines. A pipeline is a logical grouping of activities. They are used to group activities into a unit that together perform a task. To understand pipelines better, we need to understand an activity first.<\/p>\n\n\n\n

What is an activity?
<\/strong>
Activities define the actions to perform on your data. For example, you may use a Copy activity to copy data from one data store to another data store. Data Factory supports two types of activities: data movement activities and data transformation activities.<\/p>\n\n\n\n

To learn more, click the link and follow a<\/a>Step by Step Azure Data Factory Tutorials<\/a><\/em><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

Azure Data Factory is a Microsoft cloud-based data integration service which helps to transfer data to & from Azure Data Lake, HDInsight, Azure SQL Database, Azure Machine Learning (Cognitive Services), Azure Blob Storage etc. It organizes & automates the movement and transformation of data. Azure Data Factory works across on-premises, cloud data sources as well as SaaS… Continue reading Extract Data and Load using Azure Data Factory<\/span><\/a><\/p>\n","protected":false},"author":30,"featured_media":16693,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_eb_attr":"","_uag_custom_page_level_css":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-12279","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","entry"],"acf":[],"featured_image_src":"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic.webp","author_info":{"display_name":"Kartheek T","author_link":"https:\/\/viewmyprojects.com\/winwirewp\/author\/kartheek\/"},"views":3566,"uagb_featured_image_src":{"full":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic.webp",800,440,false],"thumbnail":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic-150x150.webp",150,150,true],"medium":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic-300x165.webp",300,165,true],"medium_large":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic-768x422.webp",750,412,true],"large":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic.webp",750,413,false],"1536x1536":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic.webp",800,440,false],"2048x2048":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic.webp",800,440,false],"post-thumbnail":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Extract-Data-and-Load-using-Azure-Data-Factory-graphic.webp",800,440,false]},"uagb_author_info":{"display_name":"Kartheek T","author_link":"https:\/\/viewmyprojects.com\/winwirewp\/author\/kartheek\/"},"uagb_comment_info":0,"uagb_excerpt":"Azure Data Factory is a Microsoft cloud-based data integration service which helps to transfer data to & from Azure Data Lake, HDInsight, Azure SQL Database, Azure Machine Learning (Cognitive Services), Azure Blob Storage etc. It organizes & automates the movement and transformation of data. Azure Data Factory works across on-premises, cloud data sources as well as SaaS……","_links":{"self":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts\/12279","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/users\/30"}],"replies":[{"embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/comments?post=12279"}],"version-history":[{"count":2,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts\/12279\/revisions"}],"predecessor-version":[{"id":18749,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts\/12279\/revisions\/18749"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/media\/16693"}],"wp:attachment":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/media?parent=12279"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/categories?post=12279"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/tags?post=12279"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}