{"id":11885,"date":"2020-09-07T11:47:00","date_gmt":"2020-09-07T11:47:00","guid":{"rendered":"https:\/\/viewmyprojects.com\/winwirewp\/?p=11885"},"modified":"2024-04-01T05:01:39","modified_gmt":"2024-04-01T05:01:39","slug":"azure-synapse-analytics-studio","status":"publish","type":"post","link":"https:\/\/viewmyprojects.com\/winwirewp\/blog\/azure-synapse-analytics-studio\/","title":{"rendered":"Introducing Azure Synapse Analytics Studio"},"content":{"rendered":"\n<p>Today\u2019s enterprise analytics requires enterprises to operate at a large scale on any data to facilitate better decision making. In the past, building analytics solutions requires organizations to stitch together big data and data warehousing technologies such as Spark and SQL to achieve results. Further, they were also needed to integrate them into rich data pipelines that work across relational and data lakes data.<\/p>\n\n\n\n<p>Azure Synapse Analytics&nbsp;is an integrated analytics service that accelerates time to insight from all data at any scale, across data warehouses and big data analytics systems. It brings together the best of the SQL technologies used in enterprise data warehousing, Spark technologies are used in big data analytics, and Pipelines to orchestrate activities and data movement.<\/p>\n\n\n\n<p>Azure Synapse Analytics Studio enables data engineers, data scientists, and IT professionals to collaborate. It is a place where they can develop end-to-end data solutions within a unified platform and experience.<\/p>\n\n\n\n<p>At first, sight, when we open the Azure Synapse Analytics&nbsp;<a href=\"https:\/\/www.youtube.com\/watch?v=G5MW93oYPOI\" target=\"_blank\" rel=\"noreferrer noopener\">Studio<\/a>, we find the following screen:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-1024x429-1.webp\" alt=\"\" class=\"wp-image-11887\"\/><\/figure>\n\n\n\n<p>Left side panel, Azure Synapse Analytics Activity Hubs:<\/p>\n\n\n\n<ul class=\"blog-detail-list wp-block-list\">\n<li><strong>Home:<\/strong>&nbsp;Welcome\/initial section&nbsp;(the one highlighted in the screenshot)<\/li>\n\n\n\n<li><strong>Data:&nbsp;<\/strong>Explore our data inside Azure Synapse Analytics (Storage Accounts, databases, datasets)<\/li>\n\n\n\n<li><strong>Develop:&nbsp;<\/strong>Create SQL Scripts, Notebooks, Data Flows, Spark Jobs, Power BI Reports<\/li>\n\n\n\n<li><strong>Orchestrate:&nbsp;<\/strong>Define and create Azure Data Factory data movement pipelines<\/li>\n\n\n\n<li><strong>Monitor:&nbsp;<\/strong>Monitor the execution of Azure Data Factory activities to ensure that&nbsp;they&nbsp;are running without errors, monitor Spark activities and your SQL Pools<\/li>\n\n\n\n<li><strong>Manage:&nbsp;<\/strong>Grant access to different users,&nbsp;manage&nbsp;Azure data factory&nbsp;linked services, integration run-times and triggers<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Introduction of Data Hub<\/strong><\/h3>\n\n\n\n<p>Now, we will step into the data hub first, we could see the data hub has two main sections.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-1.webp\" alt=\"\" class=\"wp-image-11886\"\/><\/figure>\n\n\n\n<p><strong>1. Workspace<\/strong>: with data assets that belong to the Azure Synapse Analytics Workspace. For example:<\/p>\n\n\n\n<ul class=\"blog-detail-list wp-block-list\">\n<li><strong>SQL&nbsp;Pools<\/strong>: A distributed query system that enables enterprises to implement data warehousing and data virtualization scenarios using standard T-SQL experiences familiar to data engineers. It also expands the capabilities of SQL to address streaming and machine learning scenarios. It offers both&nbsp;<strong>serverless(on-demand)<\/strong>&nbsp;and&nbsp;<strong>provisioned<\/strong>&nbsp;resource models, offering consumption and billing options to fit your needs.<\/li>\n\n\n\n<li><strong>Apache Spark Pools<\/strong>: Deeply and seamlessly integrates Apache Spark\u2013the most popular open-source big data engine used for data preparation, data engineering, ETL, and machine learning.<\/li>\n<\/ul>\n\n\n\n<p><strong>2. Linked<\/strong>: with data assets linked from other services. For example:<\/p>\n\n\n\n<ul class=\"blog-detail-list wp-block-list\">\n<li>Storage accounts<\/li>\n\n\n\n<li>Cosmos DB<\/li>\n\n\n\n<li>Datasets<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-2.webp\" alt=\"\" class=\"wp-image-11888\"\/><\/figure>\n\n\n\n<p>Connecting an external database (supported data sources Azure Cosmos DB and Data Lake Storage Gen2) is done as a linked service. A linked service enables us to browse and explore data, read, and write from Apache Spark for Azure Synapse Analytics or SQL into Cosmos DB or Data Lake Storage Gen2.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-3.webp\" alt=\"\" class=\"wp-image-11889\"\/><\/figure>\n\n\n\n<p>Azure Synapse removes the traditional technology barriers between using SQL and Spark together. SQL and Spark can directly explore and analyze Parquet, CSV, TSV, and JSON files stored in the data lake. It facilitates no Extract-Transform-Load (ETL) analytics in Azure Synapse Analytics against your operational data at scale.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Introduction of Developed Hub<\/strong><\/h3>\n\n\n\n<p>Azure Synapse Analytics Studio Develop Hub offers a wide range of development options, from building Azure Data Factory data flows to building Power BI Reports.<\/p>\n\n\n\n<p>With the Develop Hub in Azure Synapse Analytics we can develop:<\/p>\n\n\n\n<ul class=\"blog-detail-list wp-block-list\">\n<li>SQL Scripts<\/li>\n\n\n\n<li>Notebooks<\/li>\n\n\n\n<li>Data Flows (Azure Data Factory)<\/li>\n\n\n\n<li>Spark Job Definitions<\/li>\n\n\n\n<li>Power BI Reports<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-4-225x300-1.webp\" alt=\"\" class=\"wp-image-11890\"\/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Authoring SQL Script<\/strong><\/h3>\n\n\n\n<p>We can develop SQL Scripts with IntelliSense; we will be able to execute our scripts using SQL pool (on-demand or provisioned) and there are two different types of outputs:<\/p>\n\n\n\n<ul class=\"blog-detail-list wp-block-list\">\n<li>Table<\/li>\n\n\n\n<li>Chart<\/li>\n<\/ul>\n\n\n\n<p>The default output view is Table. The table view results can be exported to Excel, CSV, and JSON.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-5-1024x536-1.webp\" alt=\"\" class=\"wp-image-11891\"\/><\/figure>\n\n\n\n<p>We can change the view type to chart after query execution completes.<\/p>\n\n\n\n<p>Chart: Chart result can be saved JPEG, PNG, and SVG.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-6-1024x538-1.webp\" alt=\"\" class=\"wp-image-11892\"\/><\/figure>\n\n\n\n<p>Synapse providing six different types of charts:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-7.webp\" alt=\"\" class=\"wp-image-11893\"\/><\/figure>\n\n\n\n<p><strong>Authoring Notebook<\/strong><\/p>\n\n\n\n<p>Azure Synapse Analytics combines the best elements of Jupyter Notebooks or Databrick.We can create notebooks using any of our favorite languages:<\/p>\n\n\n\n<ul class=\"blog-detail-list wp-block-list\">\n<li>Python<\/li>\n\n\n\n<li>Scala<\/li>\n\n\n\n<li>C#<\/li>\n\n\n\n<li>Spark SQL<\/li>\n<\/ul>\n\n\n\n<p><strong>Note:<\/strong>&nbsp;Default language is PySpark,Business analysts, data engineers, and data scientists can now use the above languages interchangeably to run near real-time business intelligence, analytics, and machine learning pipelines. To change the language use the following syntax %%&lt;&lt;language&gt;&gt;.<\/p>\n\n\n\n<p>We will be able to execute the notebooks by using our Spark pools<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-8-1024x325-1.webp\" alt=\"\" class=\"wp-image-11894\"\/><\/figure>\n\n\n\n<p>Notebook execution results give two different types of outputs:<\/p>\n\n\n\n<ul class=\"blog-detail-list wp-block-list\">\n<li>Table<\/li>\n\n\n\n<li>Chart<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-9.webp\" alt=\"\" class=\"wp-image-11895\"\/><\/figure>\n\n\n\n<p>Table view<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/11\/Azure-Synapse-Analytics-Studio-10.webp\" alt=\"\" class=\"wp-image-11896\"\/><\/figure>\n\n\n\n<p>Chart View<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Conclusion<\/strong><\/h3>\n\n\n\n<p>The data hub offers a no-code experience for the users, enabling them to start exploring data without having a strong technical background. This user-friendly experience is one of the key reasons why Azure Synapse Analytics will be a game-changer. As we have seen, it is possible to develop everything without leaving Azure Synapse Analytics Studio, which is essential for promptly getting actionable insights and solutions. I am coming up with a new blog on Azure Synapse Analytics with Power App\u2019s Common Data Service, so stay tuned for more updates.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today\u2019s enterprise analytics requires enterprises to operate at a large scale on any data to facilitate better decision making. In the past, building analytics solutions requires organizations to stitch together big data and data warehousing technologies such as Spark and SQL to achieve results. Further, they were also needed to integrate them into rich data&hellip; <a class=\"more-link\" href=\"https:\/\/viewmyprojects.com\/winwirewp\/blog\/azure-synapse-analytics-studio\/\">Continue reading <span class=\"screen-reader-text\">Introducing Azure Synapse Analytics Studio<\/span><\/a><\/p>\n","protected":false},"author":52,"featured_media":16424,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_eb_attr":"","_uag_custom_page_level_css":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-11885","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","entry"],"acf":[],"featured_image_src":"https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data.webp","author_info":{"display_name":"Chandra","author_link":"https:\/\/viewmyprojects.com\/winwirewp\/author\/chandra\/"},"views":3996,"uagb_featured_image_src":{"full":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data.webp",801,440,false],"thumbnail":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data-150x150.webp",150,150,true],"medium":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data-300x165.webp",300,165,true],"medium_large":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data-768x422.webp",750,412,true],"large":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data.webp",750,412,false],"1536x1536":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data.webp",801,440,false],"2048x2048":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data.webp",801,440,false],"post-thumbnail":["https:\/\/viewmyprojects.com\/winwirewp\/wp-content\/uploads\/2023\/10\/Azure-Synapse-Link-Putting-Customers-Data.webp",801,440,false]},"uagb_author_info":{"display_name":"Chandra","author_link":"https:\/\/viewmyprojects.com\/winwirewp\/author\/chandra\/"},"uagb_comment_info":0,"uagb_excerpt":"Today\u2019s enterprise analytics requires enterprises to operate at a large scale on any data to facilitate better decision making. In the past, building analytics solutions requires organizations to stitch together big data and data warehousing technologies such as Spark and SQL to achieve results. Further, they were also needed to integrate them into rich data&hellip;&hellip;","_links":{"self":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts\/11885","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/users\/52"}],"replies":[{"embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/comments?post=11885"}],"version-history":[{"count":2,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts\/11885\/revisions"}],"predecessor-version":[{"id":18193,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/posts\/11885\/revisions\/18193"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/media\/16424"}],"wp:attachment":[{"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/media?parent=11885"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/categories?post=11885"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/viewmyprojects.com\/winwirewp\/wp-json\/wp\/v2\/tags?post=11885"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}