Delivering Real-time Data with Azure and Power BI
Amit Andre NetCom Learning www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Agenda • • • • •
Why consider the cloud? Cloud innovation presents challenges for IT Building a Modern Data Warehouse in Azure for Power BI Power BI Consumption Planning Power BI Data Source Planning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Why consider the cloud?
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Cloud innovation presents challenges for IT
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Enterprise needs
Integration
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Heterogeneity
Security
Š1998-2019 NetCom Learning
Enterprise needs
Virtualization
Integration
Identity
Microsoft Azure fundamentals
On-premises AND Cloud
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Development
Data Platfor
DevOps and mgmt
Š1998-2019 NetCom Learning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Microsoft Azure delivers.
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Huge infrastructure scale is the enabler
19 Regions ONLINE…huge datacenter capacity around the world…and we’re growing
North Europe Central US Iowa
US Gov
Ireland
North Central US
Illinois
West Europe Netherlands
China North * Beijing
East US
Iowa
West US
Virginia
South Central US
Texas
Saitama
Shanghai
East US 2
California
Japan East
China South *
Virginia
India West
US Gov
India East
TBD
Virginia
Japan West Osaka
TBD
East Asia
Hong Kong
SE Asia
Brazil South
Singapore
Sao Paulo
▪ ▪ ▪ ▪
100+ datacenters One of the top 3 networks in the world (coverage, speed, connections) 2 x AWS and 6x Google number of offered regions G Series – Largest VM available in the market – 32 cores, 448GB Ram, SSD… www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Australia East Sydney
Australia West Melbourne
Operational
Announced
©1998-2019 NetCom Learning
* Operated by 21Vianet
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
vpn
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Building a Modern Data Warehouse in Azure for Power BI
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Building a Modern Data Warehouse Solution for Power BI
Why build a Data Warehouse solution?
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Data Warehouse Solution
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Power BI, a Data Analytics Solution … in a box
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Power BI let’s you experience your data
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
When is a Data Warehouse Solution not needed?
1. Not an enterprise use caseor scenario 2. Simple model, few reports 3. Very few users 4. Short term use
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Why is Power BI not a Data Warehouse solution
1. 2. 3. 4.
Performance Data Quality Reliability Access and Updates
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
So you decided you do need a Data Warehouse solution… now what? Build a modern Data Warehouse solution in the cloud …
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Power BI connects to data sources and provides consumption options for users. Cloud data sources
Consume
Azure Analysis Services, SQLAzure, etc.
Consumption by end users
PBI Desktop Scheduled refresh/ Live connection/ DirectQuery
PBI Service
Group OneDrive
Datasets
Scheduled refresh/ Live connection/ DirectQuery
On-prem data sources Analysis Services, SQLServer, etc.
Reports
Dashboards
THEBIG PICTURE‌
On-Premises Gateway
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
We will discuss key consumption capabilities, how they are often used, and best practices around them. We will then discuss how to work with cloud data sources. Cloud data sources Azure Analysis Services, SQLAzure, etc.
Consumption by end users
PBI Desktop Scheduled refresh/ Live connection/ DirectQuery
PBIService
Group OneDrive
Datasets
Scheduled refresh/ Live connection/ DirectQuery
On-prem data sources Analysis Services, SQLServer, etc.
Reports
On-Premises Gateway
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Dashboards
TODAY’S FOCUS… ©1998-2019 NetCom Learning
WHAT WE WILL TALK ABOUT TODAY…
1. Power BI Consumption Planning 2. Power BI Data Source Planning 3. Next Steps
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Cloud data sources
Consume
Azure Analysis Services, SQLAzure, etc.
Consumption by end users
PBI Desktop Scheduled refresh/ Live connection/ DirectQuery
PBIService
Group OneDrive
Datasets
Scheduled refresh/ Live connection/ DirectQuery
On-prem data sources Analysis Services, SQLServer, etc.
Reports
Dashboards
CONSUMPTION PLANNING…
On-Premises Gateway
PowerBIconnectsto datasourcesandprovidesmanypowerful consumptionoptionsfor users. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
CONSUMPTION PLANNING… Power BI portal (reports, Q&A, quick insights)
Mobile apps
Data alerts
Embedded in apps using APIs
Export static views to PowerPoint or print
Email subscriptions
Therearemultipleapproachesto consumingdataviaPowerBI. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Ad-hoc analysis with Analyze in Excel
©1998-2019 NetCom Learning
CONSUMPTION PLANNING… Power BI portal (reports, Q&A, quick insights)
Mobile apps
Data alerts
Embedded in apps using APIs
Export static views to PowerPoint or print
Email subscriptions
Therearemultipleapproachesto consumingdataviaPowerBI. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Ad-hoc analysis with Analyze in Excel
©1998-2019 NetCom Learning
CONSUMPTION PLANNING…
WithinthePowerBIservicebetweenreports,dashboards,Insights,Q&Aand morethereisatremendousamountof capabilityavailabletoday. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
CONSUMPTION PLANNING… Power BI portal (reports, Q&A, quick insights)
Mobile apps
Data alerts
Embedded in apps using APIs
Export static views to PowerPoint or print
Email subscriptions
Therearemultipleapproachesto consumingdataviaPowerBI. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Ad-hoc analysis with Analyze in Excel
©1998-2019 NetCom Learning
CONSUMPTION PLANNING…
Embeddingoptionsareprovidedby Microsoftin manyof theirtechnologies today.PowerBIisenabledin Teamsto showcasekeyreports. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
CONSUMPTION PLANNING…
ItisalsoavailablewithinSharePointmodernsites.
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
CONSUMPTION PLANNING…
Don’t forgetthatyoucanalsopublishPowerBIreportsandembedthemon publicsites.Checkoutthisone:http://www.pbiusergroup.com/home www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
CONSUMPTION PLANNING‌ Integrate AccessREST/JSONServices APIsfor Power BI,including publishing content Integrate tiles and reports into applications
Extend Content Packsenable instant insights over application data. Custom visualizations enable data experience tailored to eachuse case
Embed Embed Power BIintoyour application Embed Visual Analytics powered by Power BIinto your apps
https://visuals.powerbi.com
Push datasets to PowerBI
Embeddingisoneoption,butthereareotherwaysto consumePowerBIlike theembedmodel. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
CONSUMPTION PLANNING… Is the app exclusively used by internal employees?
No Yes
Do users need to be authenticated?
Use PowerBI.com RESTAPIs
No Yes
Use Power BI Embedded
Use Power BI publish to web
Authentication
Via PowerBI.com Azure Active Directory
Via application, using Power BI app tokens
N/A
User licensing
UsersPowerBI.com subscription
Consumption based, via Azure No end-user license required
No end-user license required
Report authoring
Power BI Desktop and Power BI.com subscription
Power BI Desktop Azuresubscription
PowerBI.com subscription and/or Power BIDesktop
Embeddingisoneoption,butthereareotherwaysto consumePowerBIlike theembedmodel. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
CONSUMPTION PLANNING… Power BI portal (reports, Q&A, quick insights)
Mobile apps
Data alerts
Embedded in apps using APIs
Export static views to PowerPoint or print
Email subscriptions
Therearemultipleapproachesto consumingdataviaPowerBI. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Ad-hoc analysis with Analyze in Excel
©1998-2019 NetCom Learning
CONSUMPTION PLANNING…
Getnotifiedrightwhendatachanges.IntegratewithMicrosoftFlow. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
CONSUMPTION PLANNING… Power BI portal (reports, Q&A, quick insights)
Mobile apps
Data alerts
Embedded in apps using APIs
Export static views to PowerPoint or print
Email subscriptions
Therearemultipleapproachesto consumingdataviaPowerBI. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Ad-hoc analysis with Analyze in Excel
©1998-2019 NetCom Learning
CONSUMPTION PLANNING…
E-mailsubscriptionsdeliveredafterdata refresh.
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Cloud data sources
Consume
Azure Analysis Services, SQLAzure, etc.
Consumption by end users
PBI Desktop Scheduled refresh/ Live connection/ DirectQuery
PBIService
Group OneDrive
Datasets
Scheduled refresh/ Live connection/ DirectQuery
On-prem data sources Analysis Services, SQLServer, etc.
Reports
Dashboards
CONSUMPTION PLANNING…
On-Premises Gateway
PowerBIconnectsto datasourcesandprovidesmanypowerful consumptionoptionsfor users. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
WHAT WE WILL TALK ABOUT TODAY…
1. Power BI Consumption Planning 2. Power BI Data Source Planning 3. Next Steps
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Cloud data sources
Consume
Azure Analysis Services, SQLAzure, etc.
Consumption by end users
PBI Desktop Scheduled refresh/ Live connection/ DirectQuery
PBIService
Group OneDrive
Datasets
Scheduled refresh/ Live connection/ DirectQuery
On-prem data sources Analysis Services, SQLServer, etc.
Reports
Dashboards
DATASOURCE PLANNING…
On-Premises Gateway
PowerBIconnectsto datasourcesandprovidesconsumptionoptionsforusers. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
DATASOURCE PLANNING… Azure SQLIaaS, Azure SQL This is your curated and managed data layer. DW or Azure SQLService
Azure Analysis Services
This is your semantic layer. Remove calculation development, model tasks away from user responsibility, etc.
Azure Event Hub & Stream This is for real-time reporting of streaming data (typically via IoT). Analytics Azure Machine Learning & This means Rmodels can be automated and become part of thedata production CortanaAnalytics process that is ultimately consumed by PowerBI. Azure Data Lake & Azure HDInsight Azure Data Catalog
This can be especially helpful as a Analytics Sandbox where your users may not know ahead of time the questions they would like to ask of the data. This can help users find quality data sources to use based on IT setting up the Azure Data Catalog and users maintaining the metadata around tables andcolumns.
Therearemanypossibledatasourcesfor PowerBI.Let’sfocuson theCloudsources basedon Azure.Thisisnotacomprehensivelist,butagood summaryof keyones. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
DATASOURCE PLANNING‌
Complex Moderate Simple
Model size and complexity
Data update frequency
Active concurrent users Number of queries Query latency
time
time time
Youneedto decidehowyouwantto modelthedatasourcefor PowerBI. Considerthesefactorsfor decidingCloudModelor ExternalModel? www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
DATASOURCE PLANNING‌ Consider Import:
Consider DirectQuery
Consider Live connection to Azure Analytics Services
Youneedto decidehowyouwantto modelthedatasourcefor PowerBI. Considerthesefactorsfor decidingCloudModelor ExternalModel? www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
DATASOURCE PLANNING‌ Consider Import:
Theimportmethodcanworkwellfor smallto mediumdatamodelswith moderateconcurrentusage. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
DATASOURCE PLANNING… Consider Live connection to AAS
Thiscanbeagreatmethodandisoftenneededif scheduledrefreshwon’t satisfyyourneedsandthisscalesfor muchlargermodelanduserconcurrency. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
AZUREANALYSIS SERVICESPLANNING…
AzureAnalysisServicescanbeextremelyhelpfulwhenyouwantto connectand combinemultipledatasourcessousersdon’t haveto accessthedatasource. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
DATASOURCE PLANNING… Consider DirectQuery
BeREALLYcarefulhere.ThisisthenumberonereasonoftenPowerBIis‘slow’for realcustomers.Thiscanbegreat,buthascaveats!Usethisonlywhenneeded. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Cloud data sources
Consume
Azure Analysis Services, SQLAzure, etc.
Consumption by end users
PBI Desktop Scheduled refresh/ Live connection/ DirectQuery
PBIService
Group OneDrive
Datasets
Scheduled refresh/ Live connection/ DirectQuery
On-prem data sources Analysis Services, SQLServer, etc.
Reports
Dashboards
DATASOURCE PLANNING…
On-Premises Gateway
PowerBIconnectsto datasourcesandprovidesconsumptionoptionsforusers. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
WHAT WE WILL TALK ABOUT TODAY… 1. Power BI Consumption Planning 2. Power BI Data Source Planning 3. Next Steps
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
THEREIS ALWAYS MORE PLANNING…
▪ Power BIfit and purpose planning (in your enterprise BI technology landscape). • SSRSand Power BIboth focus on the delivery experience for BI.It also impacts analyze and authoring (desktop, Excel, etc.) ▪ External users and external sharingplanning. ▪ Export planning. ▪ Content pack, solution templates, and organizational planning. ▪ On-premises data planning (gateway,etc.). ▪ Integration and embed planning. ▪ Mobility planning. ▪ ITLed: Seeded Dashboards, Workspaces, connections & content planning.
▪ Security and distribution planning… etc. etc.etc.
Fromlicensing,governance,security,distributionanddeeperdivesinto performancethereismorethatyoushouldinvestigateand learn. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
SOGO LEARN MORE!
Getting started… • • • •
PowerBIfor Office 365 - Overview and Learning PowerBI- Getting StartedGuide PowerBI- ProvisioningGuide PowerBIKnownIssues
Forums and blogs… • • • • •
PowerPivotForum PowerBIForum PowerQueryForum Q&A Forum Power BIBlog
Guided learning…
Thereareatremendousnumberof tutorials,communityresourcesandexamples thatyoucanuseto learnbygettinghandson. www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Recorded Webinar Video
To watch the recorded webinar video for live demos, please access the link: https://goo.gl/ohV2wG
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
About NetCom Learning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Recommended Courses & Marketing Assets Courses: » 20778: Analyzing Data with Power BI - Class scheduled on Feb 04
» Microsoft Power BI Desktop and Microsoft Power Query - Class scheduled on Feb 11 » 552241: Microsoft Azure Big Data Analytics Solutions - Class scheduled on Feb 18 » Microsoft Power BI Interactive Data Visualizations » EDX11004: Analyzing and Visualizing Data with Power BI - DAT207x » EDX11308: Processing Real-Time Data Streams in Azure - DAT223.2x
Marketing Assets: •
Free On-Demand Training - Hands-On Power BI for Data Visualization
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning
Connecting Microsoft Azure Virtual Networks ITIL 4 Foundation: Core Concepts and New Version Updates Autodesk Revit: File Management Techniques for BIM Managers Get Started with Python Programming Going Head-to-Head: CompTIA PenTest+ vs. CEH How to Successfully Migrate Office 365 Exploring the New Office 365 SQL Server 2017: Indexing for Higher Performance www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Promotions
Learn the skills that are needed for tomorrow's most fascinating roles Build your, or team’s, or department’s skills with the most in-demand training courses in 2019. Cloud, Security, Networking, Data & AI, Design & Multimedia, Business Application, Application Development and Business Process training at limitedtime prices, you can imbibe in-demand skills while making a huge saving on the training cost. Learn More www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
Follow Us On:
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
Š1998-2019 NetCom Learning
THANK YOU !!!
www.netcomlearning.com | info@netcomlearning.com | (888) 563 8266
©1998-2019 NetCom Learning