Starting with Azure Synapse Analytics: Part 1: Create a Workspace and Analyze Sample Data with Serverless SQL Pool

In this blog post, I show you how easy it is to start an Azure Synapse Analytics workspace (instance) and use its Serverless SQL Pool engine to analyze sample publicly available data. As you will read shortly, Azure Synapse Analytics provides many compute engines for different use cases. The easiest one to get started with … Continue reading Starting with Azure Synapse Analytics: Part 1: Create a Workspace and Analyze Sample Data with Serverless SQL Pool

Incremental Refresh for Power BI datasets based on a numeric column (Year): Working with Parquet/Delta files in Azure Synapse Analytics

The most common scenario for setting up the out of the box incremental refresh in Power BI is to base it off of a datetime column; however, there are cases when you may want to set up incremental refresh based off of a column with a data type other than datetime. Examples are when you … Continue reading Incremental Refresh for Power BI datasets based on a numeric column (Year): Working with Parquet/Delta files in Azure Synapse Analytics

Exploring Automatic Partition Maintenance in Power BI datasets with Incremental Refresh, using EffectiveDate parameter

During one of my presentations on Incremental Refresh (IR) in Power BI, someone asked what happens during a Power BI automatic partition maintenance window when Power BI has an opportunity to merge smaller partitions into larger ones. Does Power BI use the data that is already imported into Power BI for the smaller partitions and … Continue reading Exploring Automatic Partition Maintenance in Power BI datasets with Incremental Refresh, using EffectiveDate parameter

A look at automatic partition maintenance by Power BI Service for datasets with Incremental Refresh

In this post, I am going to look at automatic partition maintenance by Power BI service for datasets with Incremental Refresh and focus on what happens to the partitions as time goes by. To do this, I am going to set up a couple of sample datasets with different Incremental Refresh (IR) policies with and … Continue reading A look at automatic partition maintenance by Power BI Service for datasets with Incremental Refresh

Slides for Intro to Lakehouse in Microsoft Fabric

Here are the slides for my Intro to Lakehouse in Microsoft fabric. If you are new to Microsoft Fabric, check out my post here for an intro. Introdcution-to-Lakehouse-in-Fabric-2023-09-11-Shabnam-Watson-2Download I will upload sample notebooks later today and update this post.

How does the DirectQuery partition of a Hybrid table in Power BI get used in queries?

While I was tracing some Power BI datasets with Hybrid tables, I noticed that that the DirectQuery partition of a Hybrid table is used in all queries submitted to the Hybrid table, whether or not they are asking for data from that Direct Query partition. On first look, this does not look good because Power … Continue reading How does the DirectQuery partition of a Hybrid table in Power BI get used in queries?

Error running a SQL Server Profiler trace for a Power BI dataset: Either the trace with the ID of ‘MicrosoftProfilerTrace1667261566’ does not exist …

I was trying to trace a dataset I had published to Power BI service using SQL Server Profiler and I was getting this error: Either the trace with the ID of 'MicrosoftProfilerTrace1667261566' does not exist in the server with the ID of 'autopremiumhostnorthcentralus001-081', or the user does not have permissions to access the object. For … Continue reading Error running a SQL Server Profiler trace for a Power BI dataset: Either the trace with the ID of ‘MicrosoftProfilerTrace1667261566’ does not exist …