Posts

Dynamic Masking with Microsoft Fabric

Image
When I recently posted about CDC I stated that Dynamic Masking on Delta Tables was not available. It is possible with Microsoft Fabric Warehouse Tables however. SQL CREATE TABLE dbo.EmployeeData (     EmployeeID INT     ,FirstName VARCHAR ( 50 ) MASKED WITH ( FUNCTION = 'partial(1,"-",2)' ) NULL     ,LastName VARCHAR ( 50 ) MASKED WITH ( FUNCTION = 'default()' ) NULL     ,Salary DECIMAL MASKED WITH ( FUNCTION = 'default()' ) NULL     ,email VARCHAR ( 256 ) NULL     ); INSERT INTO EmployeeData SELECT [EmployeeKey] ,[FirstName] ,[LastName] ,(BaseRate* 1950 ) ,[EmailAddress] FROM [Mywarehouse].[dbo].[DimEmployee] SELECT * FROM dbo.EmployeeData; Unmasked Data Masked Data  We can confirm this is  a Delta Table I have, so far, been unable to set ChangeDataCapture for this table however conceptually I think this is not what the warehouse is for. Rather the Warehouse is the destination for your Gold data layer ...

Python Code for Mapping Data Flow Users: Part 1 - Multiple Inputs

Image
  Why Learn Python Microsoft has published a how-to guide for Dataflows Gen2. In it they maintain: Microsoft Fabric’s Data Factory experience provides an intuitive and user-friendly interface using Power Query Online that can help you streamline your data transformation workflows when authoring Dataflow Gen2. If you’re a developer with a background in Azure Data Factory and Mapping Data Flows, you’ll find this guide helpful in mapping your existing Mapping Data Flow transformations to the Dataflow Gen2 Power Query user interface. These dataflow do not readily avail themselves of similar functionality and as things stand in Fabric the real strength will be the use of Notebooks. From all of my investigation and exploration nothing yet has abused me of the view the Code First is the way to go for Fabric. So, I have put together this and subsequent posts to demonstrate how the functionality can be achieved from Notebooks using Python as would be used in Mapping Data flow. Loading Data...