10

How to dynamically create SQL Serverless views from Azure Synapse Pipelines

 3 years ago
source link: https://endjin.com/what-we-think/talks/how-to-dynamically-create-sql-serverless-views-from-azure-synapse-pipelines.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

How to dynamically create SQL Serverless views from Azure Synapse Pipelines

James Broome 4th February 2022

Data Toboggan 2022

SQL Serverless allows you to add structured schemas over standard file formats in your data lake storage. For all the benefits this brings, one of the trade offs is that your schema is only enforced "on read", rather than "on write".

So if it's your Synapse Pipelines that are responsible for writing/updating the data that is stored in your data lake, then they should also be responsible for updating the schema of the SQL Serverless views that you use to query it.

In this session, James Broome will show a simple way to dynamically update SQL Serverless views from with a Synapse Pipeline so that they're always up to date with the data in your data lake.

You can also subscribe to our YouTube and Vimeo channels


report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK