In this HowTo I will show you how to load weather data from the OpenWeather API into the Databricks Lakehouse. The data is loaded via REST API from OpenWeather and then processed in the Medallion architecture in the Lakehouse. Finally, I build a simple Lakeview dashboard on top of it.
How To: Copying all schemas and tables from one catalog to another catalog in Databricks
In this quick guide, I will show you how to automatically copy all schemas and tables from one catalog to another in Databricks.
dbt core: Set up in VS Code and run seamlessly on Databricks – step by step
In this step-by-step guide, I will show you how to install dbt core locally in Visual Studio Code, set up the corresponding Visual Studio Code Extension and run dbt on Databricks.
How to create a self-hosted Airbyte environment in the Azure Cloud
In this quick guide, I will show you how to set up an Airbyte environment in a virtual machine in Azure.
How to create an Azure Databricks Lakehouse including Unity Catalog, DataLake and KeyVault – step by step
In this step-by-step guide, I describe how to create a Databricks Lakehouse environment in the Azure Cloud within 30 minutes. This guide is aimed at people who are new to Databricks and want to create an environment for a proof of concept or for practicing.
I can now also be found on Medium
I have now decided in the old year to write on Medium as well as my personal blog.
Here is the link to my Medium page: https://stefanko-ch.medium.com
It would be nice if you followed me on Medium.
First steps with the Azure Cloud
Azure is Microsoft’s cloud computing platform. It offers a comprehensive suite of cloud services that enable companies to develop, deploy and manage applications without having to have physical hardware on site. Azure enables users to use resources such as virtual machines, storage, databases, networks and much more in Microsoft’s globally distributed data centers. The Azure Cloud is one of the leading hyper-scalers on the market. In the following article, I would like to give beginners a few useful tips to make it easier to get started with the Azure portal.
Connect Databricks SQL Warehouse with DBeaver
In this quick guide I will show you how to connect to a Databricks SQL Warehouse Cluster with DBeaver.
Free Databricks Training: Generative AI Fundamentals
Everyone is talking about generative AI. But what is it exactly? Find out for yourself in this interesting course from Databricks
Data + AI World Tour 2023 in Zurich
On November 23rd, the Databricks “Data + AI World Tour” is coming to Zurich!