Azure Databricks| Working with Unit Tests

Ralph/ July 1, 2020/ Azure, Databricks

Introduction Problem Like any other program, Azure Databricks notebooks should be tested automatically to ensure code quality. Using standard Python Test Tools is not easy because these tools are based on Python files in a file system. And a notebook doesn’t correspond to a Python file. Solution To enable automated testing with unittest (documentation), we proceed as follows: Create a

Read More

Azure | Working with Widgets

Ralph/ May 29, 2020/ Azure, Databricks, Widgets

TL;DR Don’t want to read the post, then explore this Azure Notebook Requirements Define needed moduls and functions Create DataFrame for this post: Working with Widgets Default Widgets Multiselect Widgets Monitor the changes when selection values Filter Query by widgets Prepare widgets Now, change some values