Airflow : Using Boto3 in Airflow
Boto3 is the Amazon Web Services (AWS) SDK for Python, which allows Python developers to write software that makes use…
PySpark : Setting PySpark parameters – A complete Walkthru [3 Ways]
In PySpark, you can set various parameters to configure your Spark application. These parameters can be set in different ways…
PySpark : Using CASE WHEN for Spark SQL to conditionally execute expressions : Dataframe and SQL way explained
The WHEN clause is used in Spark SQL to conditionally execute expressions. It’s similar to a CASE statement in SQL…
Spark : Calculation of executor memory in Spark – A complete info.
The executor memory is the amount of memory allocated to each executor in a Spark cluster. It determines the amount…
Hive : How to load JSON and nested JSON in Hive and how to view it [Sample code with Data]
In this article, I’ll walk you through how to read JSON data from a Hive table using an example with…
Snowflake : LIMIT and FETCH of Snowflake . How it differs ? When and where its used.
In Snowflake, the LIMIT and FETCH clauses are used to limit the number of rows returned by a query. While…
Snowflake : Filtering the results of window functions in Snowflake [QUALIFY]
One of the features that sets Snowflake apart from other data warehousing solutions is its support for advanced SQL constructs…
Snowflake : Cube in detail. Learn how to implement Cube in Snowflake
In data warehousing, a cube is a multi-dimensional representation of data. It allows users to view data from different perspectives,…
Snowflake : Getting sampled row from the specified table in Snowflake [SAMPLE,TABLESAMPLE]
Two of the most useful tools for working with large datasets in Snowflake are the SAMPLE and TABLESAMPLE functions. The…
Snowflake : Snowflake’s UNPIVOT function – Transform columns into rows in a table
One of the many powerful features of Snowflake is its UNPIVOT function, which allows users to transform columns into rows…