In PySpark, spark.table() is used to read a table from the Spark catalog, whereas spark.read.table()…
Category: article
PySpark : Exploring PySpark’s last_day function with detailed examples
PySpark provides an easy-to-use interface for programming Spark with the Python programming language. Among the numerous functions available in PySpark,…
DBT : Dealing with single quotes in SQL statements [Escape single quotes in SQL]
DBT is a popular open-source data modeling tool that allows you to transform and analyze data using SQL. One feature…
DBT : Converting a variable into a string in DBT
Jinja’s as_text filter is a way to convert a variable into a string in Jinja. It is often used to…
Snowflake : How Snowflake handle backup and recovery?
In this article, we will discuss how Snowflake handles backup and recovery, and how these features help ensure the integrity…
Snowflake : Process of scaling and managing Snowflake clusters
Snowflake’s architecture is designed to provide virtually unlimited scale, allowing users to easily scale up or down based on their…
Snowflake : An overview of Snowflake’s Data Sharing feature
One of Snowflake’s most popular features is its data sharing capability, which allows organizations to securely share data with external…
Shell : Deleting empty subdirectories in a directory
In Unix-based operating systems, it is common to write shell scripts to automate tasks. One common task is deleting empty…
Shell : Sync a folder from one Linux instance to another Linux instance in a specific path.
In Linux-based operating systems, it is common to synchronize files between different instances. One way to do this is by…
Shell : Script that iterates all it directory and sub directory and find the word search and print the complete file path.
One common task is searching for a specific word in all files in a directory and its subdirectories. This is…
Shell : Script that takes a file name as an argument and checks if it’s readable or not.
One common task is checking if a file is readable before proceeding with a script. This is useful to prevent…