As you know external tables are tables where Hive does not manage the data of…
Month: August 2021
How to convert a hive managed table to external table without recreating it ?
In Hive, Managed tables / Internal table are Hive owned tables and the tables data are managed and controlled by…
How to copy data from Redshift to Hive ? How to unload from Redshift in Parquet format ? Explained with Sample code .
There may be some business scenario to copy daily data from Redshift to Hive. For the compression , it is…
How to do Force serialization in AWS Redshift table by locking all tables?
You can force serialization by locking all tables in each session. The LOCK command blocks operations that would result in…
Serializable isolation violation on table in Redshift : ERROR: 1023 : Resolved solution
When you run concurrent Amazon Redshift operations in different sessions, there is a probability of getting “ERROR: 1023 DETAIL: Serializable…
How to concatenate multiple columns in a Spark dataframe
concat_ws : With concat_ws () function you can concatenates multiple input string columns together into a single string column, using…
Elastic Network Interfaces quick reference and cheat sheet
Elastic Network Interfaces – ENIs are virtual network cards you can attach to your EC2 instances. They are used to…
AWS EC2 quick reference and cheat sheet
Amazon EC2 is the virtual server instances on the AWS cloud. Amazon EC2 provides varying combinations of CPU, memory, storage,…