1. What is Source Qualifier Transformation ?
The source qualifier transformation is an active,connected transformation used to represent the rows that the integrations service reads when it runs a session. You need to connect the source qualifier transformation to the relational or flat file definition in a mapping. It filters rows while reading the data from a source.It can filter rows only from relational sources.It limits the row sets extracted from a source. It enhances performance by minimizing the number of rows used in mapping. In this, filter condition uses the standard SQL to execute in the database.
2. Can you compare Amazon Redshift vs Microsoft SQL Server
|
Name |
Amazon Redshift X |
Microsoft SQL Server X |
|
Description |
Large scale data warehouse service for use with business intelligence tools |
Microsofts relational DBMS |
|
Primary database model |
Relational DBMS |
Relational DBMS |
|
Secondary database models |
Document store |
|
|
Graph DBMS |
||
|
Developer |
Amazon (based on PostgreSQL) |
Microsoft |
|
Cloud-based only |
yes |
no |
|
Implementation language |
C |
C++ |
|
Server operating systems |
hosted |
Linux |
|
Windows |
||
|
Data scheme |
yes |
yes |
|
Typing |
yes |
yes |
|
XML support |
no |
yes |
|
Secondary indexes |
restricted |
yes |
|
SQL |
yes |
yes |
|
APIs and other access methods |
JDBC |
ADO.NET |
|
ODBC |
JDBC |
|
|
ODBC |
||
|
OLE DB |
||
|
Tabular Data Stream (TDS) |
||
|
Supported programming languages |
All languages supporting JDBC/ODBC |
C# |
|
C++ |
||
|
Delphi |
||
|
Go |
||
|
Java |
||
|
JavaScript (Node.js) |
||
|
PHP |
||
|
Python |
||
|
R |
||
|
Ruby |
||
|
Visual Basic |
||
|
Server-side scripts |
user defined functions |
Transact SQL, .NET languages, R, Python and (with SQL Server 2019) Java |
|
Triggers |
no |
yes |
|
Partitioning methods |
Sharding |
Tables can be distributed across several files (horizontal partitioning); sharding through federation |
|
Replication methods |
yes |
yes, but depending on the SQL-Server Edition |
|
MapReduce |
no |
no |
|
Consistency concepts |
Immediate Consistency |
Immediate Consistency |
|
Foreign keys |
yes |
yes |
|
Transaction concepts |
ACID |
ACID |
|
Concurrency |
yes |
yes |
|
Durability |
yes |
yes |
|
In-memory capabilities |
yes |
yes |
|
User concepts |
Fine grained access rights according to SQL-standard |
Fine grained access rights according to SQL-standard |
3. What is round-robin partitioning?
The round robin method always creates approximately equal size partitions. The first record goes to the first processing node, the second to the second processing node, and so on. for example, if we have 3 nodes and 8 records then first record will go to first node, second record will go to second node, third record will go to third node, fourth record will go to first node and fifth record will go to second node.
4. What is Key Generator Transformation Overview ?
The Key Generator transformation is an active transformation that organizes records into groups based on data values in a column that you select. Use this transformation to sort records before passing them to the Match transformation.
5. How to load first and last records into target table ?
Add a sequence number to the records and then take the Top 1 rank and Bottom 1 Rank from the records.
