Shreyansh Gupta

💻 Software Engineer • Sharing my learnings

[Shreyansh Gupta @_backslashzero]

#TIL about #AWS data exchange that can be used to subscribe and make use of third party datasets in #Amazon Redshift.

[Shreyansh Gupta @_backslashzero]

#TIL that we can view query by query analysis for every query that has run on #AWS Redshift including execution plans.

[Shreyansh Gupta @_backslashzero]

#TIL about the different migration strategies that we can use to migration from one #database to another.
1. One step migration
2. Two steps migration
3. Iterative migration

[Shreyansh Gupta @_backslashzero]

#TIL about #AWS SCT that can be used to convert the schema for a source database to any supported database that is hosted on AWS.

[Shreyansh Gupta @_backslashzero]

#TIL about #AWS Snow family devices that include physical devices shipped to your place. These can be used to ship data in and out of AWS.

https://t.co/f7HmeQ2KTn

[Shreyansh Gupta @_backslashzero]

#TIL about DDM that allows us to dynamically mask PII while querying data in #AWS Redshift.

[Shreyansh Gupta @_backslashzero]

#TIL that we can use current_namespace system variable in the view definition to create multi tenant views in #AWS Redshift.

[Shreyansh Gupta @_backslashzero]

#TIL that #SQL queries in modern databases can, in fact, use multiple indexes contrary to what I had earlier believed.

[Shreyansh Gupta @_backslashzero]

VACUUM recluster option in #AWS Redshift can be useful if our queries access only the most recent data.

[Shreyansh Gupta @_backslashzero]

#TIL that we can use the recluster option during VACUUM operation in #AWS Redshift to sort the unsorted table portions without merging the data with the automatically sorted portions of the table.

[Shreyansh Gupta @_backslashzero]

#AWS Redshift will even go as far as automatically creating MVs based on query patterns using the AutoMV feature.

[Shreyansh Gupta @_backslashzero]

#TIL that #AWS Redshift automatically converts queries to use MVs if an appropriate MV is present that can respond to the query.

[Shreyansh Gupta @_backslashzero]

#TIL about WLM in #AWS Redshift and how you can use queues, QMR along with catalog tables to optimize your workloads.

[Shreyansh Gupta @_backslashzero]

#TIL about concurrency scaling in #AWS Redshift and how it scales workgroups automatically to meet the change in the workloads.

[Shreyansh Gupta @_backslashzero]

#DoYouKnow That #AWS Redshift uses ATO (Automatic table optimization) to automatically optimize the tables by configuring sort keys, dist keys and encoding when the table is created with the AUTO option.

[Shreyansh Gupta @_backslashzero]

#TIL You can use Redshift ML to train and use ML models using familiar #SQL commands. No need to learn new tools.

[Shreyansh Gupta @_backslashzero]

#TIL about tool calling in architectures of #AI applications. The possibilities that this feature opens up are amazing.

[Ryan Hawk @RyanHawk12]

A few lessons on showing up by @moretothat

[Shreyansh Gupta @_backslashzero]

#TIL The SQL Row values syntax can also be used in the WHERE clauses. It is most commonly seen in the INSERT statements.

Check out the usage here - https://t.co/bXOi3gHTbL

#SQL #Databases

[Shreyansh Gupta @_backslashzero]

#DoYouKnow Ensuring that the database executes the query in a pipelined manner is more important than a fast execution!

Read more here - https://t.co/98znxU1dWL

#SQL #Databases