Rajas Walavalkar – Medium

Rajas Walavalkar

Rajas Walavalkar

Leveraging Amazon Athena with Apache Spark Engine to Analyze Data and deriving Insights

Apache Spark within Amazon Athena is game changing technology that enables analyzing heavy datasets with Spark engine to get insights

5 min readApr 15, 2024

--

Leveraging Amazon Athena with Apache Spark Engine to Analyze Data and deriving Insights

--

Rajas Walavalkar

AWS Cognito user authorization using IAM roles and accessing AWS services using temporary…

Leveraging Amazon Cognito user pools to generate temporary user credentials for user authorization.

5 min readApr 14, 2024

--

AWS Cognito user authorization using IAM roles and accessing AWS services using temporary…

--

Rajas Walavalkar

Exploring AWS Data Exchange for sharing datasets across AWS accounts

Leveraging AWS Data Exchange to share dataset access across AWS accounts. Blog covers a step-by-step process with an example

7 min readApr 13, 2024

--

Exploring AWS Data Exchange for sharing datasets across AWS accounts

--

Rajas Walavalkar

Real-time pipeline with Zero-ETL integration from Aurora MySQL to Amazon Redshift

Explore seamless data integration from Aurora MySQL to Redshift with zero ETL, optimizing performance and agility of your data pipelines

9 min readApr 9, 2024

--

Real-time pipeline with Zero-ETL integration from Aurora MySQL to Amazon Redshift

--

Rajas Walavalkar

Deploy Apache Iceberg Data Lake on Amazon S3 using AWS Glue Spark job

Learn how to create a transactional data lake on Amazon S3 using Iceberg table format with AWS Glue Spark jobs and using Glue Data Catalog

7 min readMar 19, 2024

--

1

Deploy Apache Iceberg Data Lake on Amazon S3 using AWS Glue Spark job

--

1

Rajas Walavalkar

Integrate Glue Data Quality rules within AWS Glue Visual Studio ETL jobs

Empowering AWS Glue Visual Studio with Glue Data Quality rulesets to create a Visual workflow for evaluating Data Quality rules

7 min readMar 11, 2024

--

Integrate Glue Data Quality rules within AWS Glue Visual Studio ETL jobs

--

Rajas Walavalkar

Create AWS Glue Data Quality Ruleset with Recommendations and DQDL Rules

Explore how to leverage AWS Glue Data Quality to create DQ rulesets to be evaluated against the Datasets with automated recommended DQ…

7 min readMar 10, 2024

--

1

Create AWS Glue Data Quality Ruleset with Recommendations and DQDL Rules

--

1

Rajas Walavalkar
in
AWS Tip

Gen AI powered by Amazon Code Whisperer within AWS Glue Studio Notebooks

This blog covers one of the most interesting feature to work with the CodeWhisperer recommendations integrated with AWS Glue Studio…

5 min readAug 18, 2023

--

Gen AI powered by Amazon Code Whisperer within AWS Glue Studio Notebooks

--

Rajas Walavalkar

Getting Started with AWS Clean Rooms Service

Hands-on lab with step by step process to setup collaborations in the AWS clean rooms and associate tables for querying the data using SQL

8 min readJul 27, 2023

--

1

Getting Started with AWS Clean Rooms Service

--

1

Rajas Walavalkar

Kinesis Streaming Data Ingestion into Amazon Redshift

Hands-on lab showcasing the implementation of Redshift streaming data ingestion with Kinesis Data Streams as source for real-time…

6 min readJul 21, 2023

--

Kinesis Streaming Data Ingestion into Amazon Redshift

--

Rajas Walavalkar

Rajas Walavalkar

Technical Architect - Data & AWS Ambassador at Quantiphi Analytics. Worked on ETL, Data Warehouses, Big Data (AWS Glue, Spark), BI & Dashboarding (D&A).

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams