Experience: 3 to 8 years | Location: Chennai | Number of Position: 1

Mandatory Experience: Spark, Spark architecture, Data Ingestion, Data Analytics, Data Integration with Spark, Preferably PySpark, ETL Processes, Data Warehousing and Data Lakes, Python for Big Data and Analytics, Agile Scrum Model, CI/CD, AWS S3, Redshift, Lambda.

Requirements

· In depth understanding and knowledge on distributed computing with spark

· Deep understanding of Spark Architecture and internals

· Proven experience in data ingestion, data integration and data analytics with spark, preferably PySpark

· Expertise in ETL processes, data warehousing and data lakes

· Hands on with python for Big data and analytics

· Hands on in agile scrum model is an added advantage

· Knowledge on CI/CD and orchestration tools is desirable

· AWS S3, Redshift, Lambda knowledge is preferred

Our Client: A US MNC which is a AWS Advanced Consulting Partner with Big Data, EMR and Redshift competency, helping organizations accelerate their “Data-to-Insights-Leap”.