PI2_Data Engineer

Job description

Cloud Big Data

· 
Experience in implementing core Big Data services in cloud according to basic architecture best practices 

· 
Experience in design and maintenance of Big Data 

· 
Experience in Big Data tools to automate data analysis 

· 
Minimum five years hands-on experience in a data analytics field 

 

· 
Background in defining and architecting Big Data services with the ability to explain how they fit in the data life cycle of collection, ingestion, storage, processing, and visualization 

· 
Experience in designing a scalable and cost-effective architecture to process data 

· 
Experience in any of the two : EMR/HD insight cluster, Redshift,Glue/ Azure data factory, 

· 
Athena /Modern data factory, Amazon Kinesis/Azure stream, Snowflake,Azure data Bricks 

· 
Experience in Spark,Scala or Flink or Kafka or Python,SQL 

· 
Exp : 8 – 13 Yrs