Data Engineer - PySpark | AWS | Snowflake | DBT | Pune

Job Description

As a Data Engineer at our company, you will play a crucial role in supporting the successful delivery of Location Strategy projects. Your responsibilities will include planning, budgeting, and ensuring quality and governance standards. You will lead the transformation of our digital landscape by driving innovation and excellence, utilizing cutting-edge technology to enhance our digital offerings and deliver unparalleled customer experiences.Key Responsibilities:- Hands-on experience in pyspark with a strong understanding of Dataframes, RDD, and SparkSQL- Developing, testing, and maintaining applications on AWS Cloud- Proficiency in AWS Data Analytics Technology Stack including Glue, S3, Lambda, Lake Formation, and Athena- Designing and implementing scalable and efficient data transformation/storage solutions using Snowflake- Ingesting data into Snowflake using various storage formats such as Parquet, Iceberg, JSON, and CSV- Working with DBT (Data Build Tool) for ELT pipeline development in Snowflake- Writing advanced SQL and PL SQL programs- Building reusable components using Snowflake and AWS Tools/Technology- Hands-on experience in at least two major project implementations- Exposure to data governance or lineage tools like Immuta and Alation- Familiarity with Orchestration tools such as Apache Airflow or Snowflake Tasks- Knowledge of Abinitio ETL tool will be a plusQualifications Required:- Ability to engage with Stakeholders, elicit requirements/user stories, and translate requirements into ETL components- Understanding of infrastructure setup and ability to provide solutions either individually or collaboratively- Good knowledge of Data Marts and Data Warehousing concepts- Strong analytical and interpersonal skills- Experience in implementing Cloud-based Enterprise data warehouse with multiple data platforms, including Snowflake and NoSQL environment for data movement strategyAdditional Details:You may also be evaluated on key critical skills essential for success in this role, such as risk and controls, change and transformation, business acumen, strategic thinking, and digital and technology expertise. The position is based in Pune. As a Data Engineer at our company, you will play a crucial role in supporting the successful delivery of Location Strategy projects. Your responsibilities will include planning, budgeting, and ensuring quality and governance standards. You will lead the transformation of our digital landscape by driving innovation and excellence, utilizing cutting-edge technology to enhance our digital offerings and deliver unparalleled customer experiences.Key Responsibilities:- Hands-on experience in pyspark with a strong understanding of Dataframes, RDD, and SparkSQL- Developing, testing, and maintaining applications on AWS Cloud- Proficiency in AWS Data Analytics Technology Stack including Glue, S3, Lambda, Lake Formation, and Athena- Designing and implementing scalable and efficient data transformation/storage solutions using Snowflake- Ingesting data into Snowflake using various storage formats such as Parquet, Iceberg, JSON, and CSV- Working with DBT (Data Build Tool) for ELT pipeline development in Snowflake- Writing advanced SQL and PL SQL programs- Building reusable components using Snowflake and AWS Tools/Technology- Hands-on experience in at least two major project implementations- Exposure to data governance or lineage tools like Immuta and Alation- Familiarity with Orchestration tools such as Apache Airflow or Snowflake Tasks- Knowledge of Abinitio ETL tool will be a plusQualifications Required:- Ability to engage with Stakeholders, elicit requirements/user stories, and translate requirements into ETL components- Understanding of infrastructure setup and ability to provide solutions either individually or collaboratively- Good knowledge of Data Marts and Data Warehousing concepts- Strong analytical and interpersonal skills- Experience in implementing Cloud-based Enterprise data warehouse with multiple data platforms, including Snowflake and NoSQL environment for data movement strategyAdditional Details:You may also be evaluated on key critical skills essential for success in this role, such as risk and controls, change and transformation, business acumen, strategic thinking, and digital and technology expertise. The position is based in Pune.

Keyskills :
GlueAthenaSnowflakeJSONDBTSQLPL SQLData governanceETLData MartsData WarehousingNoSQLpysparkDataframesRDDSparkSQLAWS CloudAWS Data Analytics Technology StackLambdaLake formationParquetIcebergCSVAWS ToolsTechnologyImmutaAlation