AWS Data Engineer

Job Description

As an AWS Data Engineer at TechMango, you will be responsible for designing, architecting, and maintaining high-performance, scalable data pipelines and cloud data warehouses using AWS-native services such as Redshift, Glue, S3, Lambda, and Step Functions. Your role will involve solving complex data challenges, optimizing distributed systems, and being the go-to expert in a collaborative engineering team.**Key Responsibilities:**- Architect, build, and maintain robust and scalable data pipelines utilizing AWS services like Glue, Lambda, Step Functions, S3, Redshift, and Athena.- Design and optimize schemas for Redshift and Snowflake to support analytics, reporting, and data science requirements.- Implement efficient ETL/ELT processes for handling large volumes of structured and unstructured data.- Enforce and monitor data SLAs to ensure data freshness, reliability, and availability across environments.- Collaborate with engineering, product, and analytics teams to translate business requirements into robust data models and pipelines.- Identify and resolve bottlenecks, data quality issues, and system inefficiencies proactively.- Implement schema versioning, data lineage tracking, and database change management practices.- Define and enforce best practices for data governance, access control, observability, and compliance.- Contribute to CI/CD workflows and infrastructure as code practices using tools like CloudFormation or Terraform.**Qualifications Required:**- 4 years of experience in data engineering or backend systems development, focusing on cloud-based architectures.- Proficiency in AWS data ecosystem, particularly Redshift, Glue, S3, Athena, Lambda, Step Functions, and CloudWatch.- Strong background in SQL performance tuning, schema design, indexing, and partitioning strategies for handling large datasets.- Hands-on experience with Python, T-SQL, and scripting automation for data ingestion and transformation.- Solid understanding of relational and dimensional data modeling, normalization, and schema evolution.- Experience with source control systems like Git or Bitbucket and CI/CD pipelines for data infrastructure.- Track record of translating complex business requirements into reliable and scalable data solutions.- Knowledge of data governance, security, and compliance frameworks such as HIPAA and GDPR is beneficial.- Familiarity with monitoring and observability tools like CloudWatch, Datadog, or Prometheus.- Exposure to Snowflake or MSSQL in hybrid cloud environments is a plus.TechMango is a leading software development company founded in 2014, specializing in custom software solutions using the best available technologies. The company is recognized as the Best Offshore Software Development Company in India and operates in the USA, UAE, and India.For more information, please visit the TechMango website at [Techmango | Digital Transformation Solutions | IT Consulting](https://www.techmango.net). As an AWS Data Engineer at TechMango, you will be responsible for designing, architecting, and maintaining high-performance, scalable data pipelines and cloud data warehouses using AWS-native services such as Redshift, Glue, S3, Lambda, and Step Functions. Your role will involve solving complex data challenges, optimizing distributed systems, and being the go-to expert in a collaborative engineering team.**Key Responsibilities:**- Architect, build, and maintain robust and scalable data pipelines utilizing AWS services like Glue, Lambda, Step Functions, S3, Redshift, and Athena.- Design and optimize schemas for Redshift and Snowflake to support analytics, reporting, and data science requirements.- Implement efficient ETL/ELT processes for handling large volumes of structured and unstructured data.- Enforce and monitor data SLAs to ensure data freshness, reliability, and availability across environments.- Collaborate with engineering, product, and analytics teams to translate business requirements into robust data models and pipelines.- Identify and resolve bottlenecks, data quality issues, and system inefficiencies proactively.- Implement schema versioning, data lineage tracking, and database change management practices.- Define and enforce best practices for data governance, access control, observability, and compliance.- Contribute to CI/CD workflows and infrastructure as code practices using tools like CloudFormation or Terraform.**Qualifications Required:**- 4 years of experience in data engineering or backend systems development, focusing on cloud-based architectures.- Proficiency in AWS data ecosystem, particularly Redshift, Glue, S3, Athena, Lambda, Step Functions, and CloudWatch.- Strong background in SQL performance tuning, schema design, indexing, and partitioning strategies for handling large datasets.- Hands-on experience with Python, T-SQL, and scripting automation for data ingestion and transformation.- Solid understanding of relational and dimensio

Keyskills :
PythonindexingTSQLAWS servicesSQL performance tuningschema design