Software Engineer

Job Description

Job Title Software EngineerThe Purpose of This RoleA talented individual to contribute in our effort in engineering, developing enterprise-based data layer (Data on cloud, Snowflake, Oracle PLSQL, Python, Java) for supporting the IT Enablement Center division within Corporate Technology Group organization on their Data lake and Analytics project. Our product offerings are designed and implemented on AWS, Snowflake, PLSQL and ETL technologies. The candidate should possess good control over these technologies to contribute actively in Data lake team.The Value You Deliver

• A technology focused software development space with a focused/driven attitude towards developing and supporting of critical systems.
• The successful candidate will be involved in all aspects of data engineering. They will be part of a team that delivers a wealth of Technology Management data to the enterprise.

The Skills that are Key to this roleThe Expertise you have

• 4+ years of experience in multiple IT areas that include AWS, Snowflake, Data Warehousing, BI & Cloud
• A passion for data engineering and a deep desire to solve customer problems
• Bachelors or Master s Degree in a technology related field (e.g. Engineering, Computer Software) required

Technical / Behavioral

• Advanced working experience in AWS, Snowflake, Apache NiFi, SQL and PLSQL knowledge and experience working with relational databases and data warehouses
• Experienced with data normalization and denormalization techniques
• Experience building and optimizing data pipelines, architectures and data sets.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• Working knowledge of message queuing, stream processing, and highly scalable data stores.
• Experience in a Data Engineer role using the following software/tools:
  • Hadoop, Spark, Kafka, etc.
  • AWS cloud services: EC2, EMR, RDS, Redshift
  • Stream-processing systems: Storm, Spark-Streaming, etc.
  • Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Strong inter-personal and communication skills including written, verbal, and technology illustrations.
• Capacity to quickly understand and incorporate new technologies.
• Must be able to work in a matrixed (onshore/offshore) environment.

The Skills that are Good to Have for this role

• Open source data warehouse tools
• Experience in data modelling and data designing concepts
• AWS Athena, Serverless services
• In-memory databases
• Knowledge on DevOps is preferred
• Good control on Agile methodologies.

How Your Work Impacts the Organization

• Deliver and maintain from green fields a new cloud-based data lake as part of broader enterprise data strategy for Technology/Business Metrics.
• Become trusted partner, collaborate and align with the wider CTG and Enterprise Data Strategy.
• Identifying and integrating data from multiple sources in batch and real time
• Build and maintain data pipelines from internal databases and SaaS applications
• Researching and recommending solutions to complex problems
• Desire to continually keep up with advancements in data engineering practices
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues
• Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.

The IT Enablement Center (ITEC) is responsible for delivering innovative, scalable, industry leading data, analytics and process solutions for Fidelity. Data Engineering is central to all that we do.Location: Bangalore - ManyataShift timings: 11:00 am - 8:00 pmCertifications:Category: Information TechnologyApply,

Keyskills :
javasqljavascriptsql serverjquerybig datadata modelingdata structuresenterprise datadata warehousingdata engineeringproduct offeringsstream processingworking experiencedata transformation