Hyderabad Jobs |
Banglore Jobs |
Chennai Jobs |
Delhi Jobs |
Ahmedabad Jobs |
Mumbai Jobs |
Pune Jobs |
Vijayawada Jobs |
Gurgaon Jobs |
Noida Jobs |
Hyderabad Jobs |
Banglore Jobs |
Chennai Jobs |
Delhi Jobs |
Ahmedabad Jobs |
Mumbai Jobs |
Pune Jobs |
Vijayawada Jobs |
Gurgaon Jobs |
Noida Jobs |
Oil & Gas Jobs |
Banking Jobs |
Construction Jobs |
Top Management Jobs |
IT - Software Jobs |
Medical Healthcare Jobs |
Purchase / Logistics Jobs |
Sales |
Ajax Jobs |
Designing Jobs |
ASP .NET Jobs |
Java Jobs |
MySQL Jobs |
Sap hr Jobs |
Software Testing Jobs |
Html Jobs |
Job Location | Bangalore |
Education | Not Mentioned |
Salary | Not Disclosed |
Industry | IT - Software |
Functional Area | DBA / Datawarehousing |
EmploymentType | Full-time |
Job descriptionThe Data Engineer is responsible for execution and management of data delivery, data transformation, and data processing in alignment with the global IT architecture. The Data Engineer works with Subject matter experts, data architects, and data analysts to develop an efficient, scalable, automated and robust data pipleline from source to front end application.Responsibilities- Work with subject matter experts to perform data profiling activities to understand source data- Develop technical requirements and source to target data mapping for processing data from source to target- Develop data pipeline to populate Analytical data stores in alignement with the data architects design- Deliver data in an optimized form for the development of visualization/reports/dashboards to present business insightsRequirements :- Bachelor or MS degree in Computer Science, Engineering, Information Systems, Information Technology or equivalent experience- Minimum 4 years of experience with SQL- Strong experience in working with both OLTP/OLAP models for both data extraction and ingestion- Solid ETL skills for high performance data loading ( AWS Glue/ AWS EMR/ Apache Spark preferred)- Experience with Python programming (Experience in test driven development preferred)- Experience in AWS Lambda- Experience with workflow automation (python / Apache Airfolow preferred)- Experience with data profiling and data quality assessment using AWS tool set- Strong experience with database design and data architecture (ie. Snowflake, AWS Redshift, AWS Dynamo, Oracle SQL)- Strong experience with Git source code control and demonstration of different branching strategies- Strong experience in data curation/aggregation/preparation for use in a Vizualization tool (ie. Tableau, PowerBI, Quicksight)- Experience and understanding of big data compute frameworks (ie. Apache Spark preferred)Preferred Skills :- Experience with high volume processing, performance tuning, and optimization- Strong understanding of database engineering best practices and software design- Excellent written/documentation and verbal communication skills- Ability to exercise sound judgment and to work effectively given general guidance and direction- The ability to thrive in a collaborative team environment; the right candidate is someone who is willing to take on projects and challenges with the ability to be flexible with changeSkills Experience / Proficiency :Business Intelligence - 2 YearsData Warehousing - Healthcare 3 yearsETL - 3 years
Keyskills :
exchange systemadministration activedirectory networkadministration vmware ad dhcp cp/ip dns/wins exsi