Senior Data Engineer - BI

Job Description

Senior Data Engineer - BIQUALIFICATIONSDegree in computer science, engineering or related discipline; industry-recognized cloud certifications, patents, open-source contributions are preferred4+ years of experience in engineering; hands-on engineer with a deep engineering track record in modern tech stacks, frameworks and object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.Experience in working with large-scale cloud, big data or analytics implementations in complex usage scenarios and migration pathsRelevant certifications in AWS or Azure preferredHands-on knowledge in public cloud products, cloud-native architectures, serverless frameworks, Docker/Kubernetes, data security, integration services and creating/maintaining optimal data pipeline architecture.Experience in building big data ecosystems, analytics and AI/ML platforms and accelerators, data management systems using Hadoop/Spark, Tensorflow, Jupyter, HBase, BI tools, and public cloud ML tools and servicesExperience with relational SQL and NoSQL databases including Postgres and CassandraExperience building enterprise-grade data and analytics platforms that are highly scalable, compliant, and secure with robust data quality, data governance, data discovery, catalog, and visualization capabilitiesProficient in building large-scale systems using Python, Java, or other high-performance languages, developer tools, CI/CD, DevOps, monitoring tools and engineering cloud migration solutionsProven track record in enterprise-wide API management, microservices, event-driven architectures and complex integrationsCollaborative; able to build strong relations that enable robust debate and survive periodic disagreements regarding prioritiesAbility to communicate effectively with technical and non-technical audienceWHO YOULL WORK WITHYoull work in our Bengaluru or Gurugram office as part of our Technology & Digital function. The Technology & Digital function is responsible for developing and delivering all technology solutions for the firms internal use.Youll be part of the team that shapes and accelerates the delivery of target state cloud-based platforms and the migration of existing data assets to the cloud. Youll work with a team of data engineers that work across the global hubs to build target state platforms and migrate existing applications and products. Youll take a cloud-first approach in transforming our data platforms and analytical applications across the firm. You will also be working with data scientists to understand their data needs and provide them with the necessary data.WHAT YOULL DOYoull support the development and implementation of cloud products.In this role, your responsibilities will include the identification, organization and ingestion of data spread across multiple sources (operational, analytical, and reporting). You will work with stakeholders and team members to analyze user needs and develop data integration solutions. You will implement new and ongoing data integration needs to complete the end-to-end setup of the product.You will adhere to data architecture strategy, best practices, standards and roadmaps. You will be responsible for the management of data including definition, usage and quality via architecture repositories like data dictionaries, data models, metadata and data quality logs. You will also design, build and support data pipelines for ingestion, transformation, conversion and validation. Youll also conduct data assessment, perform data quality checks, transform and load raw data using SQL and ETL tools. Your work will contribute to the overall implementation of product solutions.,

Keyskills :
content managementemailsqlanalyticsapache