Senior Architect KAFKA & NoSQL

Job Description

Dear Candidate,Were Opening forSenior Architect KAFKA & NoSQLRoles & Responsibilities :-Participates in the design of the technical and information architecture for the NoSQL data warehouse (MongoDB, Cassandra), including all information structures (staging area, data warehouse, data marts, and operational data stores).

• Design and perform POC where needed and develop enterprises Apache Kafka Distributed Messaging and Integration Ecosystem.
• Solid experience and knowledge in the deployment of Kafka(Apache/Confluent
• Physical Deployment across multiple environments
• Optimization and Tuning based on performance metrics
• Setup best practices, Standards, Patterns Development and automate process for onboarding.
• Focuses on enterprise-wide data modeling and database design.
• Creates logical and physical data models, mapping logical to physical.
• Designs, develops, tests, monitors, manages, and validates data warehouse activity, including data extraction, transformation, movement, loading, cleansing and updating processes.
• Coordinates with other Data Warehouse IT stakeholders to ensure overall health and performance of the data warehouse environment.
• Works with end users to translate business questions and requirements into applications that employ the appropriate reporting tools.
• Assists in monitoring system performance, reliability, availability, and recoverability of the DW environment.
• Assists in the evaluation, selection, testing, and optimization of BI/DW related hardware and software products.
• Develops and applies sound fundamental design, analysis, and data administration concepts, practices, and procedures.
• Designs and develops BI reporting deliverables.

Required Skills:

• Experience with medium-to-large data pipelines: implementing, testing and deploying
• Experience with stream processing using Kafka
• Experience with automated unit and integration testing
• Experience with Kafka Connect.
• Five or more years of experience with NoSQL data warehousing and business intelligence and/or large and complex database management systems (MongoDB, Cassandra etc.)
• Strong relational and dimensional data modeling and database design skills.
• Hands-on experience using ETL tools.
• Creates logical and physical data models, mapping logical to physical.
• Designs, develops, tests, monitors, manages, and validates data warehouse activity, including data extraction, transformation, movement, loading, cleansing and updating processes.
• Coordinates with other Data Warehouse IT stakeholders to ensure overall health and performance of the data warehouse environment.
• Work in collaboration with business leaders and end users to translate business questions and requirements into solutions that employ the appropriate tools and reporting.
• Assists in monitoring system performance, reliability, availability, and recoverability of the DW environments.
• Assists in the evaluation, selection, testing, and optimization of BI/DW related hardware and software products.
• Translate business requirements and end users needs into DW architecture blueprints that deliver cost effective, high performing and high-quality solutions in compliance with standards, policies and long-term technical strategies.
• Communicate database designs to business and technical audiences.
• Provide architectural expertise, thought leadership, direction, and assistance across entire organization for related data driven IT and BI initiatives.
• Assist Project Managers and delivery team leaders in estimating effort and resources for new projects and enhancement requests.
• Serve as a Subject Matter Expert of data principles (data analysis, modeling, ETL, storage and delivery).
• Stay current in new DW and BI technologies, evaluate them and make adoption recommendations.
• Participate in developing and documenting technical standards and best practices for the organization.

Preferred Skills:

• Manage data integrity and accuracy of the data warehouse data and analytic environments.
• Develop optimized SQL, code and scripts to implement ETL job steps and analysis services.
• Profile, monitor, diagnose and repair data loading and processing packages to ensure data integrity and efficiency
• BI Report and Dashboard Development (Tableau, PowerBI, etc.)
• DevOps and Agile Development processes

Regards,Team HR

Keyskills :
nosqlkafkatechnical architectureetl toolstableautestingsenior architectpowerbi