Data Services Engineering Lead - Assistant Vice President 2

Job Description

As a Data Services Engineering Lead joining our innovative development team, you will have the opportunity to lead the design and implementation of cutting-edge data solutions that drive business intelligence and analytics. Your responsibilities will include:- Leading the design, development, and deployment of scalable Java applications integrated with Databricks for big data processing- Architecting and optimizing distributed computing solutions using Apache Spark within the Databricks environment to handle large-scalable datasets efficiently- Implementing and managing data lake house architecture using Databricks, ensuring data integrity, security, and accessibility- Developing and maintaining ETL pipelines using Databricks and Apache Spark, automating data workflows to improve processing efficiency- Providing technical leadership in system architecture design, making informed decisions to meet business requirements and scalability needs- Optimizing cloud resource utilization on platforms like Azure, ensuring cost-effective and reliable data processing solutions- Establishing best-in-class engineering practices through solid design decisions, conducting regular code reviews, and resolving defects at the code and platform level- Ensuring alignment, buy-in, and support of diverse stakeholders by building and maintaining trusting relationships with internal customers, third-party vendors, and senior management- Managing multiple services or applications and providing resources in support of the applications by leveraging partnerships with technology teams, vendors, and business leaders- Leading the team through all technology solution development phases, ensuring adherence to org policies, methodologies, standards, and controls- Educating and aligning the team on departmental standard operating procedures, objectives, key results, and overall operationalization of assigned services- Resolving escalated issues throughout the development, configuration, and modification of integrated business or enterprise application solutionsQualifications required for this role:- Bachelors degree in Computer Science / Information Technology, or a related field- Proven ability to work in a high-paced environment, be flexible, follow tight deadlines, organize, and prioritize work- 15 years of experience in Core Java/J2EE development, Solution design & Architecture- 5 years of experience in Spring, Spring Boot, UI Technologies & SQL/PLSQL (Preferably Snowflake/Databricks)- Expertise in designing scalable, reliable, and secure software architectures including Microservices, APIs, and containerization (Docker, Kubernetes, Helm)- Expertise in Public Cloud (Azure and AWS) technologies- Strong knowledge in modern software development technologies and frameworks- Ability to work closely with cross-functional teams to deliver high-impact solutions- Strong analytical and problem-solving skills with the ability to make critical technical and business decisions- Excellent verbal and written communication skills with the ability to explain complex technical issues to technical and non-technical stakeholders- Strong experience with cloud platforms, especially Microsoft Azure, including services like Azure Data Lake Storage (ADLS) and Azure Data Factory- Solid understanding of data warehousing concepts and hands-on experience with Snowflake & Databricks- Demonstrated excellent Communication Skills with the ability to effectively run meetings and collaborate across teams and functions- Demonstrated intermediate to high level of skill in team management- Experience with version control systems such as Github and familiarity with CI/CD pipelines- Excellent problem-solving skills, attention to detail, and the ability to work effectively in a collaborative team environmentGood to have skills include experience with additional programming languages such as Python or Scala, understanding of agile development methodologies, cloud development/architect certification, JAVA certifications, and contributions to open-source projects or active participation in relevant technical communities.Please note that the Job ID for this position is R-771723.,

Keyskills :
JavaDistributed ComputingAzureData WarehousingSnowflakeApache SparkResource UtilizationStakeholder ManagementTeam LeadershipMicroservicesAPIsContainerizationDockerKubernetesHelmAWSCommunication SkillsGithubTeam ManagementPythonScala