Software Developer 3 (Big Data/Spark)

Job Description

*Design, develop, troubleshoot and debug software programs for databases, applications, tools, networks etc.As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or operating systems. Provide technical leadership to other software developers. Specify, design and implement modest changes to existing software architecture to meet changing needs.Duties and tasks are varied and complex needing independent judgment. Fully competent in own area of expertise. May have project lead role and or supervise lower level personnel. BS or MS degree or equivalent experience relevant to functional area. 4 years of software engineering or related experience., * PMTS, Development (IC3) Oracle Cloud is a comprehensive enterprise-grade cloud computing platform that offers best-in-class services across Software as a Service (SaaS), Platform as a Service (PaaS) and Infrastructure as a Service (IaaS).Oracle Cloud platform offers choice and flexibility for customers to build, deploy, integrate, and extend applications in the cloud that enable adapting to rapidly changing business requirements, promote interoperability and avoid lock-in. This platform supports numerous open standards (SQL, HTML5, REST, and more), open-source solutions (such as Kubernetes, Hadoop, and Kafka) and a wide variety of programming languages, databases, tools and integration frameworks.Our TeamOracle Cloud Data integration team provides a comprehensive, best-in-class data integration PaaS offering with hundreds of out-of-the-box adapters to seamlessly integrate on-prem and cloud applications along with real-time, fault-tolerant data integration and replication services supporting a wide variety of on-prem and cloud databases. This delivers a complete offering to accelerate integration with zero-code point and click visual orchestration, flexible API management, comprehensive integration analytics, data governance and the fastest data migration and integration.Data Migration Service (DMS) and Data Integration Service (DIS) are two PaaS services for migration, and data management needs. DMS is focused on helping customers to migrate their on premise or remote cloud Databases to OCI-native Databases such as Autonomous Database and DBaaS to simplify, be cost effective and reduce the operational challenges that come with managing mission critical databases. DIS is focused to efficiently ingest, cleanse, transform, shape and load data and provide data lifecycle management for associated data management needs.Some of the main Objectives of our services are:-

• Efficiently load and transform data into a data warehouse
• Efficiently load and transform data into an OCI data lake
• Provide an intuitive design environment to create data flows
• Provide advanced orchestration to support end to end data warehouse and data lake loading
• Provide cost based optimization with push down execution
• Provide data lifecycle management within data integration context
• Seamless integration with Autonomous databases, Object Storage and Oracle Data Catalog
• Utilize server-less compute for data transformations
• Will be able to create database connections and persist them
• Browse database objects along with filtering, search and creating database objects on the target database instances
• Heterogeneous database schema conversion
• Data movement in both batch and real-time change data capture
• Manual Orchestration for switching for zero downtime migrations
• Data validation for the source and target database
• Complete audit report

The primary focus for the Database Migration Service it to help the customers to re-platform on premise or external cloud DBs into OCI (ATP, ADW, DBaaS or Oracle). This service is a self-service experience to achieve offline (batch mode), online (real-time) migrations, schema conversion to help customers migrate DB objects including schemas, tables. Data integration as part of a cloud platform is an evolving market, and some of the use-cases we would be solving are loading of Data Lake/Data warehouses, in-line Data preparation and core service capabilities like Orchestration and bulk data movement.Your OpportunityOracle is a market leader in the Data integration space and we are aggressively investing in the next generation cloud data integration application and services. You will be responsible for applying your extensive knowledge of software architecture and user experience to architect, develop and design highly performant services on Oracle Cloud.This opportunity involves building the Data Integration service by enabling data preparation involving cleaning, structuring and enriching raw data into a desired output as part of the data ingestion to a Data Lake/warehouse and help orchestrate data flow jobs. These services need to be built for hyper scale by leveraging the best of the breed technology (Spark, Scala, Livy, Apache Flink, Airflow, Kubernetes, etc.) that follow modern design/architecture principles (Micro-services, Scale to zero, Telemetry, Circuit Breakers, etc.) to provide a rich and intuitive user experience for our customers.Our Ideal CandidateWe are looking for a strong engineering who thrives on research and development projects. We want you to be a strong technical leader who needs to be hands-on. We want you to work with the development team and can work efficiently with other product groups that can sometimes be remote in different geographies. You should be comfortable working with product management. You should also be comfortable working with senior architects and engineering leaders to make sure we are building the right product and services using the right design principles.Your ResponsibilitiesAs an integral part of the OCI development team you will be responsible for the following

• Help drive the next generation Data Migration and Data Integration cloud services using Oracle standard tools, technology and development practices
• Working directly with product management
• Working directly with architects to ensure newer capabilities are built applying right design principles
• Working with remote and geographically distributed teams to enable building the right products, using the right building blocks and making them consumable by other products easily
• Be very technically hands-on and own/drive key end to end product/services

Your Qualifications

• BS/MS/PhD in Computer Science or equivalent related fields.
• Excellent design and coding skills
• Expertise on Spark, Scala and Java technology
• Familiar with Java open-source and API standards.
• Strong problem solving, troubleshooting and analytical skills.
• Prior experience building cloud services
• Familiarity of Data Integration domain
• Familiarity with Agile process will be an added advantage
• Ability to quickly learn new technologies in a dynamic environment.
• Good organization, communication and interpersonal skills.
• 6+ years in software development.

Keyskills :
sqlserver javascript jquery html sql softwareasaservice changedatacapture research development dataflow agileprocess datamigration cloudcomputing uditrep