OCI Engineer

Job Description

OCI EngineerLocations:MUMBAI, MAHARASHTRA, IndiaPUNE, MAHARASHTRA, IndiaBENGALURU, KARNATAKA, IndiaCHENNAI, TAMIL NADU, IndiaJob Identification: 275336Job Category: ConsultingPosting Date: 01/23/2025, 02:37 PMRole: Individual ContributorJob Type: Regular EmployeeExperience Level: ProfessionalDoes this position require a security clearance NoYears: 6 to 10 yearsApplicants: Less than 10 applicantsApplicants are required to read, write, and speak the following languages: EnglishAdditional Info: Visa / work permit sponsorship is not available for this positionRole OverviewThe OCI Data Engineer will be responsible for building, managing, and optimizing data pipelines, data lakes, and data warehouses using Oracle Cloud Infrastructure (OCI) and other associated tools and technologies. The ideal candidate will have strong experience with cloud-based data engineering solutions, focusing on the integration, storage, and processing of large datasets in a scalable and efficient manner.This role requires close collaboration with data scientists, analysts, and architects to ensure that data infrastructure is designed, implemented, and maintained in accordance with business requirements and best practices.Key ResponsibilitiesData Pipeline Development

• Design, develop, and maintain data pipelines to move large volumes of data from various sources into OCI environments.
• Build scalable ETL (Extract, Transform, Load) workflows to handle both batch and real-time data processing.
• Automate data ingestion and transformation processes using OCI tools such as Oracle Data Integration service (ODI), Oracle Cloud Data Flow, FDI etc.

Data Infrastructure Management

• Experience in OCI Administration on strong understanding of Tenancy, VCN, Compartments, Network Layers, handling firewalls, subnet, policies, storage options.
• Ensure optimal performance, security, and reliability of the data infrastructure in OCI environments.
• Develop and manage data lakes, data warehouses, and other data storage solutions.

Cloud Integration

• Integrate OCI services with on-premise systems, third-party applications, and external data sources.
• Implement secure and high-performance data sharing and integration using Oracle Cloud Integration tools.

Data Quality and Governance

• Implement data quality controls to ensure the integrity and accuracy of the data.
• Ensure compliance with data governance policies and industry standards.
• Work with Data Architects to define data standards, schemas, and metadata management.

Collaboration and Communication

• Collaborate with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand data requirements.
• Develop and communicate data solutions effectively to both technical and non-technical teams.
• Assist in data visualization and reporting for business intelligence (BI) solutions.

Performance Optimization

• Optimize data pipelines and queries for better performance and cost management.
• Troubleshoot issues related to performance, scalability, and reliability of data engineering solutions.

Documentation and Reporting

• Document the architecture, design, and implementation of data solutions for internal stakeholders.
• Provide regular status updates, metrics, and insights regarding data pipeline health, performance, and issues.

Continuous Learning and Improvement

• Stay up-to-date with the latest developments in Oracle Cloud Infrastructure and data engineering technologies.
• Continuously improve data engineering processes, ensuring innovation and optimization in data handling.

Required Skills & QualificationsExperience:

• 3-5 years of hands-on experience in data engineering, specifically with Oracle Cloud Infrastructure (OCI).
• Strong experience in designing and managing ETL pipelines using tools such as Oracle Data Integration Service, Oracle Data Flow, or Apache Spark.
• Experience with Oracle Autonomous Database, FDI, Oracle Exadata, Oracle Object Storage, and related OCI services.
• Experience with SQL and NoSQL databases, data warehousing, and data lakes.
• Familiarity with data modeling, data integration, and data governance best practices.

Technical Skills:

• Expertise in Oracle Cloud Infrastructure (OCI) services for data processing and storage.
• Strong programming skills in languages such as Python, SQL.
• Familiarity with cloud-native tools and frameworks for data engineering (e.g., Apache Kafka, Apache Airflow).
• Hands-on experience with monitoring, logging, and optimizing data processes in cloud environments.

Soft Skills:

• Strong problem-solving and analytical skills.
• Excellent communication skills, with the ability to work with cross-functional teams.
• Ability to work under pressure and manage multiple projects with tight deadlines.
• Attention to detail and a commitment to data accuracy and quality.

Preferred QualificationsCertifications:

• Oracle Cloud Infrastructure (OCI) Data Engineering or Cloud certifications.
• Certifications in big data tools (e.g., Apache Spark, Hadoop).

Career Level: IC3ResponsibilitiesOperates independently to provide quality work products to an engagement. Performs varied and complex duties and tasks that need independent judgment, in order to implement Oracle products and technology to meet customer needs.

Keyskills :
data pipeline development oci administration expertise etl workflow management data quality implementation cloud integration solutions metadata business intelligence oracle data engineer odi data integration bi data warehousing storage sql