Principal Big Data Engineer

The Java Platform Group is looking for an experienced, passionate, and highly motivated Big Data Engineer. Our team is responsible for delivering the Java platform that is used by millions of developers. We are looking for an engineer with a thorough working experience of both the Java Platform and the implementation of the cloud native services. We are hiring to further expand our cloud service to more Oracle commercial regions and we are continuously investing to grow the service's capabilities and footprint across the globe.

As a Big Data Engineer with the Java Platform Group, you will be a leading contributor in Big Data Analytics of Oracle’s latest Cloud Services Technologies. You will take an active role in the definition and evolution of standard practices and procedures. Additionally, you will be responsible for scaling our existing infrastructure, incorporating new data sources, building robust data pipelines for production level cloud service. If you have a passion Big Data processing this is the place where you can make a difference.

Responsibilities 

• Develop ETL pipelines with robust monitoring and alarming
• Develop data models that are optimized for business usability and understanding
• Develop and optimize data tables using best practices for partitioning, compression, parallelization, etc.
• Develop and maintain metadata, data catalog and documentation in regard to the data flow of the system.
• Ensure the handling of the data is in compliant to security and privacy requirements of the organization.
• Optimize SQL and ETL solutions to solve various reporting requirements.
• Maintain and continuously improve Java Management Services operations inline with the service's SLOs
• Ensure JMS performance, uptime and scale, maintaining high standards of code quality
• Work with agile development methodology, adhering to best practices established by Oracle and project team and pursuing continued learning opportunities 
• Knowledge sharing and provide mentorship to junior engineers.
• Perform in-depth data analysis of incoming JVM telemetry data 
• Provide technical consulting and mentoring to team members on optimization techniques, new algorithm design, 
• Implementation and conformance to architecture standards
• You will be responsible for architecting and developing data models
• Help deploy and productionize Machine Learning models.

Skills we require:

• 10+ years of experience designing, implementing, testing and operating cloud native in an Agile and DevOps setup
• 3+ years of industry experience in Data Engineering with experience manipulating and extracting data from large datasets.
• 3+ years of Data Warehousing experience preferably with Oracle or related  technology displaying strength in SQL, python/pyspark scripting, data modeling and ETL development. 
• 2+ years working in a role as Lead / Principal Engineer or Architect
• Broad knowledge of different types of data storage engines - (non)relational, row/column oriented dbs. e.g. Oracle, Postgres, MySQL, QB/redshift, Elastic, Hive, HBase
• Advanced query language (SQL) knowledge
• Experience with stream processing engines (Kafka, Kinesis)
• Experience in using a Java framework in development preferable using Dropwizard
• Experience deep working experience with one or more major cloud vendors (OCI, Azure, AWS, GCP)
• Strong analytical skills, 2+ years’ experience with Python and an interest in Machine Learning
• Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy

 

Design, develop, troubleshoot and debug software programs for databases, applications, tools, networks etc.

As a member of the software engineering division, you will take an active role in the definition and evolution of standard practices and procedures. You will be responsible for defining and developing software for tasks associated with the developing, designing and debugging of software applications or operating systems.

Work is non-routine and very complex, involving the application of advanced technical/business skills in area of specialization. Leading contributor individually and as a team member, providing direction and mentoring to others. BS or MS degree or equivalent experience relevant to functional area. 7 years of software engineering or related experience.

As part of Oracle's employment process candidates will be required to successfully complete a pre-employment screening process. This will involve identity and employment verification, professional references, education verification and professional qualifications and memberships (if applicable).