The Mission of Oracle Labs is straightforward: identify, explore, and transfer new technologies that have the potential to substantially improve Oracle's business. The Machine Learning Research Group (MLRG) in Oracle Labs is working to develop, scale, and deploy Machine Learning throughout all of Oracle's products and services.

As transformer architectures like BERT have changed the face of Natural Language Processing, we have started incorporating these types of models into our research work and our collaborations with Oracle’s product groups. Our current research is focused on multi-task and multilingual training, as well as investigating ways to train these models faster and with less data. At the same time, we are building models that can be used by Oracle's product group for a variety of downstream tasks, so we're interested in how to train models that will lead to greater effectiveness on those tasks.

We're seeking a junior research engineer who has experience working with large-scale transformer architectures like BERT, MUSE, or GPT-3 to help with our efforts to build effective and efficient systems that use transformer models. The ideal candidate will have experience fine-tuning these sorts of models for a variety of tasks, as well as experience automating testing and performing extensive error analysis.

Required Skills and Experience

• A Bachelors or Masters degree in Computer Science
• Experience fine-tuning Transformer models for downstream NLP tasks using toolkits like PyTorch or Huggingface
• A good general understanding of Machine Learning algorithms and techniques
• A good understanding of experimental practices, error analysis, and evaluation approaches
• Strong data cleaning and manipulation experience
• Strong communication skills

Preferred Skills and Experience

• Experience working with large scale database schemas and SQL
• Experience using Unix
• Familiarity with data visualization tools

Design, develop, troubleshoot and debug software programs for databases, applications, tools, networks etc.

As a member of the software engineering division, you will apply basic to intermediate knowledge of software architecture to perform software development tasks associated with developing, debugging or designing software applications or operating systems according to provided design specifications. Build enhancements within an existing software architecture and occasionally suggest improvements to the architecture.

Duties and tasks are standard with some variation; displays understanding of roles, processes and procedures. Performs moderately complex problem solving with assistance and guidance in understanding and applying company policies and processes. BS degree or equivalent experience relevant to functional area. 1 year of software engineering or related experience.

As part of Oracle's employment process candidates will be required to successfully complete a pre-employment screening process. This will involve identity and employment verification, professional references, education verification and professional qualifications and memberships (if applicable).