Career Category
Information SystemsJob Description
Job description
We are seeking a Data Engineer to join our team to develop an insight driven sensing capability with a focus on revolutionizing decision making. As part of this role you will be designing and developing robust data models, data pipelines and data products as part of a product team of data scientists, business analysts, and software engineers. The team will rely on your expertise in automating the transformation and manipulation of data to generate insights while building this visionary new capability for Amgen.
Responsibilities
Determine which tools and architectures are available for pipeline development based on the data source format and current technologies
Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development
Build data products and service processes which perform data transformation, metadata extraction, workload management and error processing management to ensure high quality data
Collaborate with Data Scientists to normalize and clean data in order to produce robust and high quality data assets
Support Data Science team with model design by anticipating and engineering features needed to drive model development and insight generation
Provide clear documentation for delivered solutions and processes, integrating documentation
Ensure that data engineering applications are aligned with the overall architectural and development guidelines
Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability)
Partner with business stakeholders and other technical team members to identify and acquire data sources that are most relevant to business needs and goals
Demonstrate deep technical and domain knowledge in order to propose potential solutions
Mentor junior data engineers on best practices in the industry and in the Amgen data landscape
Basic Qualifications
Doctorate degree
OR
Master’s degree and 3 years of Information Systems experience
OR
Bachelor’s degree and 5 years of Information Systems experience
OR
Associate degree and 10 years of Information Systems experience
OR
High school diploma / GED and 12 years of Information Systems experience
Preferred Qualifications:
Experience working with teams of data scientists, software engineers and business experts to drive insights
Strong understanding of relevant data standards and industry trends
Ability to understand new business requirements and prioritize them for delivery
Proficient in one of the coding languages (Python, Java, Scala)
Hands on experience writing SQL using any RDBMS (Redshift, Postgres, MySQL, Teradata, Oracle, etc.).
Experience with Schema Design & Dimensional data modeling.
Experience with AWS Services like EC2, S3, Redshift/Spectrum, Glue, Athena, RDS, Lambda, and API gateway.
Experience with software DevOps CI/CD tools, such Git, Jenkins, Linux, and Shell Script
Experience with Spark, Hive, Kafka, Kinesis, Spark Streaming, and Airflow.
Hands on experience using Databricks/Jupyter or similar notebook environment.
Experience working in an agile environment (i.e. user stories, iterative development, etc.)
Experience working with test-driven development and software test automation
Experience working in a Product environment
Amgen is committed to unlocking the potential of biology for patients suffering from serious illnesses by
discovering, developing, manufacturing and delivering innovative human therapeutics. Amgen focuses on areas of high unmet medical need and leverages its expertise to strive for solutions that improve health outcomes and dramatically improve people’s lives. A biotechnology pioneer since
1980, Amgen has grown to be one of the world’s leading independent biotechnology companies, has
reached millions of patients around the world and is developing a pipeline of medicines with breakaway
potential.
Get email alerts for the latest"Data Engineer jobs in Us - new york - new york"
