The China Data team is responsible for discovering Big Data insights and identifying business opportunities through the use of statistical, algorithmic, mining and visualization techniques. We are supporting our internal customers by coming up with cutting-edge algorithms to support daily business. As a solid basis, we are also keeping the Datalake, the Data Warehouses and all applications running stable and easy to use.
Within this setup we are looking for a Data Engineer to
- Be in charge of Data Ingestion Process for Data needed for Data solutions and projects (1st, 2nd and 3rd party data)
- Be in charge of Data Project implementation & new feature introduction
- Be in charge for MapReduce, Spark and Storm programing needed for Data Projects
- Be in charge with development and maintenance distributed data pipelines for ETL
- Be in charge with building frameworks and tools (mostly Spark, Scala, Python) to process data and generate modeling data more efficiently
- Be in charge with consist data warehouse modeling for structural, semi-structural and nonstructural data
- Be in charge with artificial, automatic or analytical solutions like DMP design
- Be in charge with OLTP and OLAP dataflow build
- Research and promote new ways of data engineering within the team, cultivate a constant flow of information and a learning environment for the data scientists
Be in charge with development and maintenance distributed data pipelines for ETL/oozie tasks take majority.(supplement)
Get email alerts for the latest"Data Engineer (大数据工程师) jobs in Către locație: beijing"
