Principal Responsibilities:

主要职责：

• Building distributed and highly parallelised Big data ingestion and processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time.
• 分布式、高度并行的大数据摄取处理管道，实时处理海量数据(包括结构化和非结构化数据)。
• Evaluate and deploy data quality framework to measures and improve data quality in the organization over time.
• 和部署数据质量框架，以衡量和改进组织中的数据质量。
• Engaged with data stewards, producers and consumers to design appropriate data pipelines.
• 据管理员、生产者和消费者一起设计合适的数据管道。
• Automate processes where possible and are repeatable and reliable.
• 自动化流程，且重复和可靠。
• Work closely with Site Reliability Engineers and Product Managers to deliver software in a continuous delivery environment.
• 场运维工程师和产品经理紧密合作，在持续的交付环境中交付软件。

Knowledge, Skills & Qualifications:

硬件知识、专业领域和资质

• 
  Data driven thinking.
• 驱动思维。
• Experience in container technologies (openshift, docker or k8s).
• 站技术经验(openshift、docker或k8s)。
• Delivery focus with strong product mindset.
• 于交付产品，有很强的产品竞争意识。
• Knowledge in design and implementing data infrastructure on AWS or GCP.
• 在AWS或GCP上设计和实现数据基础设施。
• Excellent communication skills and experience working in cross functional teams.
• 的沟通技巧和跨职能团队协作的工作经验。
• Over 3 years experience in data engineering.
• 3年以上数据工程经验。

Experience:

经验：

• Experience in Apache Spark and Nifi.
• 具有Apache Spark和Nifi方面的经验。
• Experience in in-memory data processing.
• 有内存数据处理经验。
• Experience in implementing data security capabilities such as encryption and anonymisation.
• 施数据安全功能(如加密和匿名)的经验。
• Solid grounding in Financial Services Industry.
• 的金融服务业务基础。
• Solid knowledge in SQL.
• 的知识。
• Understanding in statistical models, machine learning, graph analysis

了解统计模型，机器学习，图表分析。

上班地址：深圳市前海深港合作区梦海大道创新商务中心A组团1层公馆南路的门