Responsibilities:

• Responsible for requirement gathering, design, development, and testing of large-scale data ecosystem including data management, governance and the integration of structured and unstructured data
• Define and build large-scale streaming data processing pipelines
• Study data, identify patterns, and convert it to algorithms
• Effectively collaborates with team members and business units and acts as a SME and mentor as needed
• Works in an Agile environment with a mix of onshore and offshore resources

Requirements:

• Degree in Computer Science, Information Systems, Information Management, Business Statistics or equivalent
• At least 4 years of strong hands-on experience in data management project including tools such as Informatica PowerCenter, Informatica DEI
• 2 years’ experience working with Big Data ecosystem including tools such as Hadoop, Spark, HBase, Hive and Kafka
• Proficiency in Python, Scala or similar languages
• Experience on data lakes, datahub implementation
• Knowledge on AWS or Azure platforms is a plus
• Excellent analytical and problem-solving skills to data integration scenarios and quickly recognize, isolate, and resolve technical problems
• Good analytical and communication skills
• Candidate with less experience will also be considered