Job Description: 

Mandatory Skills:

• SQL (Expertise)
• Spark
• ETL (ANY TOOL/ETL Process)
• Python/Scala
• Hive

Good to have:

• Kafka
• HBase/Redis/Cassandra (Any NoSQL database)
• Cloudera/AWS/Azure

Required:

• 2 to 4yrs of relevant experience in data engineering.
• A solid track record of data management showing flawless execution and attention to detail.
• Experience of working on different Hadoop environments like Cloudera or AWS or Microsoft.
• Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
• Experience around HQL, Oozie, SQL, Streaming and ETL.
• Experience in Kafka, spark, python or Scala
• Experience with any NoSQL databases (like Hbase, Cassadra, redis)
• Experience with integration of data from multiple data sources.
• Programming experience, ideally in Python or Scala
• Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
• Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.