Big Data Engineer
• Experience in integrating data into analytical platforms
• Experience with ingestion technologies (Spark, Kafka, Storm, Apache NiFi & Minifi, Azure Data Factory) and storage (HDFS, HBase, Hive, Blob Storage, ADSLG2)
• Experience in data profiling, source-target mappings, ELT development, SQL optimization, testing and implementation
• Expertise in SQL & other data manipulation languages essential (Pig, Python, Java)
• Experience with structured/unstructured data
• Track record of implementing databases and data access middleware and high volume processing involving large data stores