Lead Engineer Job in Quadratic Insights Pvt. Ltd.

Lead Engineer

Quadratic Insights Pvt. Ltd. 4+ weeks ago

Apply Now

Save Job

Job Summary

This role requires that you have:

Min. 5+ years of experience on BIG Data Architecture, BIG Data - Apache Hadoop (HDFS) - Hbase/Hive/Pig/Flume/Scoop/MapReduce/Yarn
End-to-end system implementation including data security and privacy concerns.
Building systems that rely on proprietary algorithms, building and running large-scale distributed systems, web services, extracting structured-data from unstructured-content etc.
Provide technical leadership and governance of the big data team and the implementation of the solution architecture in following Hadoop ecosystem (Hadoop (HortonWorks), Map Reduce, Pig, Hive, Yarn, Tez, Spark, Pheonix, Presto, Hbase, Storm, Kafka, Flume, OoZie, Ambari, Security Kerberos, Ranger, Knox, HDFS encryption)
You have loaded the outcome to NoSQL database (HBase / Cassandra) and served them to other applications (live website traffic, other internal tools)
You have stream processing experience on any - Apache Storm, Spark, Flink
You have Code/Build/Deployment -- Git, Maven, Jenkins
Provide cloud-computing infrastructure solutions on Amazon Web Services (AWS - EC2, VPCs, S3, IAM)
Last not but least Research and Details oriented mind-set