Big Data Architect Job in Datametica
Big Data Architect
- Pune, Pune Division, Maharashtra
- Not Disclosed
- Full-time
- Permanent
Required Past Experience: 7+ years of overall experience in architecting, developing, testing & implementing Big data projects using Hadoop, Spark, Hive. Minimum 3+ years of experience in a architect/lead role Experience in setting up Hadoop services, implementing ETL/ELT pipelines, working with Terabytes of data ingestion & processing from varied systems Experience working in onshore/offshore model, leading technical discussions with customers, mentoring and guiding teams on technology, preparing HDD & LDD documents Required Skills and Abilities: Mandatory Skills Spark, Scala/Pyspark, Hadoop ecosystem including Hive, Sqoop, Impala, Oozie, Hue, Java, Python, SQL, Flume, bash(shell scripting) Secondary Skills Apache Kafka, Storm, Distributed systems, good understanding of networking, security(platform & data) concepts, Kerberos , Kubernetes Excellent understanding of distributed system architectures, in-depth knowledge on architecture and implementation of Hadoop Stack, Spark, Data warehousing concepts Understanding of Data Governance concepts and experience implementing metadata capture, lineage capture, business glossary Experience implementing CICD pipelines and working experience with tools like SCM tools such as GIT, Bit bucket, etc Hands on experience in writing data ingestion pipelines, data processing pipelines using spark and sql, experience in implementing SCD type 1 & 2, auditing, exception handling mechanism Data Warehousing projects implementation with either Java, or Scala based Hadoop programming background. Proficient with various development methodologies like waterfall, agile/scrum. Exceptional communication, organization, and time management skills Collaborative approach to decision-making & Strong analytical skills Good To Have - Certifications in any of GCP, AWS or Azure, Cloudera Work on multiple Projects simultaneously, prioritizing appropriately Knowledge on pre-sales activities such as RFP response, estimation techniques, planning concepts is an added advantage
Fresher
2 - 4 Hires
