Lead Data Architect Job in Blazeclan Technologies
Lead Data Architect
Blazeclan Technologies
4+ weeks ago
- Pune, Pune Division, Maharashtra
- Not Disclosed
- Full-time
- Permanent
Job Summary
- 10+ Yrs. years of hands-on experience in big data computation technologies (at least one and potentially several of the following) Kafka Streaming, Apache Kafka, Confluent, Spark and Hadoop.
- 3 + years of experience working with creating and managing multiple topics on Kafka clusters.
- Architectural experience with Spark, AWS and Big Data (Hadoop Cloudera or Hortonworks).
- Design and develop low-latency, highly-performance data analytics applications
- Extensive experience with messaging and stream processing on Kafka
- Develop automated data pipelines to synchronize and process complex data streams
- Strong experience working on Event Driven Architecture.
- Design and develop low-latency, highly-performance data analytics applications
- Develop automated data pipelines to synchronize and process complex data streams
- Ability to install, maintain and troubleshoot Kafka components
- Experience with the Confluent version of Kafka and its many related components.
- Provide expertise in Confluent Platform Enterprise Edition: Kafka Connect, Schema Registry, KSQLDB, Kafka brokers, ZooKeeper, KStream API, KAFKA MDS/RBAC, and Confluent Control center.
- Provide expertise and hands-on experience working on AvroConverters, JsonConverters, and StringConverters.
- Provide expertise and hands-on experience on custom connectors using the Kafka core concepts and API.
- Strong understanding of Canonical Data Modelling in Kafka, which describes how messages or packets move between various systems both inside the company and between various vendor systems.
- Must have a good understanding and experience of working in cloud/on-premise platforms and must have experience working on AWS cloud.
- Solid understanding of Data Modelling (Facts and Dimensions, etc) and Data Management (ETL, etc) concepts
- Deep Knowledge of CI/CD (Gitlab, Jenkins, Ansible)
- Excellent troubleshooting & problem-solving skills
- Strong analytical thinking
- Good team-work skills
Experience Required :
Minimum 10 Years
Vacancy :
2 - 4 Hires
Similar Jobs for you
×
Help us improve TheIndiaJobs
Need Help? Contact us