Senior Data Engineer Job in Cadenz.ai
Senior Data Engineer
Cadenz.ai
4+ weeks ago
- Bengaluru, Bangalore Urban, Karnataka
- Not Disclosed
- Full-time
- Permanent
Job Summary
Role Description
- TheDataTeam is looking for a Senior Data Engineer to join full-time and contribute to the engineering consulting services of the company. The Senior Data Engineer role is primarily responsible for building out entire engineering artifacts (code and documentation) for clients delivered on top of the Hadoop ecosystem (and friends like Spark and Kafka).
- Requirements gathering and assessment
- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach
- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic
- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.
- Mentoring juniors in a dynamic team setting
- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values
- Strong problem solving ability
- Excellent software design and implementation ability
- Exposure and commitment to agile methodologies
- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance
- Minimum 8 years of experience
- Should have experience in full life-cycle of one big data application
- Strong understanding of various storage formats(ORC/Parquet/Avro)
- Should have hands-on experience in one of the Hadoop distributions(Hortoworks/Cloudera/MapR)
- Experience in at least one cloud environment (GCP/AWS/Azure)
- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)
- Bachelor's in Computer Science, and preferably, a Masters as well
- Should have a good code review and debugging skills
- Experience in Containerization (docker/Heroku)
- Exposure to microservices
- Exposure to DevOps practices
- Experience in Performance tuning of big data applications
Experience Required :
Minimum 8 Years
Vacancy :
2 - 4 Hires
Similar Jobs for you
×
Help us improve TheIndiaJobs
Need Help? Contact us