BriefCase
BriefCase

Senior Data Engineer Job in Cadenz.ai

Senior Data Engineer

Cadenz.ai 4+ weeks ago
Apply Now
Job Summary

Role Description


    TheDataTeam is looking for a Senior Data Engineer to join full-time and contribute to the engineering consulting services of the company. The Senior Data Engineer role is primarily responsible for building out entire engineering artifacts (code and documentation) for clients delivered on top of the Hadoop ecosystem (and friends like Spark and Kafka).
Responsibilities:

  • Requirements gathering and assessment
  • Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach
  • Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic
  • Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.
  • Mentoring juniors in a dynamic team setting
  • Manage stakeholders with proactive communication upholding TheDataTeam's brand and values
Requirements:

  • Strong problem solving ability
  • Excellent software design and implementation ability
  • Exposure and commitment to agile methodologies
  • Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance
  • Minimum 8 years of experience
  • Should have experience in full life-cycle of one big data application
  • Strong understanding of various storage formats(ORC/Parquet/Avro)
  • Should have hands-on experience in one of the Hadoop distributions(Hortoworks/Cloudera/MapR)
  • Experience in at least one cloud environment (GCP/AWS/Azure)
  • Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)
  • Bachelor's in Computer Science, and preferably, a Masters as well
  • Should have a good code review and debugging skills
Additional skills(Good to have)

  • Experience in Containerization (docker/Heroku)
  • Exposure to microservices
  • Exposure to DevOps practices
  • Experience in Performance tuning of big data applications
Experience Required :

Minimum 8 Years

Vacancy :

2 - 4 Hires

Similar Jobs for you

See more recommended jobs