Staff Engineer (big Data) Job in Nagarro

Job Description:

We are seeking an experienced Data Engineer with 7+ years of hands-on expertise in Hadoop, Hive, Spark, and Scala to join our team. The ideal candidate will have strong technical abilities in performance tuning, debugging, and developing scalable applications in Data Engineering. If you're passionate about solving complex problems, optimizing data workflows, and working with cutting-edge technologies, this role is for you!

Key Requirements:

• Experience:
  • 7+ years of experience in Data Engineering, specifically with Hadoop, Hive, Spark, and Scala.
  • Proven hands-on experience in performance tuning and debugging issues in distributed systems.
• Technical Skills:
  • Strong knowledge of stream processing with Spark/Java and Kafka, including integration with REST APIs.
  • Expertise in Functional Programming and OOP concepts, SOLID principles, and design patterns to develop scalable applications.
  • Familiarity with build tools such as Maven.
  • Experience writing unit and integration tests using ScalaTest.
  • Proficiency with version control systems like GitHub.
  • Experience working with CI/CD pipelines, specifically using Jenkins.
  • Familiarity with shell scripting and Oozie for job scheduling.
• Good-to-Have Skills:
  • Experience with Airflow, Databricks, Azure, and Splunk is a plus.

Responsibilities:

• Client Understanding & Technical Design:

  • Understand client business use cases and technical requirements, and translate them into technical designs that effectively meet their needs.
  • Collaborate with stakeholders to identify the best solutions, ensuring the final implementation aligns with client goals.

• Solution Architecture & Development:

  • Define guidelines and benchmarks for non-functional requirements (NFRs) during project implementation.
  • Write and review design documents outlining the architecture, framework, and high-level design for the development team.
  • Review architecture and design on aspects such as scalability, extensibility, security, user experience, and ensure adherence to best practices.

• Technology Integration & Problem Solving:

  • Develop solutions for functional and non-functional requirements, defining the necessary technologies, patterns, and frameworks to implement them.
  • Relate technology integration scenarios to project requirements and apply previous learnings to ensure project success.
  • Troubleshoot and resolve issues raised during code reviews, performing a thorough root cause analysis and providing justified solutions.
  • Conduct proof-of-concept (POC) activities to validate that proposed designs and technologies meet project requirements.

Qualifications:

• Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.