Big Data Engineers And Leads Job in Gspann Technologies, Inc

Big Data Engineers And Leads

Apply Now
Job Summary




Role and Responsibilitie

  • Participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support.
  • Solve complex business problems by utilizing a disciplined development methodology.
  • Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
  • Analyze sourceandtarget system data. Map the transformation that meets the requirement.
  • Interact with clientsand onsite teams during different phases of a project.
  • Coordinate and collaborate withbusinessstakeholders, architects,and other teams.
  • Conduct performance and scalability tuning.

Skills and Experience

  • Experience in developing relevantBigData/ETL data warehouse and building cloud-native data pipelines.
  • Prior experience in developing Agile/Scrum applications using Jira.
  • Sound knowledge of Hive, Spark, Scala/Java/Python, and SQL.
  • Prior experience in Object and Functional programming using Python.
  • Good understanding of REST and SOAP-based APIs to extract data for data pipelines.
  • Expertise in Hadoop and related processing frameworks, such as Spark, Hive, Sqoop, etc.
  • Prior experience in workingin a public cloud environment, i.e.,GCP,AWS, orAzure.
  • Hands-on experience in working with real-time data streams and Kafka platform.
  • Good knowledge of workflow orchestration tools, such as Apache Airflow design and deploy Directed Acyclic Graphs (DAGs).
Experience Required :

2 to 8 Years

Vacancy :

2 - 4 Hires

Similar Jobs for you

See more recommended jobs