Big Data Engineers And Leads Job in Gspann Technologies, Inc

Big Data Engineers And Leads

Gspann Technologies, Inc 4+ weeks ago

Apply Now

Save Job

Job Summary

Role and Responsibilities:

Participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support.
Solve complex business problems by utilizing a disciplined development methodology.
Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
Analyze sourceandtarget system data. Map the transformation that meets the requirement.
Interact with clientsand onsite teams during different phases of a project.
Coordinate and collaborate withbusinessstakeholders, architects,and other teams.
Conduct performance and scalability tuning.

Skills and Experience

Experience in developing relevantBigData/ETL data warehouse and building cloud-native data pipelines.
Prior experience in developing Agile/Scrum applications using Jira.
Sound knowledge of Hive, Spark, Scala/Java/Python, and SQL.
Prior experience in Object and Functional programming using Python.
Good understanding of REST and SOAP-based APIs to extract data for data pipelines.
Expertise in Hadoop and related processing frameworks, such as Spark, Hive, Sqoop, etc.
Prior experience in workingin a public cloud environment, i.e.,GCP,AWS, orAzure.
Hands-on experience in working with real-time data streams and Kafka platform.
Good knowledge of workflow orchestration tools, such as Apache Airflow design and deploy Directed Acyclic Graphs (DAGs).

Experience Required :

2 to 8 Years

Vacancy :

2 - 4 Hires