Big Data_bangalore/pune Job in Sigma Allied Services Private Limited

Big Data_bangalore/pune

Apply Now
Job Summary

Roles and Responsibilities

" 5 10 years of recent experience in data engineering.
Bachelor s/Master s Degree in Computer Science or a related engineering field.
Strong analytical, verbal and written communication skills
StrongSQLknowledge
Exposure and experience with relational, NoSQL and Cloud based databases/datastores. Exposure and experience with Snowflake, Elasticsearch, MongoDB is an added advantage
Excellent hands-on coding skills on programming languages, such as Python and Scala
Experience in building scalable, robust data pipeline using Apache Airflow, Apache Nifi or similar technologies
Demonstrable experience with large scale batch processing systems based on Spark, Spark-SQL, Hadoop or similar allied technologies
Demonstrable experience building large scale stream processing solutions based on Kafka, Spark Streaming or similar technologies
Experience building and managing Data lakes, Big Data warehouse.
Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks
Willingness to explore new alternatives or options to solve complex data ingestion/mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done
Knowledge of GitLab, & CI/CD processes
Integrating ML Models to Data pipelines is an added advantage
Experience working in public cloud environments like AWS, GCP is an added advantage
Exposure in creating RESTful services and knowledge of containers like Docker, Kubernetes is an added advantage




Experience Required :

5 to 10 Years

Vacancy :

2 - 4 Hires

Similar Jobs for you

See more recommended jobs