Lead - Big Data Developer Job in Sutherland Global Services
Lead - Big Data Developer
- Hyderabad, Telangana
- Not Disclosed
- Full-time
- Permanent
Sutherland is seeking an attentive and analytical person to join us as a Big Data Developer (Hadoop Admin). The person should have hands-on experience in Big Data, Cloudera, Cloudera Manager admin console, Hadoop cluster setup and administration with Cloudera. We are a group of dynamic and driven individuals. If you are looking to build a fulfilling career and are confident you have the skills and experience to help us succeed, we want to work with you!
Responsibilities:
Keep management updated: Should update the management on the status
Impact the bottom line: Produce solid and effective strategies based on accurate and meaningful data reports and analysis and/or keen observations
Define Sutherlands reputation: Oversee and manage performance and service quality to guarantee customer satisfaction
Strengthen relationships: Establish and maintain communication with clients and/or team members; understand needs, resolve issues, and meet expectations
Take the lead: Able to debug the production issue quickly and provide the root cause analysis with resolution for the issue.
Qualifications:
To succeed in this position, you must:
Experience with Cloudera 6.0 and above versions
Well versed with Cloudera manager admin console
Knowledge on Hadoop cluster setup and administration, with Cloudera
Knowledge on HDFS, Hive, MapReduce, YARN, IMPALA, SPARK, HBASE, KMS, HUE, SENTRY
Knowledge on Azure Cloud Services
Strong background in Internet-related technologies, TCP/IP networking and core protocols (http, ftp, SMTP, etc.)
Excellent knowledge of UNIX/LINUX
Should have curiosity to find the root cause of the problem and solve it in an optimal way to prevent further issues.
Excellent Communication skills (Oral & Written)
Problem solving skills & good team player
Years of Experience: 6+
Educational Qualification: B.E / B.Tech / M.C.A
Additional responsibilities:
Deploying a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tool - Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running hadoop jobs.
Implementing, managing and administering the overall hadoop infrastructure.
Takes care of the day-to-day running of Hadoop clusters
A hadoop administrator will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.
Hadoop admin is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster.
Hadoop admin is also responsible for deciding the size of the hadoop cluster based on the data to be stored in HDFS.
Monitoring the cluster connectivity and performance.
Manage and review Hadoop log files.
Backup and recovery tasks
Resource and security management
Troubleshooting application errors and ensuring that they do not occur again.
Work with System and Application Owners, Quality Assurance, Release Management and others to resolve problems
Active participation in incident and problem management
Work to improve operations and performance of Hadoop deployments
Ensure that the hadoop cluster is up and running all the time.
Participate in on-call support, after-hours and weekend support
Fresher
2 - 4 Hires