Big Data Platform Automation Engineer/senior Software Engineer Job in Hsbc
Big Data Platform Automation Engineer/senior Software Engineer
- Hyderabad, Telangana
- Not Disclosed
- Full-time
About HSBC
If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you're aiming to reach the top or seeking an exciting new direction, HSBC offers opportunities, support, and rewards to take you further. As one of the largest banking and financial services organizations globally, with operations across 64 countries and territories, HSBC is committed to enabling businesses to thrive, economies to prosper, and ultimately, helping people fulfill their ambitions.
The Role
We are seeking an experienced Senior Software Engineer to join our team. You will become part of HSBC s Data Provisioning Technologies team, responsible for managing and working on the cutting edge of CDP (Cloudera Data Platform) and ODP (Open Data Platform) platforms. As part of one of the largest Big Data estates in the banking industry, you will be instrumental in creating engineering solutions for Hadoop platform pipelines and utilizing industry-leading cloud technologies.
Responsibilities
- Contribute to Hadoop Engineering tasks, developing solutions for data pipeline management on CDP/ODP platforms.
- Work with Python, Ansible, and Kubernetes to create scalable, efficient solutions within a Big Data environment.
- Collaborate with the Data/Analytics teams to ensure the smooth operation of data systems and platforms.
- Design and implement technical solutions while adhering to best practices for CI/CD, DevOps, and GitOps methodologies.
- Develop and support solutions utilizing cloud technologies, ensuring the scalability and robustness of platforms.
- Contribute to debugging, troubleshooting, and maintaining the high-quality performance of data systems.
- Utilize Shell scripting, YAML, and modern automation tools to improve deployment and operational efficiency.
- Work with GitHub, Jenkins, Ansible for version control, continuous integration, and deployment.
Requirements
To be successful in this role, you should meet the following requirements:
- 3-6 years of experience in Hadoop Engineering with practical expertise in Python, Ansible, and DevOps methodologies.
- Strong knowledge of HDP (Hadoop Distribution), CDP, Linux, Python, Ansible, and Kubernetes.
- Proficient in Shell scripting, YAML, and technical design.
- Strong understanding of CI/CD concepts and hands-on experience with tools like GitHub, Jenkins, and Ansible.
- Familiarity with Test automation tools such as JUnit, Selenium, and Cucumber.
- Experience with industry-leading Cloud technologies and hands-on development in cloud environments.
- Working knowledge of GitOps and DevSecOps principles.
- Knowledgeable in Agile methodologies and ideally, certified in one of the frameworks.
- Strong communication and networking skills, with the ability to collaborate across teams.
- Ability to work autonomously, take accountability, and drive results in a high-pressure environment.
- A strong commitment to high-quality standards, and ownership of individual contributions.
Why HSBC?
- You ll have the opportunity to work on innovative projects at the forefront of the banking industry.
- A global platform with exposure to diverse teams and technologies.
- Join a company committed to professional development and career growth.
Achieve more when you join HSBC.
Qualification :
3-6 Years Experience in Hadoop Engineering with working experience on Python, Ansible DevOps methodologies.

