Senior Software Engineer Hadoop Data Engineer Job in Valuemomentum

Qualification, Skills & Experience:

• 2-10 years of total experience in data projects with focus on data integration and ingestion
• 4+ years of experience in Hadoop infrastructure
• Good understanding of HDFS file systems, Hive, Zookeeper, YARN, Sqoop, oozie, Mapreduce and Spark
• Experience in building pipelines using Kafka, Sqoop, Spark and Python
• Experience in data migration, data ingestion and data management
• Experience in power shell, shell scripting and python
• Experience in building data pipelines for large volumes of data across disparate data sources
• Exposure to Azure cloud data services
• Experience in working with agile/scrum methodologies.
• Good communication and presentation skills

Responsibilities:

• Develop innovative analytic solutions to help enterprises derive actionable insights from their data to drive better business decisions
• Design and develop data analytics applications to solve challenging data problems of enterprises with cutting-edge design and algorithms
• Work with stakeholders including the product owner, data and design teams to assist with data-related technical issues and support their data infrastructure needs
• Analyze, interpret, and document data on all source, data conversions and data storage into target systems
• Provide resolutions to all data issues and co-ordinate with data analysts to validate requirements
• Identify, design, and implement process improvements aimed at automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build data sets for reporting to support visualization tools like Tableau
• Support data migration initiatives to Cloud platforms like Snowflake
• Develop ETL, workflows, and automated reporting solutions as needed by the business
• Collaborate with DevOps team to develop Continuous Integration/Continuous Delivery pipelines using containerization technologies
• Improve the scaling, optimization, efficiency and tests to enhance data quality and reliability
• Monitor process of software configuration/development/testing to assure quality deliverable
• Review deliverables to verify that they meet client and contract expectations
• Implement and enforce high standards for quality deliverables
• Design, implement, test and maintain new features for the data pipeline based on stakeholders requirements
• Analyze, interpret and document data on all source, data conversions and data storage into target systems
• Assess and improve the efficiency and effectiveness of the data analytics application solutions to ensure user requirements and business objectives are met in a timely and cost-effective manner
• Participate in daily scrums and technical initiatives for the organisation
• Achieve high customer satisfaction through technical deliverables
• Identify opportunities of innovation and bring new ideas to the table
• Apply principles of Agile and DevOps methodology in day-to-day work
• Willing to pick up additional skills based on business requirements
• Stay up-to-date on technical knowledge and technology trends by attending workshops, training, reviewing publications, etc.
• Collaborate with other engineers and product developers in an agile work environment
• Estimate task sizes and regularly communicate progress in daily standups and Scrum meetings

About Valuemomentum:

Headquartered in New Jersey, US, ValueMomentum is one of the fastest-growing software & solutions firms focused on the Insurance, Healthcare and Financial Services domain. Our industry focus, expertise in technology backed by R&D, and our customer-first approach uniquely position us to deliver the value we promise and drive momentum to our customers initiatives. ValueMomentum is amongst the top 10 insurance-focused IT services firms in North America in terms of the number of customers. Leading insurers, banks, and healthcare firms trust ValueMomentum with their core transformation and digital transformation initiatives. We are looking for talented, passionate and
creative people to join our rapidly expanding team and discover unlimited opportunities for growth!

What We Offer

• Career Advancement: Individual Career Development, coaching and mentoring programs for professional and leadership skill development in a global and diverse work environment.
• Comprehensive training (functional & technical), valuable professional qualification and certifications
• Performance Management: Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
• Culture: A highly transparent organization with an open-door policy and a vibrant culture.