Senior Engineer - Etl Development Job in Cambridge Technology

We are seeking a Senior ETL Developer with a minimum of 5 years of hands-on experience in ETL development. In this role, you shall design the implementation of new ETL processes that add new data or improve existing processes to reduce latency and reduce cost. You are required to have good knowledge of using tools like ODI, SSIS, Informatica, etc. You are expected to be proficient in wiring complex SQL Queries and procedural scripts. Experience in Data Warehouse will be highly desired.

No of Positions

1

Skills Required

• Experience in the database, data integration, and data migration
• Experience with integration of data from multiple data sources
• Knowledge of various ETL techniques and frameworks
• Very good understanding of data warehousing techniques and processes
• Ability to write complex stored procedures and functions on multiple databases
• Proficient in working with data integration tools such as Oracle Data Integrator or Google Data Flow
• Good knowledge of scripting languages such as Python and Shell Script
• Experience with Google Cloud Platform, particularly BigQuery

Good to have

• Experience with Hadoop v2 and Spark
• Experience in real-time streaming data processing with Spark/Kafka/Kinesis
• Management of Hadoop cluster, with all included services and ability to solve any ongoing issues with operating the cluster
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

Roles & Responsibilities

• Interface with onsite/offshore team to gather, understand, and translate requirements related to ETL and Big Data Processing into the delivery process.
• Work closely with other ETL Engineers to provide technical requirements and implementation details.
• Develop ETL mappings and scripts
• Deploy, Run, and Debug the ETL system running the config scripts built by the ETL Engineering team.
• Ensure continuous improvement in data engineering excellence by implementing best practices for coding, testing, and deploying.

Experience

5-8 years

Education Qualification

B.E/B.Tech/MCA