Senior Data Engineer Job in Thotaka Tekhnologies India Private Limited

Senior Data Engineer

Apply Now
Job Summary


Responsibilities:

  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.
  • Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
  • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Python.
  • Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.

Qualifications & Expertise

  • 7+ years of experience as a Database Specialist or in a similar role with Bachelors/Masters degree in a relevant area
  • Experience with data modeling, data warehousing, and building ETL pipelines
  • Expertise in SQL(Window functions, Analytical functions, UDF, Sharding)
  • Extremely proficient in writing performant SQL working with large data volumes.
  • Must have excellent knowledge of Advanced SQL working with large data sets.
  • Experience with scripting for automation (preferably Python)
  • Expertise in Python Pandas
  • Expertise working on AWS stack and performance optimization of cloud databases
  • Strong understanding of ETL concepts and experience building them with large-scale, complex datasets using the traditional or map-reduce batch mechanism.
  • Experience designing and operating very large Data Warehouses
Minimum qualification requirement

Preferred - skill with 6+ years experience

Preferred - skill with 3+ years experience

Preferred - skill with 3+ years experience

Preferred - skill with 3+ years experience

Preferred - skill with 3+ years experience

Experience Required :

6 to 25 Years

Vacancy :

1 Hire

Skills Required :

AWS Glue, Snowflake, Data Warehouse, ETL, Python, SQL, Redshift, Aws Lambada, AWS Cloud Database, Database Specialist

Similar Jobs for you

See more recommended jobs