Data Engineer (aws Or Snowflake) Job in Cloud Kinetics Technology Solutions Private Ltd

Data Engineer (aws Or Snowflake)

Apply Now
Job Summary
  • Identify, propose and implement advanced best-of-breed solutions to complex data engineering problems at scale
  • Shape and advise on detailed technical design decisions involving the design, build and launch of efficient and reliable distributed data pipelines to move & transform data
  • Design and develop new systems in partnership with software engineers to enable quick and easy data consumption
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
  • Guide and direct junior developers
  • Be a technology ambassador Git, blogs, spokesperson in customer and industry


Requirements

  • Possess a strong technology foundation
    • Platform Architecture incl. containerization
    • Databases
    • Data Pipelines Engineering and Architecture
    • Infrastructure Deployment and Management
  • Have extensive hands-on experience across the data pipeline
    • Ingestion: batch, streaming or both
    • ETL/ELT
    • Repository architecture and implementation
    • Deep expertise with ability to mentor in at least one programming language (such as Python, Scala, R) as well as SQL and Bash
  • Proven ability to envision and build platforms to scale disproportionately
  • Prior knowledge of CI/CD and agile development methodologies would be a plus
  • Prior experience in migration to cloud from legacy Hadoop, Teradata or Cloudera environments would be a big plus
  • Great aptitude for collaboration combined with excellent communication and presentation skills
  • Have deep experience and associated certifications in at least one of the platform-tracks below
  • Required: AWS Glue, AWS Redshift, AWS S3, Athena, MSK or Apache Kafka
  • Preferred: AWS Certified Data Analytics Specialty or AWS Certified Big Data Specialty
  • Must Have: Any combination of tools Snowflake native (COPY, Snowpipe, Streams etc) or 3rd party tools (dbT, Fivetran, Matillion, Immuta, Collibra etc) or Open Source tools (Airbyte, Debezium, etc)
  • Preferred: SnowPro Core & SnowPro Advanced: Data Engineer
  • Nice to Have: AWS Data pipeline, Lake Formation, EMR, Data Exchange or any of the 3rd party data integration tools (dbT, Fivetran, Matillion, Immuta, Collibra etc) or Open Source tools (Airbyte, Debezium etc)
  • Nice to have: AWS Solutions Architect Professional or Associate
  • Nice to Have: AWS Glue, Informatica ETL, other data integration and ETL/ELT tool sets
  • Nice to have: SnowPro Advanced: Administrator or Architect



Experience Required :

3 to 7 Years

Vacancy :

2 - 4 Hires

Similar Jobs for you

See more recommended jobs