Spark Scala Developer (bigdata) (e5 - Senior Engineer I) Job in Mobiquity Inc

You're looking for a job where you have the opportunity to stretch yourself, and where a job title is not considered the definition of who you are, but just a starting point. We invite you to join our ride, let s see if you ve got what it takes!

Mobiquity s delivery organization is responsible for the successful delivery of development projects as well as SLA driven operations, maintenance and support. By establishing a team of customer focused DevOps professionals we ensure the best service to our clients, and enable ongoing improvement of their (mobile) applications.

Job description:-

Must have

• Scala, Spark, Hive, Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker, executor cores and memory params.
• Hadoop development, SPARK, SCALA and Database exposure
• Spark and Spark Streaming creating RDD s, applying operations -Transformation and Actions.
• Code optimize to fine tune the applications.
• Develop Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.
• Develop scripts for doing transformations using Scala.
• Configure Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Spark-Scala.
• Analyze large amounts of data set to determine optimal way to aggregate and report on it.
• Strong database, SQL, ETL and data analysis skills.
• Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.
• Experienced with streaming work flow operations.
• Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently.
• (Soft skill) Right communication skills to be able to work with Business.
• (Soft skill) Good logical reasoning, analytical abilities. Recommend changes to client software based on information such as client feedback, language changes and new technology.
• (Soft skill) Experience working with remote teams.
• (Soft skill) Work to become the trusted partner of the Architects by regular engagement and proposals on best development practices which can be implemented and would bring change to the process

Good to have (Knowledge)

• Experience with GIT, Jenkins, test frameworks is good to have
• Good understanding of Agile development methodology.
• Create the required technical tasks in backlog and update status regularly.
• Using Kafka on publish-subscribe messaging as a distributed commit log, have experienced in its fast, scalable and durability.
• Participate in all Agile ceremony meetings and update task status and adhere to timelines and quality standards for the task.