Spark Developer / 3 - 5 Years / Bangalore


Posted 10 May 2017 (290 days ago)

Job Description

Candidate must have experience in developing and deploying large scale distributed applications and event processing systems.
Should have hands-on expertise in Spark in a Java.
They should have experience in working on large data sets.
Candidate must be having experience developing and or using web services (REST and or SOAP).
Should have strong debugging skills from client-side to server-side to back-end.
Candidate must have good experience in Spark with Scala & Impala.
Experience in Hadoop ecosystem which includes: Hive, PIG, Java, Sqoop, Oozie & shell scripting.
Must have strong understanding of HDFS, Hadoop technologies.
Candidate must have ability to design & develop workflows in Big data.
Experience working with complex data models, large databases, extensive reporting and data analysis is a plus.
Candidate must be strong background in system architecture and design, documentation, implementation and deployment.
Should be broad understanding and experience of real-time analytics and batch processing using apache spark and strong understanding and hands-on experience of spark components such as streaming, batch processing, spark.
Must architect and design new software product features and help drive projects to completion.

Desired Candidate

Candidate must have solid Understanding of Big Data Systems in the Hadoop Ecosystem. Experience with Apache Spark.
Should work independently completing small to large sized projects while managing priorities in a demanding production environment.
Should have ability for End to end delivery on projects from documentation to production while functioning within the process.
Must actively participate in high level engineering team activities such as suggesting architecture improvements, recommending process improvements and conducting tool evaluations.
Candidate must be fluency with one or more of the following programming languages: Java, Python.
Must troubleshoot programming problems independently and in peer groups.
Should evaluate new and emerging technologies and determine applicability to current and future projects.Good understanding of open source cloud technologies and application platforms.

Key Skills

Spark, Hadoop, Scala


Information Technology And Services

Employment Type

Full Time

Job Function

Information Technology

Experience Required

3 - 5 Years

No Of Positions

Salary Offered

INR 500000 - 1000000

Interview Locations

Client Location - Not Mentioned(Interview Mode - Face 2 Face)

Also Matched Jobs

Big data Architect


Posted 21 Feb 2018(3 days ago)

ETL Developer


Posted 31 Jan 2018(24 days ago)

Infrastructure Engineer


Posted 01 Sep 2017(176 days ago)

Backend/Lead developer


Posted 01 Sep 2017(176 days ago)

Test Engineer/Associate QA Lead


Posted 14 Jul 2017(225 days ago)