Coders Brain is a global leader in it services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise and a global network of innovation and delivery centers.

We achieved our success because of how successfully we integrate with our clients.

Coders Brain Technology Pvt. Ltd.

<div>JD for Spark developer</div><div>Experience:3 to 5 Years</div><div>Work Location: Bangalore&nbsp;</div><div>&nbsp;&nbsp;</div><div>Responsibilities&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;As a Spark developer you will manage the development of scalable distributed Architecture</div><div>defined by the Architect or tech Lead in our team.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Analyse, assemble large data sets to designed for the functional and non-functional</div><div>requirements.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;You will develop ETL scripts for big data sources.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Identify, design &amp;amp; optimise data processing &amp;amp; automate for reports and dashboards.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;You will be responsible for workflow optimizations, data optimizations and ETL optimization</div><div>as per the requirements elucidated by the team.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Work with stakeholders such as Product managers, Technical Leads &amp;amp; Service Layer</div><div>engineers to ensure end-to-end requirements are addressed.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Strong team player to adhere to Software Development Life cycle (SDLC) and</div><div>documentations needed to represent every stage of SDLC.&nbsp;</div><div> General Qualifications:&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;BE/BTech/MCA/MTech/MSC with 3-5 years of experience with Apache Spark development</div><div>or in alternative Data Engineering &amp;amp; analytics frameworks.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Overall experience in the field Java/Scala as a Backend developer could be between 3 years.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Working experience in Bigdata is important.&nbsp;</div><div> Technical Skills&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Programming experience in Java/Scala is needed. Experience in Python also will have an</div><div>advantage.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Writing ETL Stack in scalable &amp;amp; optimized fashion using Apache Spark/Hadoop/Kafka etc.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Should have working experience in writing distributed &amp;amp; optimized Apache Spark jobs for</div><div>various Machine Learning Algorithms.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Experience building and optimizing data pipeline and data sets is essential.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Should have worked with Kafka, at least one of No SQL databases (e.g. Cassandra,</div><div>MongoDB, elastic DB) and at least one of RDBMS (e.g. MySQL)&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Working experience to use cache such as Redis, Apache Ignite, Hazelcast will advantage.&nbsp;</div><div> .&nbsp;&nbsp;&nbsp;Working knowledge of Docker and Kubernetes will be a plus.&nbsp;</div><div>Kindly find the below inputs from customer to get quality profiles</div><div> Include the criteria apart from Spark à Experience in No sql databases (elastic search OR</div><div>Cassandra OR MongoDB), Apache Kafka.</div><div> Look for Spark Streaming (people who have used Sqoop, likely doesn’t know Spark Streaming).</div><div> Scala or Java based work experience using Spark is a MUST. Python usage with Spark is</div><div>optional, not must.</div><div><br></div><div>Spark streaming ,Kafka experience is mandatory for this requirement. Kindly add more profiles with</div><div>Spark Streaming, Kafka, Nosql experience</div>