Coders Brain is a global leader in it services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise and a global network of innovation and delivery centers.

We achieved our success because of how successfully we integrate with our clients.

Coders Brain Technology Pvt. Ltd.

<div><strong>JD :</strong></div><div><span style="color: rgb(49, 57, 73);">Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.</span></div><div><strong style="color: rgb(49, 57, 73);">Experience building robust and scalable data integration (ETL) pipelines using SQL, Python, Spark or PySpark. Advanced knowledge in one of the programming language is must.</strong></div><div><span style="color: rgb(49, 57, 73);">Maintain and enhance Confluent Kafka architecture, Confluent Kafka design principles, CI/CD Deployment procedures</span></div><div><span style="color: rgb(49, 57, 73);">Experience with building streaming applications with Confluent Kafka&nbsp;(Confluent Kafka preferred but open-source Kafka acceptable)</span></div><div><span style="color: rgb(49, 57, 73);">Development experience using Kafka producers, consumers, and streams (Confluent Kafka preferred but open-source Kafka acceptable)</span></div><div><span style="color: rgb(49, 57, 73);">Experience with building data pipelines and applications to stream and process datasets at low latencies.</span></div><div><span style="color: rgb(49, 57, 73);">Experience with real-time and scalable systems development using Apache Kafka or Confluent Kafka or Kafka Streams.</span></div><div><span style="color: rgb(49, 57, 73);">Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discover-ability of data.</span></div><div><span style="color: rgb(49, 57, 73);">Good understanding of AWS technologies (S3, AWS Glue, CDK, ECS, EMR, Redshift, Athena)</span></div><div><span style="color: rgb(49, 57, 73);">Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.</span></div><div><span style="color: rgb(49, 57, 73);">Knowledge of Engineering and Operational Excellence using standard methodologies.</span></div><div><span style="color: rgb(49, 57, 73);">Experience with process improvement, workflow, bench marking and / or evaluation of business processes.</span></div><div><span style="color: rgb(49, 57, 73);">Familiarity with CI/CD process.</span></div><div><span style="color: rgb(49, 57, 73);">Work in a fast paced agile environment.</span></div><div><span style="color: rgb(49, 57, 73);">Experience providing technical leadership and mentoring other junior engineers for best practices on data engineering.</span></div><div><span style="color: rgb(49, 57, 73);">Experience in building REST-APIs for data transfers.</span></div><div><span style="color: rgb(49, 57, 73);">Background in Java and Spring framework is a plus</span></div><div><span style="color: rgb(49, 57, 73);">Proficiency in one of JIRA, Atlassian, and Git is must.</span></div><div><span style="color: rgb(49, 57, 73);">&nbsp;</span></div><div><strong style="color: rgb(49, 57, 73);">Requirements</strong></div><div><span style="color: rgb(49, 57, 73);">Experience with real-time and scalable systems development using Apache Kafka or Confluent Kafka or Kafka Streams.</span></div><div><span style="color: rgb(49, 57, 73);">Experience providing technical leadership and mentoring other junior engineers for best practices on data engineering.</span></div><div><span style="color: rgb(49, 57, 73);">Experience in building REST-APIs for data transfers.</span></div><div><span style="color: rgb(49, 57, 73);">Background in Java and Spring framework is a plus</span></div><div><span style="color: rgb(49, 57, 73);">Proficiency in one of JIRA, Atlassian, and Git is must.</span></div><div><br></div>