Coders Brain is a global leader in it services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise and a global network of innovation and delivery centers.

We achieved our success because of how successfully we integrate with our clients.

Coders Brain Technology Pvt. Ltd.

<div><strong>Job Title: Senior Data Engineer </strong></div><div><br></div><div><strong>Job Description: Senior Data Engineer (Hive, Spark, Scala, and Python).</strong></div><div>We are seeking a highly skilled data engineer to join our team. In this role, you will be responsible for designing and implementing scalable data pipelines to process large amounts of data. This will include extracting data from a variety of sources, transforming and cleaning the data, and loading it into Hive or Spark for analysis. You will also be responsible for optimizing the performance of these pipelines and ensuring their reliability. As a Senior Data Engineer, you will play a critical role in the design, implementation, and maintenance of high-performance big data infrastructure, systems, and processing pipelines. You will work with a team of data engineers to scale our systems to handle billions of records of structured and unstructured data.</div><div>Key Responsibilities:</div><div> Design and implement big data infrastructure, systems, and processing pipelines</div><div> Troubleshoot and resolve technical issues related to data pipelines</div><div> Oversee assigned programs and guide team members</div><div> Explore new technologies and learn new techniques to solve business problems creatively</div><div> Build Flask and Rest APIs for data processing and analysis</div><div> Experience in Data Modelling concepts and SQL script</div><div> Hands-on experience with Spark Streaming or other live stream processing technologies</div><div> Any Cloud development (AWS, Azure, GCP) would be a plus and added advantage</div><div><br></div><div>Required Skills and Experience:</div><div><br></div><div><strong> Strong experience with Hive, Spark, Scala, Python, Linux, and Shell scripting</strong></div><div> Strong understanding of data modelling concepts and SQL script</div><div> Experience in building and maintaining high-performance big data infrastructure and processing pipelines</div><div> Experience with Spark Streaming or other live stream processing technologies</div><div> Any Cloud development (AWS, Azure, GCP) would be a plus and added advantage</div><div> Strong problem-solving and analytical skills</div><div> Excellent communication and team management skills</div><div>This is an exciting opportunity for an experienced Senior Data Engineer to take a lead role in a dynamic organization. If you are passionate about data engineering and want to work with a team of talented individuals, we would love to hear from you.</div>