Finding great talent globally comes at the expense of time and complexity. Global vetting, low selection ratio, lower offer acceptance rate, long notice periods, multiple offers and local compliances.

The list is long.

Well, no more. Deploy a remote team in under 3 days with our bench of 200+ meticulously selected, pre-recruited (not just vetted) experienced remote software developers trained in full-stack product development in our in-house projects. 

40+ companies across 3 countries have chosen us for their complex project requirements

Our full-stack developers specialise in 8+ technology stacks:

MERN
MEAN
Python dominant full-stack
Java dominant full-stack

We have a special emphasis on 'product development'. To enable this, every developer in TGS maintains a 360 degree understanding of product development with knowledge of server-less architecture, Microfrontend design pattern, version control softwares, generative AI, TDD and more.

To start building your team today, please drop a note to: sales@thegeeksquad.tech

Team Geek Solutions

About the Role We are seeking a skilled &nbsp;Data Engineer &nbsp;with hands-on &nbsp;experience in Kafka Connect &nbsp;and &nbsp;related data ingestion tools to design and implement a &nbsp;Bronze Layer &nbsp;for our data platform. The &nbsp;ideal candidate will work closely with data platform and analytics teams to build scalable and &nbsp;reliable ingestion pipelines from various data sources into cloud-based storage systems. &nbsp;
Location: Remote Time zone: IST&nbsp;
Notice Period: Immediate Joiner
Key Responsibilities:
● Design, develop, and maintain &nbsp;data ingestion pipelines using Kafka Connect &nbsp;and &nbsp;Debezium for real-time and batch data integration. &nbsp;
● Ingest data from &nbsp;MySQL &nbsp;and &nbsp;PostgreSQL &nbsp;databases into AWS S3, Google Cloud &nbsp;Storage(GCS) , and BigQuery . &nbsp;
● Implement best practices for data modeling, schema evolution, and efficient partitioning &nbsp;in the Bronze Layer. &nbsp;
● Ensure reliability, scalability, and monitoring of Kafka Connect clusters and connectors. &nbsp;
● Collaborate with cross-functional teams to understand source systems and downstream data requirements. &nbsp;
● Optimize data ingestion processes for performance and cost efficiency. &nbsp;
● Contribute to automation and deployment scripts using &nbsp;Python &nbsp;and cloud-native tools. &nbsp;
● &nbsp;Stay updated with emerging data lake technologies such as &nbsp;Apache Hudi &nbsp;or &nbsp;Apache &nbsp;Iceberg . &nbsp;
Required Skills and Qualifications:
● 2+ years &nbsp;of hands-on experience as a &nbsp;Data Engineer or similar role. &nbsp; ● Strong experience with &nbsp;Apache Kafka &nbsp;and &nbsp;Kafka Connect (sink and source &nbsp;connectors). &nbsp; ● Experience with &nbsp;Debezium &nbsp;for change data capture (CDC) from RDBMS. &nbsp; ● Proficiency in working with &nbsp;MySQL &nbsp;and &nbsp;PostgreSQL . &nbsp; ● Hands-on experience with &nbsp;AWS S3 , &nbsp;GCP BigQuery , and &nbsp;GCS . &nbsp; ● Proficiency in &nbsp;Python &nbsp;for automation, data handling, and scripting. &nbsp; ● Understanding of data lake architectures and ingestion patterns. &nbsp; ● Solid understanding of &nbsp;ETL/ELT pipelines , data quality, and observability practices. &nbsp;
Good to Have: &nbsp; ● Experience with containerization (Docker, Kubernetes). &nbsp; ● Familiarity with workflow orchestration tools (Airflow, Dagster, etc.). &nbsp; ● Exposure to infrastructure-as-code tools (Terraform, CloudFormation). &nbsp; ● Familiarity with &nbsp;data &nbsp;versioning &nbsp;and &nbsp;table &nbsp;formats &nbsp;such as &nbsp;Apache &nbsp;Hudi &nbsp;or &nbsp;Apache &nbsp;Iceberg &nbsp;(preferred).&nbsp;
&nbsp;