I am pleased to welcome you to star4rall. Thank you for taking out time to visit us and I am sure you would find it exciting, informative and interesting to know about us in detail. We have a past that we can be proud of, at the same time, we are confident about our enormous growth in the future which is completely based on the innovations and aspirations of our professionals. Without any doubt, I announce that our unique business model, work practices, and culture of quality and excellence in everything we do will lead us to a successful future. We have reached this far owing to hard work, dedication and determination of the team that drives this organization. I’m confident that with our versatile, adaptable and technology led efforts, we will meet the exacting standards of our clients.

star4rall it solutions pvt ltd

<div><strong style="color: rgb(31, 78, 121);">Job Title: DATA ENGINEER </strong></div><div><strong style="color: rgb(31, 78, 121);"> Location: Remote</strong></div><div><strong style="color: rgb(31, 78, 121);"> Employment Type: Permanent role</strong></div><div><strong style="color: rgb(31, 78, 121);"> Client: Bilge Adam(UK Based client)</strong></div><div><strong style="color: rgb(31, 78, 121);"> Work Time: 2pm-11pm</strong></div><div><span style="color: rgb(31, 78, 121);"> </span><strong style="color: rgb(31, 78, 121);">Experience: 4-6years</strong></div><div><br></div><div><span style="color: rgb(31, 78, 121);"> </span><strong style="color: rgb(31, 78, 121);"><em><u>Job Description:</u></em></strong><span style="color: rgb(31, 78, 121);"> </span></div><div><span style="color: rgb(31, 78, 121);">&nbsp;</span></div><h1>The Role</h1><div style="text-align: justify;">As a Data Engineer you'd be working with us to design, maintain, and improve various analytical and operational services and infrastructure which are critical for many other functions within the organization. These include the data lake, operational databases, data pipelines, large-scale batch and real-time data processing systems, a metadata and lineage repository, which all work in concert to provide the company with accurate, timely, and actionable metrics and insights to grow and improve our business using data. You may be collaborating with our data science team to design and implement processes to structure our data schemas and design data models, working with our product teams to integrate new data sources, or pairing with other data engineers to bring to fruition cutting-edge technologies in the data space.</div><div>&nbsp;</div><h1>Our Ideal Candidate</h1><div style="text-align: justify;">We expect candidates to have <u>in-depth experience</u> in <u>some of the following</u> skills and technologies and be motivated to build up experience and fill any gaps in knowledge on the job. More importantly, we seek people who are <u>highly logical</u>, with a balance of respect for <u>best practices</u> and using their own <u>critical thinking</u>, <u>adaptable</u> to new situations, capable of <u>working independently</u> to deliver projects end-to-end, <u>communicates well</u> in English, <u>collaborates effectively</u> with teammates and stakeholders, and eager to be on a high-performing team, taking their careers to the next level with us.</div><div style="text-align: justify;"><strong>Highly relevant:</strong></div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;General computing concepts and expertise: Unix environments, networking, distributed and cloud computing</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Python frameworks and tools: pip, pytest, boto3, pyspark, pylint, pandas, scikit-learn, keras</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Agile/Lean project methodologies and rituals: Scrum, Kanban</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Workflow scheduling and monitoring tools: Apache Airflow, Luigi, AWS Batch</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Columnar and big data databases: Athena, Redshift, Vertica, Snowflake, Hive/Hadoop</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Version control: git commands, branching strategies, collaboration etiquette, documentation best practices</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;General AWS or Cloud services: Glue, EMR, EC2, ELB, EFS, S3, Lambda, API Gateway, IAM, Cloudwatch, DMS</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Container management and orchestration: Docker, Docker Swarm, ECS, EKS/Kubernetes, Mesos</div><div>	•&nbsp;&nbsp;&nbsp;&nbsp;CI / CD tools: CircleCI, Jenkins, TravisCI, Spinnaker, AWS CodePipeline .</div><div><strong>Also good to have:</strong></div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;JVM languages, frameworks and tools: Kotlin, Java, Scala / Maven, Spring, Lombok, Spark, JDK Mission Control</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Distributed messaging and event streaming systems: Kafka, Pulsar, RabbitMQ, Google Pub/Sub</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;RDBMS and NoSQL databases: MySQL, PostgreSQL / DynamoDB, Redis, Hbase</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Enterprise BI tools: Tableau, Qlik, Looker, Superset, PowerBI, Quicksight</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Streaming data processing frameworks: Spark Streaming, Apache Beam, Apache Flink</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Data science environments: AWS Sagemaker, Project Jupyter, Databricks</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Log ingestion and monitoring: ELK stack (Elasticsearch, Logstash, Kibana), Datadog, Prometheus, Grafana</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Metadata catalogue and lineage systems: Amundsen, Databook, Apache Atlas, Alation, uMetric</div><div>•&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Data privacy and security tools and concepts: Tokenization, Hashing and encryption algorithms, Apache Ranger</div><div>&nbsp;&nbsp;</div><div><br></div>