<div>Mega Cloud Lab is a unique IT company that helps you migrate websites to mobile apps. We develop cloud-native e-commerce sites/mobile apps with domain-driven designs along with powerful automation. Professional Services- Build for natives and served globally with intuitive cloud implementation. Our Specialty- Migrate website to Mobile app, create e-commerce sites and mobile apps. Custom Solutions: We customize solutions based on the needs of customers. We understand that building trust is important and thus we provide all infrastructure and help to be successful. (to try our services for 1-3 months at our cost).</div>

Mega Cloud Lab

Data Engineer – Modern Cloud &amp; Semantic Data Platform
Location: Houston, Texas, United States (Onsite)
Job Type: Full-time / Contract
Experience Level: 9–13+ Years
Domain Focus: Energy / Oil &amp; Natural Gas Midstream
About the Role
We are seeking a senior-level Data Engineer to design, build, and scale a modern cloud data platform centered on Snowflake and AWS. The ideal candidate combines strong core data engineering fundamentals with experience in enterprise data platforms, ontology-driven modeling, and governed data products.
In this role, you will lead strategic data initiatives leveraging Snowflake, AWS, Iceberg managed tables, Snowflake Catalog, Snowflake Horizon, Informatica, and dbt. You will translate business concepts into trusted, reusable data assets supporting advanced analytics, business intelligence, application development, and AI-enabled use cases across the energy sector.
Key Responsibilities
<ul>
<li>
Data Pipeline Engineering: Design, build, and maintain scalable data pipelines for structured, semi-structured, and unstructured data.
</li>
<li>
Data Ingestion &amp; Extraction: Develop ELT/ETL ingestion processes using Informatica, aligning with enterprise standards and existing infrastructure.
</li>
<li>
Transformation &amp; Analytics Engineering: Build transformation logic using dbt, including modular models, automated testing, documentation, and deployment workflows.
</li>
<li>
Data Warehouse &amp; Architecture: Design and manage core data structures in Snowflake as the central strategic enterprise data platform.
</li>
<li>
Cloud Infrastructure: Integrate AWS-based data services and infrastructure to support applications and governed data products.
</li>
<li>
Open Table Formats &amp; Lakehouse: Support data architecture using Apache Iceberg managed tables, focusing on open table formats, interoperability, cataloging, and governed access patterns.
</li>
<li>
Governance &amp; Metadata Management: Leverage Snowflake Catalog and Snowflake Horizon for metadata management, data discovery, lineage tracking, policy enforcement, and secure data sharing.
</li>
<li>
Ontology &amp; Semantic Modeling: Support ontology-driven data modeling, entity definitions, taxonomies, business glossaries, and semantic mappings in collaboration with domain experts.
</li>
<li>
Data Architecture &amp; Design: Translate domain and business concepts into logical/physical data models and reusable data products.
</li>
<li>
Data Quality &amp; Observability: Implement validation rules, data quality checks, observability tools, and lineage controls.
</li>
<li>
Domain Use Cases: Support applications in news intelligence, asset intelligence, analytics, and AI/LLM integration (including Claude).
</li>
<li>
Security &amp; Compliance: Ensure all solutions satisfy enterprise requirements for access control, security, privacy, and performance.
</li>
</ul>
Required Skills &amp; Qualifications
<ul>
<li>
Experience: 9 to 13+ years of data engineering, data modeling, ETL/ELT pipeline design, and cloud platform development experience.
</li>
<li>
Domain Expertise: Experience in the Oil &amp; Natural Gas Midstream industry or broader Energy sector.
</li>
<li>
Snowflake Expertise: Deep hands-on proficiency with Snowflake (data modeling, performance optimization, access controls, warehouse/lakehouse patterns).
</li>
<li>
Cloud Platforms: Hands-on experience building and supporting applications in AWS cloud environments.
</li>
<li>
Generative AI / LLM Integration: Practical familiarity with Claude or LLM workflows integrated into data platforms.
</li>
<li>
Ingestion Tools: Experience with Informatica (or similar enterprise ETL tools) for ingestion and extract-load patterns.
</li>
<li>
dbt &amp; Analytics Engineering: Demonstrated hands-on experience using dbt for transformations, testing, and CI/CD workflows.
</li>
<li>
Open Table Formats: Knowledge of Apache Iceberg (managed tables, schema evolution, catalog-based access).
</li>
<li>
Data Governance &amp; Architecture: Familiarity with data cataloging, lineage tracking, policy-driven data access, metadata management, and knowledge graph/ontology concepts (semantic modeling, taxonomies, business glossaries).
</li>
<li>
Programming &amp; SQL: Advanced proficiency in SQL and Python (or another core data engineering language).
</li>
<li>
Soft Skills: Excellent communication, stakeholder management, documentation, and problem-solving skills.
</li>
</ul>
Preferred Skills
<ul>
<li>
Experience with Snowflake Catalog and Snowflake Horizon.
</li>
<li>
Building governed data products for advanced analytics and AI/ML applications.
</li>
<li>
Enterprise governance tools, particularly Informatica Governance capabilities.
</li>
<li>
Knowledge of RDF, OWL, SHACL, SPARQL, graph databases, or knowledge graph platforms.
</li>
<li>
Hands-on design of semantic layers, domain ontologies, and enterprise metadata models.
</li>
<li>
Modern DataOps practices: CI/CD, Git, automated testing, continuous integration for data pipelines.
</li>
<li>
Data observability, data contracts, and automated quality frameworks.
</li>
</ul>