Talent.com
Data Engineer Lead (OT Data)
Data Engineer Lead (OT Data)Codvo.ai • Doha, Ad-Dawhah, Qatar
Data Engineer Lead (OT Data)

Data Engineer Lead (OT Data)

Codvo.ai • Doha, Ad-Dawhah, Qatar
15 hours ago
Job description

Job Description : Data Engineer (OT Data) (Category - Engineer)

Sector : Oil and Gas

Location : Doha, Qatar

Experience : 10 years

About Us

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.

The Opportunity

The Data Engineer will be a foundational architect of our delivery strategy, responsible for building and maintaining the data ecosystem required for our scoped-out use cases. You will be the crucial link between our vast, complex data sources and our advanced analytics ambitions. This involves tackling the unique challenges of the oil and gas sector, bridging the worlds of operational technology (OT)—with its real‑time drilling data, SCADA systems, and seismic surveys—and information technology (IT). Your mission is to build the specific, high‑performance data pipelines required to deliver our portfolio of projects. This means going beyond simple data movement; you will be creating reliable, scalable, and secure data products that serve as the fuel for our most critical AI models and analytics dashboards, directly enabling tangible business value and competitive advantage.

Key Responsibilities

  • Architect & Build Data Pipelines : Design, construct, install, test, and maintain highly scalable data management systems and ETL / ELT pipelines.
  • Integrate Diverse Data Sources : Develop processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors.
  • Cloud Data Platform Development : Implement and manage data solutions on the Microsoft Azure cloud platform, leveraging services like Azure IoT Hub, Azure Event Hubs, and Azure Stream Analytics for real‑time ingestion and processing of OT data.
  • Data Modelling & Warehousing : Design and implement data models optimized for time-series data from industrial assets, supporting operational dashboards and real‑time analytics.
  • Enable Advanced AI : Build the data infrastructure to support AI / ML models for predictive maintenance, operational anomaly detection, and process optimization using real‑time OT data.
  • Champion Master Data Management (MDM) : Design and implement MDM strategies and solutions to create a single, authoritative source of truth for critical data domains such as wells, equipment, and assets, ensuring data consistency across the enterprise.
  • Ensure Data Quality & Governance : Implement robust data quality checks, validation rules, and monitoring to ensure the accuracy, consistency, and reliability of our data. Adhere to and help shape our data governance policies.
  • Embrace Industry Standards : Champion and implement industry‑specific data standards and models, such as the OSDU™ Data Platform, to ensure interoperability and a unified data view across the upstream lifecycle.
  • Collaborate & Innovate : Work closely with a cross‑functional team of geoscientists, drilling engineers, data scientists, and business analysts to understand their data needs and deliver effective solutions.
  • Automate & Optimize : Identify opportunities for process automation and infrastructure optimization to improve data delivery, scalability, and cost‑effectiveness.
  • Security First : Implement and maintain security best practices to protect our sensitive and proprietary data assets.

Required Skills and Qualifications

  • Bachelor's in engineering, Information Systems, or a related quantitative field.
  • 5+ years of proven experience in a data engineering role.
  • Experience within oil and gas industry is highly preferred.
  • Demonstrable experience building and operationalizing large‑scale data pipelines and applications.
  • Technical Proficiencies

  • Expert‑level proficiency in SQL and Python for data manipulation and pipeline development.
  • Big Data Technologies : Hands‑on experience with distributed computing frameworks like Apache Spark (PySpark). Experience with streaming technologies like Kafka is a plus.
  • Cloud Platforms : Deep experience with Microsoft Azure (Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure Synapse).
  • Data Warehousing / Lakehouse : Proven experience with modern data platforms Databricks Delta Lake.
  • AI & ML Knowledge : Understanding of machine learning lifecycles and the data requirements for training and deploying AI / ML models.
  • Orchestration : Experience with workflow orchestration tools like Airflow, Dagster, or Azure Data Factory.
  • Databases : Strong understanding of both relational (e.g., PostgreSQL, SQL Server) and NoSQL databases. Experience with graph databases (e.g., Neo4j) and vector databases is highly desirable.
  • Version Control : Proficiency with Git and CI / CD best practices.
  • Preferred Qualifications

  • Familiarity with historian systems (e.g., OSIsoft PI System) and their data structures.
  • Hands‑on experience with the OSDU™ Data Platform.
  • Experience working with industrial communication protocols (e.g., OPC UA, Modbus TCP / IP).
  • Understanding of cybersecurity considerations for OT environments and data segregation.
  • Experience integrating data from ERP systems like SAP.
  • Professional certifications in Azure or Databricks.
  • Advanced SQL skills, including query optimization and performance tuning.
  • Knowledge of containerization technologies (Docker, Kubernetes).
  • Experience of constructing and maintaining enterprise knowledge graphs.
  • Sector – Oil & Gas

    Location – Doha, Qatar

    #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Doha, Ad-Dawhah, Qatar

    Related jobs
    Data Engineer (OT Data)

    Data Engineer (OT Data)

    Codvo.ai • Doha, Ad-Dawhah, Qatar
    Job Description : Data Engineer (OT Data) (Category - Engineer).At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of inn...Show more
    Last updated: 1 day ago • Promoted
    Project Manager for Applications, Data & AI

    Project Manager for Applications, Data & AI

    Project Management Institute • Doha, Ad-Dawhah, Qatar
    At Kyndryl, we design, build, manage and modernize the mission‑critical technology systems that the world depends on every day. We are always moving forward – always pushing ourselves to go further ...Show more
    Last updated: 12 days ago • Promoted
    Lead - Proposal Engineer

    Lead - Proposal Engineer

    Petrotec Group • Qatar
    EPC and long-term maintenance projects.This includes handling client RFQs, preparing pre-qualifications, developing detailed technical and commercial proposals, and coordinating with internal depar...Show more
    Last updated: 1 day ago • Promoted
    Head of Data Architecture & Strategy

    Head of Data Architecture & Strategy

    OMW Consulting • Doha, Ad-Dawhah, Qatar
    Founder of OMW Consulting | Connecting Top Defense Talent | Executive Search.Head of Data Architecture & Strategy.This strategic leadership role is central to shaping the Bank’s data-driven future ...Show more
    Last updated: 15 hours ago • Promoted • New!
    Lead Project Manager

    Lead Project Manager

    Sprinklr • Qatar
    Sprinklr is the definitive, AI-native platform for Unified Customer Experience Management (Unified-CXM), empowering brands to deliver extraordinary experiences at scale — across every customer touc...Show more
    Last updated: 9 days ago • Promoted
    Associate Director - Data Analytics

    Associate Director - Data Analytics

    Uniqus Consultech Inc. • Doha, Ad-Dawhah, Qatar
    We at Uniqus Consultech are hiring for Data & Analytics role.Uniqus is a tech-enabled global platform that offers ESG and Accounting & Reporting Consulting by leveraging high-performing global tale...Show more
    Last updated: 9 days ago • Promoted
    Sales Engineer

    Sales Engineer

    Everllence • Qatar
    To drive revenue growth from existing and prospective customers through a relationship-based selling approach.The Sales Engineer will be responsible for ensuring that the company remains competitiv...Show more
    Last updated: 9 days ago • Promoted
    Principal Engineer - Data & AI (OIl & Gas) (Doha)

    Principal Engineer - Data & AI (OIl & Gas) (Doha)

    Codvo.ai • Doha, Ad-Dawhah, Qatar
    Senior Technical Lead (Data & AI) / Delivery Owner.Category – Principal Engineer / Technical Lead.At Codvo, we are committed to building scalable, future-ready data platforms that power business im...Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Architect

    Data Architect

    Ashghal (Public Works Authority) • Doha, Ad-Dawhah, Qatar
    The Data Architect is responsible for defining, designing, and implementing enterprise data architecture strategies and solutions that enable data-driven decision-making and digital transformation....Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Analyst

    Data Analyst

    Fusion Outsourcing and Services • Qatar
    Support the data and information systems for Reservoir and Geosciences with a specific focus on Petrophysics data stewardship. Provide assistance across related data domains including Geology and Re...Show more
    Last updated: 7 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Connect Vision International • Doha, Ad-Dawhah, Qatar
    Permanent – Full-time or Contract (Open to both).Competitive salary / rate (open and negotiable based on experience).The ideal candidate will have deep technical expertise in.This role involves bui...Show more
    Last updated: 15 hours ago • Promoted • New!
    Azure DevOps (Data) Engineer

    Azure DevOps (Data) Engineer

    Connect Vision International • Doha, Ad-Dawhah, Qatar
    Permanent – Full-time or Contract (Open to both).Competitive salary / rate (open and negotiable based on experience).We are looking for an experienced. The ideal candidate will have strong hands‑on ...Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Engineer (OT Data)

    Data Engineer (OT Data)

    Codvo Private Limited • Doha, Qatar
    Job Description : Data Engineer (OT Data) (Category - Engineer).About Us At Codvo, we are committed to building scalable, future-ready data platforms that power business impact.We believe in a cultu...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer (SQL)

    Data Engineer (SQL)

    Vinirma Consulting Pvt Ltd. • Qatar
    Seeking a Data Engineer / SQL Developer with 35 years of experience in advanced T‑SQL scripting, database optimization and performance tuning using Microsoft Azure SQL and SQL Server.Ideal candidat...Show more
    Last updated: 7 days ago • Promoted
    Sales Engineer

    Sales Engineer

    INSTROL WLL • Qatar
    Operations Manager at Instrol Company W.INSTROL WLL, an ISO 9001 : 2015 certified organization, is a leading Trading & Technical Services Company based in Doha, Qatar. Serving primarily the Oil & Gas ...Show more
    Last updated: 15 hours ago • Promoted • New!
    Senior Sales Engineer

    Senior Sales Engineer

    Elite Fire Protection Systems • Qatar
    Direct message the job poster from Elite Fire Protection Systems.This ideal candidate will partner with Account Executives to find, contact, and follow-up with prospective clients.Once they discove...Show more
    Last updated: 1 hour ago • Promoted • New!
    Business Development Leader

    Business Development Leader

    Kin-Tec Global Recruitment • Qatar
    The Business Development Leader is responsible for identifying, evaluating, and driving new business opportunities in assigned regions. The role involves conducting market research, screening ventur...Show more
    Last updated: 3 days ago • Promoted
    Data Analyst

    Data Analyst

    DSQ • Doha, Ad-Dawhah, Qatar
    Urgent Hiring for Data Analyst.Educational / Technical Qualifications.Bachelor’s degree in a relevant domain such as Management Information Systems, Information Technology, Informatics or related t...Show more
    Last updated: 9 days ago • Promoted