Data Engineer – Oil & Gas
New
I
ITMatesOil & gas
Remote, LATAM, Houston business hoursContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Advanced English
- Experience
- 5+ years in data engineering
- Required Skills
- AWSPythonSQLApache AirflowAzureSparkdbt
Requirements
- Have 5+ years of experience in data engineering.
- Have strong SQL and Python skills.
- Have production experience with Spark.
- Have experience with Azure or AWS data stacks.
- Have experience with Airflow or similar orchestration.
- Have experience using dbt for transformations.
- Have experience with high-volume time-series or IoT data.
- Have advanced English proficiency.
- Oil and gas domain knowledge, including WITSML, PPDM, or OSDU, is a plus.
- PI System integration experience is a plus.
- Spanish or Portuguese for work with LATAM operations is a plus.
Responsibilities
- Ingest time-series data from SCADA and historians, including OSIsoft PI and OPC UA, alongside ERP and production accounting sources.
- Build batch and streaming pipelines using Databricks or Snowflake, Spark, Kafka, and Airflow.
- Model data in a medallion architecture for production, drilling, and maintenance analytics.
- Enforce data quality, lineage, and access controls.
- Work with reservoir and production engineers to turn their questions into datasets.
- Optimize pipeline cost and performance.
View Full Description & ApplyYou'll be redirected to the employer's site
