Senior Data Engineer
New
W
WorldlyESG Intelligence
Location: United States - RemoteFull-TimeSenior
Salary$135K - $165K
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPythonSQLPostgresTerraformdbt
Requirements
- 5+ years of experience in data engineering, analytics engineering, or data platform engineering.
- Advanced SQL and relational database experience (e.g., Postgres, MongoDB).
- Hands-on production experience with graph databases and their integration with warehouses/lakes.
- Expertise in open table formats and medallion architectures such as Apache Iceberg.
- Experience with distributed SQL engines such as Trino or Presto.
- Strong Python skills for pipelines, automation, and operational tooling.
- Experience with streaming/CDC pipelines (e.g., Kafka, Pulsar, Debezium, or Flink).
- Experience with dbt orchestrated by tools like Dagster or Airflow.
- AWS infrastructure experience including EKS, VPC, IAM, and S3 using Terraform.
- Experience with CI/CD, GitOps, and Docker.
- Strong understanding of data security practices and analytics data modeling.
Responsibilities
- Operate and evolve the Postgres data warehouse, including schema, performance, and access controls.
- Manage the end-to-end production data lake including CDC ingestion, streaming, and the Trino query layer.
- Own pipeline health, latency SLAs, data lineage, and infrastructure-as-code management.
- Maintain and evolve dbt pipelines orchestrated by Dagster with integrated data quality tests.
- Lead the integration of graph databases with the warehouse and lake, working within canonical data models.
- Support and extend production generative AI workflows including embeddings and LLM-based extraction.
View Full Description & ApplyYou'll be redirected to the employer's site
