Staff Data Engineer
New
O
OXIO CorporationTelecom-as-a-service
US | CanadaFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- AWSPythonSQLKubernetesSnowflakeData engineeringSparkTerraformdbt
Requirements
- 7+ years experience building large scale data platforms.
- Experience in Data Engineering, and/or Analytics Engineering, building scalable data warehouses
- Proficient with Dimensional Modeling (Star Schema, Kimball, Inmon) and Data architecture concepts.
- Fantastic collaboration and communication skills.
- Advanced SQL skills (ease with window functions, defining UDFs).
- Experienced with Python, Spark for building and maintaining data pipelines & ETL/ELT processes.
- Experienced working with dbt and Snowflake, BigQuery, Redshift or other data warehouses.
- Experience implementing real-time and batch data pipelines with tight SLOs and complex transformation requirements.
- Develop data models, schemas and standards for event data.
- Optimize data storage and access patterns for fast querying.
- Improve data reliability, discoverability and observability.
- Familiarity with Data Engineering tooling: ingesting, testing transformations, lineage, orchestration, publishing data, metric layers.
- Familiarity with storage layers like Hudi, Delta Lake and Iceberg.
- Familiarity with infrastructure tooling such as Terraform/Pulumi and worked with Kubernetes.
- Proficiency with AWS cloud.
Responsibilities
- Help build, maintain, and scale our data pipelines that bring together data from various internal and external systems into our data warehouse.
- Partner with internal stakeholders to understand analysis needs and consumption patterns.
- Partner with upstream engineering teams to enhance data logging patterns and best practices.
- Participate in architectural decisions and help us plan for the company’s data needs as we scale.
- Adopt and evangelize data engineering best practices for data processing, modeling, and lake/warehouse development.
- Advise engineers and other cross-functional partners on how to most efficiently use our data tools.
View Full Description & ApplyYou'll be redirected to the employer's site
