Senior Data Engineer
New
S
SoftetaIT consulting
Kraków, Lesser Poland Voivodeship, PolandFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonCloud ComputingGCPSnowflakeData engineeringTerraformBigQuerydbtGitLab
Requirements
- Demonstrated experience as a Data or Software Engineer in Senior role
- Prior experience with dbt and Python is advantageous
- Familiarity with CI/CD systems like GitLab is required
- Experience with any public Cloud service
- Knowledge of Google Cloud and Cloud Data Warehousing is highly beneficial
- Experience with BigQuery or Snowflake and their integration with dbt is preferred
- Proficiency with Terraform is strongly desired
Responsibilities
- Combine data from multiple sources such as APIs, databases, and third-party systems
- Design and execute ETL/ELT workflows utilizing advanced data processing tools like Cloud Composer/Airflow, Dataflow
- Develop robust and efficient data pipelines, implement processing logic, and perform data transformations
- Enhance BigQuery queries and allocate resources effectively to minimize costs and boost performance
- Maintain data quality, availability, and security by adhering to industry best practices
View Full Description & ApplyYou'll be redirected to the employer's site
