Senior Cloud Data Engineer (AWS and Databricks)

New

Workplace type: Remote; Możliwość pracy 100% remoteContractSenior

Salary133 - 196 PLN per hour

Apply NowOpens the employer's application page

Job Details

Languages: English at intermediate level (minimum B2); fluent communication in Polish.
Experience: 5 lat; min. 5 lat doświadczenia w IT, w tym min. 3,5 roku w komercyjnej pracy z danymi w chmurze AWS
Required Skills: AWSPythonSQLGitTerraformDatabricksPySpark

Have at least 5 years of IT experience, including at least 3.5 years of commercial experience with data in the AWS cloud.
Have experience with AWS Glue, Athena, and DynamoDB.
Have experience using Databricks and Terraform.
Have commercial experience processing large volumes of data using JSON.
Know and use Python and PySpark.
Use SQL at an advanced level, including with Microsoft technology solutions.
Be proficient with Git and CI/CD.
Have experience with dbt.
Have experience creating and optimizing ETL/ELT data-processing solutions, preceded by technical design and consideration of alternatives such as Apache Airflow.
Have experience with agile practices and software development tools such as Azure DevOps.
Understand secure data storage and processing in the cloud.
Use Generative AI in software development and architectural and technology decisions.
Have English at intermediate level (minimum B2) and communicate fluently in Polish.

Design and develop a modern data platform based on Databricks and AWS.
Build and optimize ETL/ELT processes using PySpark, Spark SQL, and dbt.
Implement a lakehouse architecture using the Bronze, Silver, and Gold medallion approach.
Contribute to Data Engineering, data quality, and Data Governance standards.
Implement and develop solutions based on Unity Catalog.
Design data models to support business analytics and reporting.
Integrate data from multiple sources and implement CDC and near-real-time data processing.
Collaborate with architects, analysts, and the client to define the platform's development direction.
Help prepare and present product prototypes.

View Full Description & ApplyYou'll be redirected to the employer's site