Trainee Data Engineer
New
V
Vertex RecruitmentsData engineering
Workplace type: remote; Country code: PLFull-TimeEntry
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Pl C2, en B2
- Required Skills
- PythonSQLSparkCI/CDDatabricksPySpark
Requirements
- Have basic knowledge of SQL and relational databases.
- Have basic knowledge of Python and programming.
- Understand basic data processing concepts such as ETL/ELT.
- Have basic knowledge of data lakes and data storage.
- Be interested in Big Data and willing to learn Spark/PySpark and Databricks.
- Have basic knowledge of at least one public cloud (AWS, GCP, or Azure), or be willing to develop in this area.
- Have basic knowledge of CI/CD.
- Be curious about technology and willing to learn and experiment with new technologies.
Responsibilities
- Learn data ingestion, processing, and transformation, and build basic data pipelines.
- Use Python to work with data and automate processes.
- Write SQL queries, join and aggregate data, and work with databases.
- Explore data warehouse and data lakehouse storage and organization approaches.
- Learn Apache Spark and PySpark for distributed processing of large datasets.
- Use Databricks for processing, analyzing, and managing large datasets.
- Learn Apache Airflow orchestration and CI/CD processes for testing and deploying pipelines.
- Explore AWS, GCP, or Azure and Terraform and Infrastructure as Code.
- Learn Docker and Kubernetes basics for running and managing applications and processes in containers.
- Learn Apache Kafka basics for real-time data processing.
View Full Description & ApplyYou'll be redirected to the employer's site
