Senior Data Engineer
New
Gdynia, Aleja Zwycięstwa 96/98/98, Gdynia, Country code: PLContractSenior
Salary140 - 170 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Pl C2, en B2
- Experience
- Minimum 5-7 years across core technologies
- Required Skills
- PythonSQLApache HadoopGitJUNITSparkLinuxScala
Requirements
- Minimum 5 years of experience in Spark and Scala.
- Minimum 7 years of experience in Python.
- Minimum 5 years of experience in Linux.
- Experience with distributed data processing engines like Spark.
- Experience with Hadoop and associated tools (Hive, Oozie, MapReduce).
- Strong/Advanced SQL skills.
- Previous experience in creating data flows.
- Expert level in Bitbucket and Git.
- Unit testing experience using JUnit 5, Mockito, and Spark testing.
- Advanced English skills (min B2).
Responsibilities
- Build a distributed and highly parallelized big data processing pipeline for massive amounts of structured and unstructured data in near real-time.
- Leverage Spark and Scala to transform corporate data for data product development.
- Perform continuous delivery on Hadoop and other Big Data platforms.
- Automate processes to ensure reliability and repeatability.
- Collaborate within a team to ensure expectations are met.
View Full Description & ApplyYou'll be redirected to the employer's site
