Senior Big Data Engineer
New
L
Lumicode Sp. z o.o.IT Services
Warszawa, Al. Jerozolimskie, Warszawa, Country code: PLFull-TimeSenior
Salary18,480 - 21,840 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- Minimum 5 lat praktycznego doświadczenia w programowaniu; Minimum 3 lata doświadczenia w pracy z rozwiązaniami klasy Big Data
- Required Skills
- DockerPythonSQLJavaKubernetesSparkLinuxScala
Requirements
- Minimum 5 years of practical programming experience in Scala, Python, or Java.
- Commercial experience in implementing projects involving distributed systems.
- Minimum 3 years of experience in working with Big Data solutions, particularly Apache Spark and Apache Iceberg.
- Commercial experience in optimizing processing of large data sets.
- Experience in projects related to large-scale system integration.
- Experience working with Relational Database Management Systems (RDBMS) and very good knowledge of SQL.
- Practical knowledge of the Linux environment and scripting languages.
- Experience in containerization, including modifying Dockerfiles, and knowledge of Kubernetes basics.
Responsibilities
- Create and optimize solutions based on Python.
- Work in a Kubernetes environment using Spark Operator, Jupyter, and Airflow.
- Develop Big Data solutions utilizing Apache Spark / PySpark.
- Provide technical support for unit, integration, and UAT testing.
- Document code and data flows.
View Full Description & ApplyYou'll be redirected to the employer's site
