Senior Data Engineer
New
R
RITS GroupData engineering
Locations: Warszawa, Warszawa, Warszawa, Country code: PLContractSenior
Salary135 - 150 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Pl C1, en B2
- Experience
- Minimum 3–5 years of experience
- Required Skills
- PythonSQLGitSparkCI/CDScalaDatabricks
Requirements
- Have 3–5 years of experience processing large datasets and working with Spark or Databricks platforms.
- Have advanced knowledge of Python or Scala and be able to write efficient queries and data transformations.
- Have experience designing and implementing ETL/ELT pipelines.
- Have experience working with data warehouses and data lakes.
- Understand Spark performance optimization, resource management, and cluster tuning.
- Have experience with version control systems such as Git.
- Know CI/CD tools and practices in the context of data solutions.
- Have strong communication skills and experience collaborating across teams.
- Have a technical degree or equivalent professional experience related to data engineering.
Responsibilities
- Design and implement ETL/ELT architecture in Databricks.
- Create and optimize data pipelines using Apache Spark, Python, and Scala.
- Work with analytics and product teams to understand business requirements and translate them into technical solutions.
- Automate data processing and ensure performance and scalability.
- Monitor, diagnose, and resolve performance issues in data environments.
- Implement practices for data quality, security, and metadata management.
- Create technical documentation and participate in code reviews.
View Full Description & ApplyYou'll be redirected to the employer's site
