Databricks Data Engineer
New
R
RemoDevsData & AI
Warszawa, Ludna 2, Gdańsk, Szafarnia 11, Kraków, Ludna 2, Warszawa, Country code: PLFull-TimeSenior
Salary30,240 - 36,960 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLGCPAzureSparkDatabricksPySpark
Requirements
- Hands-on experience with Databricks.
- Strong experience in Data Engineering and building production-grade data pipelines.
- Strong SQL and PySpark / Apache Spark skills.
- Experience working with large datasets and distributed data processing.
- Good understanding of modern data platform, lakehouse and data architecture concepts.
- Experience with cloud environments such as Azure, AWS or GCP.
- Experience with Delta Lake and data orchestration tools.
- Experience working with different data sources, formats and integration patterns.
- Ability to work closely with Data Scientists, Analysts and other technical stakeholders.
- Strong problem-solving skills and a pragmatic approach to data engineering.
Responsibilities
- Design, build and maintain scalable data pipelines using Databricks and Apache Spark.
- Integrate data from multiple sources and build reliable, reusable data flows.
- Develop and optimize data processing solutions for large volumes of data.
- Work closely with Data Scientists, Analysts and business stakeholders to deliver data products supporting ML, BI and analytics.
- Contribute to the development of a unified data platform and high-quality data layer.
- Ensure data pipelines are reliable, scalable, performant and easy to maintain.
- Optimize data processing and infrastructure with a focus on performance, scalability and cost efficiency.
- Implement and maintain data quality, monitoring and data engineering best practices.
- Support the development and evolution of modern lakehouse and cloud data architectures.
View Full Description & ApplyYou'll be redirected to the employer's site
