Senior Data Engineer (Research)
New
X
XTBFinancial Technology
Remote work, from the office in Warsaw or from a coworking space in your city.Full-TimeSenior
Salary17,500 - 22,100 PLN per month
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 4 years
- Required Skills
- PythonSQLETLgRPCSparkCI/CDRESTful APIsData modelingPySpark
Requirements
- At least 4 years of experience as a Data Engineer or in a related software engineering role.
- Proficiency in Python and the ability to write clean, testable production code.
- Hands-on experience with Apache Spark.
- Advanced SQL skills (query optimization on large datasets).
- Strong understanding of data warehouse design principles and data modeling.
- Practical knowledge of ETL/ELT processes.
- Familiarity with data quality, monitoring, and pipeline reliability.
- Experience working with relational databases, including an understanding of how they work, data modeling, and optimization.
- Understanding of REST and gRPC standards for system integration.
- Experience with workflow orchestration tools (e.g., Airflow, Dagster, or similar).
- Knowledge of CI/CD pipeline building and maintenance principles.
Responsibilities
- Designing, building, and maintaining scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark.
- Working with raw data and designing methods for its integration into the data platform.
- Developing CI/CD pipelines for data engineering solutions.
- Creating and maintaining Infrastructure as Code solutions.
- Integrating the data platform with other systems and applications.
- Participating in architectural decision-making and defining engineering standards.
- Conducting code reviews, documenting solutions, and sharing knowledge with team members.
View Full Description & ApplyYou'll be redirected to the employer's site
