Apply

Data Engineer: Data Infrastructure (Remote)

Posted 5 days agoViewed

View full description

πŸ’Ž Seniority level: Senior, 4+ years

πŸ“ Location: Portugal

πŸ’Έ Salary: 90000.0 - 110000.0 USD per year

πŸ” Industry: Software Development

🏒 Company: Constructor

⏳ Experience: 4+ years

πŸͺ„ Skills: AWSPythonSQLCloud ComputingETLGitKubernetesClickhouseData engineeringSparkCI/CDData visualizationData modelingData management

Requirements:
  • Solid skills in any programming language (ideally Python)
  • Big data engineering
  • Web services
  • Cloud providers (ideally AWS)
Responsibilities:
  • Implement a data model for our tables (bronze, silver, gold) to incapsulate parsing logic, lower the costs and provide better abstractions
  • Power our recommendation system with a fast, global data store.
  • Improve the build system in our repositories to speed up test execution, job deployment and thus improving the developers productivity
  • Optimize Spark pipelines, ClickHouse tables/queries, and streaming processing in AWS Lambda.
Apply