Data Engineer
New
J
JUMOFinTech
Portugal; South Africa, UTC 0 and UTC +3Full-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSDockerPostgreSQLPythonSQLDynamoDBHadoopKafkaKotlinKubernetesMicrosoft SQL ServerMySQLAirflowSparkLinuxRedshift
Requirements
- BSc. in Computer Science, Electrical Engineering or equivalent tertiary degree
- Real-world understanding & experience of data pipeline design and development
- Experience in designing systems to process and curate large data sets
- Experience in streaming technologies (Spark, Kafka)
- Experience with cloud technologies (AWS preferred)
- Solid, proven experience working with big-data technologies (Apache Spark, Flink, Hadoop, Kafka, Kinesis, DynamoDB)
- Command of productionising and monitoring of data pipeline workflows
- Working knowledge of the Data Product Lifecycle
- Experience in application design and development with Python (preferred) or Kotlin
- RDBMS experience (MySQL, PostgreSQL, Redshift, SQL Server)
- Experience with relational database administration, technical architectures and infrastructure components
- Understanding of CI/CD practices
- Productive within a Linux command line environment
- Proven ability to contribute software as part of a team
- Ability to effectively communicate technical concepts
- Ability to apply critical thinking under pressure
Responsibilities
- Design, build and maintain scalable data architectures
- Monitor performance of data architectures, perform root cause analysis and provide solutions to issues
- Work with large, complex data sets
- Create robust, mission critical batch and streaming data processing capabilities
- Design, implement, and maintain the data pipelines that constitute JUMO's data platform
- Provide feedback on team members' output, encouraging skills development within the team
- Work closely with Portfolio Managers and Decision Scientists to understand real world problems
- Mentor juniors with technical leadership
View Full Description & ApplyYou'll be redirected to the employer's site