Data Engineer

Posted 11 days agoViewed

💎 Seniority level: Junior, 2+ years

📍 Location: United Kingdom

🔍 Industry: Software Development

🏢 Company: Ripjar👥 101-250💰 Private 7 months agoArtificial Intelligence (AI)Predictive Analytics Analytics Cyber Security Data Visualization Natural Language Processing Software

🗣️ Languages: English

⏳ Experience: 2+ years

🪄 Skills: Node.jsPythonApache AirflowApache HadoopApache HbaseElasticSearchMongoDBData engineeringLinuxAnsibleData modelingScriptingSoftware Engineering

Requirements:

Fluent in at least one programming language
2 years experience working with moderately complex software systems in production
Using python (specifically pyspark) and Node.js for processing data
Using Hadoop stack technologies such as HDFS and HBase
Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial
Experience using Airflow & Nifi to co-ordinate the processing of data would be beneficial
Using Ansible to manage configuration and deployments

Responsibilities:

Contributing production quality code and unit-tests to our Data Collection Hub
Contributing improvements to the test and build pipelines
Considering the impact and implications of changes and communicating these clearly
Helping to support the data processing pipelines as needed
Modelling data in the best way for specific business needs
Staying abreast of the latest developments in Data Engineering to contribute to Ripjar’s best practices
Adding to Ripjar’s culture and make it a fun and rewarding place to work!

Apply