Why is remote work so nice? Let's try to see!
Apply
Semi-Senior Data Engineer (PySpark) - E-Learning
Posted 4 days agoViewed
💎 Seniority level: Senior, 3-5 years
🔍 Industry: E-Learning
🏢 Company: Truelogic👥 101-250ConsultingWeb DevelopmentWeb DesignSoftware
⏳ Experience: 3-5 years
Requirements:
- 3-5 years of experience working with PySpark and Apache Spark in Big Data environments.
- Experience with SQL and relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, etc.).
- Knowledge of ETL processes and data processing in distributed environments.
- Familiarity with Apache Hadoop, Hive, or Delta Lake.
- Experience with cloud storage (AWS S3, Google Cloud Storage, Azure Blob).
- Proficiency in Git and version control.
- Strong problem-solving skills and a proactive attitude.
- A passion for learning and continuous improvement.
Responsibilities:
- Design, develop, and optimize data pipelines using PySpark and Apache Spark.
- Integrate and process data from multiple sources (databases, APIs, files, streaming).
- Implement efficient data transformations for Big Data in distributed environments.
- Optimize code to improve performance, scalability, and efficiency in data processing.
- Collaborate with Data Science, BI, and DevOps teams to ensure seamless integration.
- Monitor and debug data processes to ensure quality and reliability.
- Apply best practices in data engineering and maintain clear documentation.
- Stay up to date with the latest trends in Big Data and distributed computing.
Related Articles
Posted 7 months ago
Insights into the evolving landscape of remote work in 2024 reveal the importance of certifications and continuous learning. This article breaks down emerging trends, sought-after certifications, and provides practical solutions for enhancing your employability and expertise. What skills will be essential for remote job seekers, and how can you navigate this dynamic market to secure your dream role?
Posted 8 months ago
Explore the challenges and strategies of maintaining work-life balance while working remotely. Learn about unique aspects of remote work, associated challenges, historical context, and effective strategies to separate work and personal life.
Posted 8 months ago
Google is gearing up to expand its remote job listings, promising more opportunities across various departments and regions. Find out how this move can benefit job seekers and impact the market.
Posted 8 months ago
Learn about the importance of pre-onboarding preparation for remote employees, including checklist creation, documentation, tools and equipment setup, communication plans, and feedback strategies. Discover how proactive pre-onboarding can enhance job performance, increase retention rates, and foster a sense of belonging from day one.