Why is remote work so nice? Let's try to see!
Apply
Senior Software Engineer, Data Integration Platform (Python)
Posted 22 days agoViewed
💎 Seniority level: Senior, 5+ years
🔍 Industry: Software Development
🏢 Company: Northbeam👥 11-50💰 $15,000,000 Series A over 2 years agoMachine LearningInformation Technology
🗣️ Languages: English
⏳ Experience: 5+ years
Requirements:
- 5+ years of experience in data engineering, software engineering, or integration engineering, with a focus on ETL, APIs, and data pipeline orchestration.
- Strong proficiency in Python
- Experience with API-based ETL, handling REST, GraphQL, Webhooks
- Experience implementing authentication flows
- Proficiency in SQL and BigQuery
- Experience with orchestration frameworks (e.g., Airflow) to manage and monitor complex data workflows.
- Familiarity with containerization (Docker, Kubernetes) to deploy and scale workloads.
- Ability to drive rapid development while ensuring maintainability, balancing short-term delivery needs with long-term platform stability.
Responsibilities:
- Design and implement scalable, high-performance data pipelines to ingest and transform data from a variety of sources, ensuring reliability, observability, and maintainability.
- Build and maintain APIs that enable flexible, secure, and tenant-aware data integrations with external systems.
- Work with event-driven and batch processing architectures, ensuring data freshness and consistency at scale.
- Drive clean API design and integration patterns that support both real-time and batch ingestion while handling diverse authentication mechanisms (OAuth, API keys, etc.).
- Implement observability, monitoring, and alerting to track data freshness, failures, and performance issues, ensuring transparency and reliability.
- Optimize data flows and transformations, balancing cost, efficiency, and rapid development cycles in a cloud-native environment.
- Collaborate with data engineering, infrastructure, and product teams to create an integration platform that is flexible, extensible, and easy to onboard new sources.
Related Articles
Posted 7 months ago
Insights into the evolving landscape of remote work in 2024 reveal the importance of certifications and continuous learning. This article breaks down emerging trends, sought-after certifications, and provides practical solutions for enhancing your employability and expertise. What skills will be essential for remote job seekers, and how can you navigate this dynamic market to secure your dream role?
Posted 8 months ago
Explore the challenges and strategies of maintaining work-life balance while working remotely. Learn about unique aspects of remote work, associated challenges, historical context, and effective strategies to separate work and personal life.
Posted 8 months ago
Google is gearing up to expand its remote job listings, promising more opportunities across various departments and regions. Find out how this move can benefit job seekers and impact the market.
Posted 8 months ago
Learn about the importance of pre-onboarding preparation for remote employees, including checklist creation, documentation, tools and equipment setup, communication plans, and feedback strategies. Discover how proactive pre-onboarding can enhance job performance, increase retention rates, and foster a sense of belonging from day one.