Senior Software Engineer, Data Systems
New
N
NorthbeamMarketing Intelligence
Remote - CanadaFull-TimeSenior
Salary170,000 - 200,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- DockerGraphQLPythonSQLETLKubernetesAirflowRESTful APIsBigQuery
Requirements
- 5+ years of experience in data engineering, software engineering, or integration engineering.
- Strong proficiency in Python.
- Experience with API-based ETL, handling REST, GraphQL, and Webhooks.
- Experience implementing authentication flows (OAuth, API keys).
- Proficiency in SQL and BigQuery.
- Experience with orchestration frameworks (e.g., Airflow).
- Familiarity with containerization (Docker, Kubernetes).
- Ability to drive rapid development while ensuring maintainability.
Responsibilities
- Design and implement scalable, high-performance data pipelines to ingest and transform data from a variety of sources, ensuring reliability, observability, and maintainability.
- Build and maintain APIs that enable flexible, secure, and tenant-aware data integrations with external systems.
- Work with event-driven and batch processing architectures, ensuring data freshness and consistency at scale.
- Drive clean API design and integration patterns that support both real-time and batch ingestion while handling diverse authentication mechanisms.
- Implement observability, monitoring, and alerting to track data freshness, failures, and performance issues.
- Optimize data flows and transformations, balancing cost, efficiency, and rapid development cycles in a cloud-native environment.
- Collaborate with data engineering, infrastructure, and product teams to create a flexible and extensible integration platform.
View Full Description & ApplyYou'll be redirected to the employer's site
