Software Engineer, Data Systems (Python)
N
NorthbeamMarketing Intelligence
Remote - CanadaFull-TimeMiddle
Salary$140,000 — $155,000 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- DockerPythonSQLETLAirflowRESTful APIs
Requirements
- 3+ years of experience in data engineering, software engineering, or integration engineering, with exposure to ETL, APIs, or data pipeline work.
- Solid working proficiency in Python.
- Experience building against REST APIs; familiarity with GraphQL or webhooks is a plus.
- Comfort with SQL and some exposure to a cloud data warehouse (BigQuery, Snowflake, Redshift, or similar).
- Some exposure to orchestration frameworks such as Airflow, Dagster, or Prefect.
- Willingness to work in a containerized environment (Docker).
- A track record of shipping steadily and asking good questions when the path isn't obvious.
Responsibilities
- Build and maintain data pipelines that ingest and transform data from a variety of sources, with an eye toward reliability and maintainability.
- Develop and support APIs that enable secure, tenant-aware data integrations with external systems.
- Work within event-driven and batch processing architectures to keep data fresh and consistent.
- Contribute to API design and integration patterns that support both real-time and batch ingestion across different authentication mechanisms (OAuth, API keys, etc.).
- Add monitoring and alerting that surfaces data freshness issues, failures, and performance problems before customers notice them.
- Improve existing data flows and transformations, weighing cost, efficiency, and speed of delivery in a cloud-native environment.
- Partner with data engineering, infrastructure, and product teams to make our integration platform easier to extend and onboard new sources into.
View Full Description & ApplyYou'll be redirected to the employer's site