Software Engineer II (Python and Data pipelines) - (Remote - US or Canada)

4+ years of experience in backend software engineering, with hands-on experience in developing data pipelines. Proficient in one or more programming languages such as Ruby, Python, or similar. Experience working with public cloud providers (AWS, Azure, or Google Cloud). Hands-on experience with AWS services such as ECS, EKS, or AWS Lambdas. Familiarity with queueing and streaming technologies like SQS, Kafka, or Kinesis. Experience with large-scale systems, external APIs, and data transformations. Strong skills in testing, optimizing, and scaling systems for performance and reliability. Bachelor’s degree in Computer Science or equivalent professional experience.

Design and develop data pipelines to extract, enrich, and process vast amounts of metadata from diverse content types. Collaborate with machine learning engineers, product managers, and other teams to create efficient and scalable metadata solutions. Optimize and refactor existing systems for improved performance, scalability, and reliability. Ensure data quality and accuracy by implementing automated validation and monitoring processes. Participate in code reviews and maintain high standards for quality and best practices. Manage and maintain the infrastructure for data pipelines, ensuring security and operational efficiency.