Data Platform Engineer

New
P
PrizePicksDaily Fantasy Sports
While we prefer candidates based in Atlanta, we are open to qualified applicants from anywhere in the U.S. and are willing to consider remote candidates.Full-TimeMiddle
Salary$145,000 to $175,000
Apply NowOpens the employer's application page

Job Details

Experience
3+ years
Required Skills
AWSDockerPythonGCPKafkaKubernetesGoSparkRESTful APIs

Requirements

  • 3+ years of experience in Platform Engineering in high-traffic production environments.
  • Proficiency in streaming architectures (Kafka, Flink, PubSub).
  • Proficient with Containerization, Docker, Kubernetes and cluster-level management.
  • Deep experience building a platform for managing the full Data lifecycle and data exploration.
  • Expert in coding with Python and Go.
  • Deep experience with Cloud services (GCP preferred, AWS equivalents acceptable).
  • Extensive experience with Big data technologies like Spark, Airflow, Polaris, OpenMetadata, Iceberg, Lakehouse, Redis, and Elasticsearch.
  • Experience building REST APIs and package management.
  • Excellent communication, stakeholder management, and problem-solving skills.
  • Proven track record of success through the entire software development lifecycle.

Responsibilities

  • Design and build the Data platform for Batch and Streaming use cases.
  • Build and maintain a platform with cutting-edge technologies including data catalog and data lineage capabilities.
  • Design and enforce robust data security architectures and controls.
  • Build platform for deploying low-latency services to pipe data for streaming or near real-time use cases.
  • Power real-time decisions including dynamic oddsmaking, risk analysis, and smart deposit defaults.
  • Champion best practices for model deployment, monitoring, and CI/CD for Data pipeline deployment.
  • Enable complete observability for batch and streaming data platform to ensure 99.99% availability.
View Full Description & ApplyYou'll be redirected to the employer's site
$145,000 to $175,000
Apply Now