Data Platform Engineer
New
P
PrizePicksDaily Fantasy Sports
While we prefer candidates based in Atlanta, we are open to qualified applicants from anywhere in the U.S. and are willing to consider remote candidates.Full-TimeMiddle
Salary$145,000 to $175,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- AWSDockerPythonGCPKafkaKubernetesGoSparkRESTful APIs
Requirements
- 3+ years of experience in Platform Engineering in high-traffic production environments.
- Proficiency in streaming architectures (Kafka, Flink, PubSub).
- Proficient with Containerization, Docker, Kubernetes and cluster-level management.
- Deep experience building a platform for managing the full Data lifecycle and data exploration.
- Expert in coding with Python and Go.
- Deep experience with Cloud services (GCP preferred, AWS equivalents acceptable).
- Extensive experience with Big data technologies like Spark, Airflow, Polaris, OpenMetadata, Iceberg, Lakehouse, Redis, and Elasticsearch.
- Experience building REST APIs and package management.
- Excellent communication, stakeholder management, and problem-solving skills.
- Proven track record of success through the entire software development lifecycle.
Responsibilities
- Design and build the Data platform for Batch and Streaming use cases.
- Build and maintain a platform with cutting-edge technologies including data catalog and data lineage capabilities.
- Design and enforce robust data security architectures and controls.
- Build platform for deploying low-latency services to pipe data for streaming or near real-time use cases.
- Power real-time decisions including dynamic oddsmaking, risk analysis, and smart deposit defaults.
- Champion best practices for model deployment, monitoring, and CI/CD for Data pipeline deployment.
- Enable complete observability for batch and streaming data platform to ensure 99.99% availability.
View Full Description & ApplyYou'll be redirected to the employer's site