Data Platform Engineer
New
P
PrizePicksDaily Fantasy Sports
While we prefer candidates based in Atlanta, we are open to qualified applicants from anywhere in the U.S. and are willing to consider remote candidates.Full-TimeMiddle
Salary$145,000 to $175,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- DockerPythonGCPKafkaKubernetesAirflowGoSparkBigQuery
Requirements
- 3+ years of experience in Platform Engineering with a track record of maintaining scalable data platforms in high-traffic production environments.
- Proficient in streaming architectures including Kafka, Flink, or PubSub.
- Experience building low-latency services for stream ingestion and processing.
- Proficient with containerization, Docker, Kubernetes, and cluster-level management.
- Deep experience managing the full data lifecycle, including data exploration environments.
- Expert in coding with Python and Go.
- Deep experience with cloud services, specifically GCP (BigQuery, Cloud Functions, GKE) or AWS equivalents.
- Extensive experience with big data technologies such as Spark, Airflow, Polaris, OpenMetadata, Iceberg, Lakehouse, Redis, and Elasticsearch.
- Proven ability to build REST APIs, manage packages, and build libraries.
- Experience managing the full development lifecycle from concept to release.
- Excellent communication, stakeholder management, and problem-solving skills.
Responsibilities
- Design and build the data platform to support both batch and streaming use cases.
- Implement data catalog and data lineage capabilities to enable data users.
- Develop and enforce robust data security architectures and controls.
- Build platforms for deploying low-latency services for streaming or near real-time data ingestion and processing.
- Champion best practices for model deployment, monitoring, and CI/CD for data pipeline management.
- Ensure 99.99% availability for the batch and streaming data platform.
View Full Description & ApplyYou'll be redirected to the employer's site
