Senior Data Platform Engineer
New
100% Remote in NYC time zone, 5/6 hours of overlap with NYC time zoneContractSenior
Salary7,560 - 9,240 USD per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLETLGCPKafkaKubernetesSparkLinux
Requirements
- Experience as Data Platform Engineering or SRE
- Strong software engineering experience and working with Python
- Experience building ETL and stream processing tools and frameworks using Kafka, Spark, Flink, Airflow/Prefect, etc.
- Strong experience working with SQL and databases/engines such as MySQL, PostgreSQL, SQL Server, Snowflake, Redshift, Presto, etc.
- Experience with using AWS/GCP (S3/GCS, EC2/GCE, IAM, etc.), Kubernetes and Linux in production
- Strong proclivity for automation and DevOps practices
- Experience with managing increasing data volume, velocity and variety
- Agile, self-starter and is focused on getting things done
- Strong communicator
Responsibilities
- Build and run data platform using such technologies as public cloud infrastructure (AWS and GCP), Kafka, Spark, databases and containers
- Develop data platform based on open source software and Cloud services
- Build and run ETL tools and frameworks to onboard data into the platform, define schema, build DAG processing pipelines and monitor data quality
- Help develop machine learning development framework and pipelines
- Manage and run mission crucial production services
View Full Description & ApplyYou'll be redirected to the employer's site
