Senior Data Engineer
New
ConnecticutFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- AWSPythonSQLDynamoDBElasticSearchAirflowSparkData modelingPySpark
Requirements
- 7+ years of experience in data engineering within a production environment
- Proven experience managing large datasets exceeding 100M+ records
- 2+ years of experience with AWS-based scalable, distributed systems
- 5+ years of programming experience in Python
- 5+ years in big data ecosystems with a focus on Spark; PySpark preferred
- 3+ years of experience with SQL and dimensional data modeling
- 2+ years of experience using dataflow orchestration tools like Airflow
- 2+ years working with non-relational databases (DynamoDB, Elasticsearch)
- Bachelor’s degree in Computer Science, Information Systems, Mathematics, or a related field
Responsibilities
- Build infrastructure and data automation pipelines to ingest, process, and load data from various sources.
- Collaborate with stakeholders and data science teams to develop data products aligned with organizational goals.
- Create unit and stress-test components to monitor technical performance.
- Develop data analysis tools to provide insights and capture key metrics.
- Research solutions and maintain technical documentation.
- Follow best practices for data governance, quality, and cleansing.
View Full Description & ApplyYou'll be redirected to the employer's site
