Mid-Level Data Engineer
C
Crisis Text LineData Engineering
Remote position within the United StatesFull-TimeMiddle
Salary99,704 - 116,990 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- Approximately three to five years
- Required Skills
- AWSPythonSQLETLSparkDatabricksPySpark
Requirements
- Approximately three to five years of professional data engineering, software engineering, or related experience, including meaningful responsibility for production data pipelines.
- Professional experience using SQL and Python to build, transform, and troubleshoot data.
- Experience building, maintaining, and supporting production data pipelines or ETL/ELT workflows.
- Experience with distributed data processing technologies such as Spark or PySpark.
- Familiarity with cloud-based environments such as AWS and modern data engineering practices.
- Experience testing, debugging, monitoring, and improving the reliability and performance of production data systems.
- The ability to independently complete well-defined engineering work, investigate problems, and clearly communicate technical decisions, risks, and tradeoffs.
- A collaborative approach to working with engineers, data scientists, and cross-functional partners.
- Must have a stable high-speed internet connection.
Responsibilities
- Design, build, maintain, and improve reliable production data pipelines as part of our broader data and engineering environment.
- Develop and optimize data processing workflows using SQL, Python, Spark/PySpark, and Databricks.
- Partner with engineers, data scientists, and business teams to understand data needs and translate them into practical, maintainable solutions.
- Build and maintain integrations between data sources and our data infrastructure.
- Use Infrastructure as Code practices to support and improve our AWS data environment.
- Monitor pipeline health, data quality, and performance; troubleshoot issues and contribute to solutions when something isn’t working as expected.
- Automate repeatable processes that improve the reliability, efficiency, and maintainability of our data pipelines.
- Participate in shared production support and develop confidence diagnosing and resolving pipeline issues independently.
View Full Description & ApplyYou'll be redirected to the employer's site
