Data Engineer
New
United StatesFull-TimeMiddle
Salary135,000 - 155,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- SQLApache KafkaData engineeringSparkData modeling
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or equivalent experience.
- 3+ years of experience in data engineering or data integration.
- Strong hands-on experience with Apache Kafka for streaming pipelines.
- Strong experience with Apache Spark for large-scale data processing.
- Advanced SQL development experience including complex queries and performance tuning.
- Experience integrating and managing data across heterogeneous data sources.
- Experience working in federal government or highly regulated environments.
- Solid understanding of data quality management and data governance practices.
- Strong problem-solving, analytical thinking, and collaboration skills.
Responsibilities
- Build and maintain high-volume, scalable data pipelines using Apache Kafka and Apache Spark.
- Design, develop, and optimize data ingestion, transformation, and integration workflows.
- Ensure data quality, consistency, and integrity across disparate data sources through validation and reconciliation.
- Develop and maintain SQL-based data solutions including complex queries, modeling, and performance tuning.
- Collaborate with stakeholders to define requirements and align with business goals.
- Implement monitoring, logging, and alerting for pipeline reliability.
- Support data architecture design and ensure compliance with federal governance and security requirements.
View Full Description & ApplyYou'll be redirected to the employer's site
