Senior Data Engineer
New
O
OnHiresMarket Intelligence
LATAMContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English
- Experience
- 4+ years
- Required Skills
- PythonSQLETLSparkData modelingPySpark
Requirements
- 4+ years of hands-on Data Engineering experience with production data systems.
- Strong Python skills.
- Hands-on experience with PySpark / Apache Spark and distributed data processing.
- Strong experience building and maintaining ETL/ELT and data ingestion pipelines.
- Experience working with large, complex datasets and multiple data sources.
- Strong SQL and data modeling skills.
- Experience with modern data platforms, data lakes, lakehouse, or similar architectures.
- Strong understanding of data quality, validation, monitoring, and data reliability.
- Ability to independently design solutions, troubleshoot production problems, and take ownership of delivery.
- Fluent English.
Responsibilities
- Design, build, and maintain scalable production data pipelines.
- Ingest, process, and transform large volumes of data from multiple sources.
- Develop solutions for data standardization, normalization, matching, and validation.
- Build data quality controls and monitoring to identify malformed, inconsistent, or incorrect data.
- Design reliable approaches to data corrections, updates, reprocessing, and backfills.
- Improve the architecture, scalability, reliability, and performance of the data platform.
- Take end-to-end ownership of technical solutions and production quality.
- Work closely with a small engineering team while independently driving your area of responsibility.
- Use AI-assisted engineering tools and practices to improve development efficiency.
View Full Description & ApplyYou'll be redirected to the employer's site
