Data Engineer – Mid & Senior Level
New
S
Synthlane Technologies Private LimitedData engineering
Source API remote eligibility restrictions: United StatesFull-Time
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLAirflowSpark
Requirements
- Demonstrate strong proficiency in Python and SQL.
- Have hands-on experience with AWS data services and production data pipelines.
- Have experience with Apache Spark or equivalent distributed data processing technologies.
- Have practical experience with Airflow, Dagster, AWS Step Functions, or similar orchestration tools.
- Understand data pipeline architecture, ETL/ELT, and data transformation.
- Have experience working with Parquet and large-scale datasets.
- Understand data quality, schema management, monitoring, and alerting.
- Apply software engineering practices including Git, code reviews, and automated testing.
- Understand idempotency, error handling, retries, and backfills.
- Have experience supporting and troubleshooting production data pipelines.
- Work effectively with cross-functional engineering and data teams.
Responsibilities
- Build and maintain production-grade data pipelines on AWS.
- Extract, transform, validate, and curate large-scale Parquet datasets.
- Implement data de-identification, masking, and privacy-preserving transformations.
- Design and maintain pipeline orchestration, scheduling, retries, and backfill mechanisms.
- Implement data quality checks, monitoring, and alerting.
- Manage schema evolution and schema drift across data sources and pipelines.
- Provide production support, troubleshoot pipeline issues, and perform root cause analysis.
- Maintain data catalogs, metadata, and data lineage.
View Full Description & ApplyYou'll be redirected to the employer's site
