Data Engineer
New
D
DynatronAutomotive Data Intelligence
India based - remote, 9:00 AM – 2:00 PM EST (8:00 AM – 1:00 PM CST, 7:00 AM – 12:00 PM MST, 6:00 AM – 11:00 AM PST)Full-TimeSenior
Salary₹5750k per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPythonSQLETLSnowflakeApache KafkaData engineeringDatabricksPySpark
Requirements
- 5+ years of experience in data engineering with a focus on large-scale distributed systems.
- Expert-level Python and PySpark proficiency.
- Strong SQL skills.
- Deep hands-on experience with Snowflake or Databricks built natively within an AWS ecosystem.
- Proven track record building streaming applications using Kinesis or Kafka.
- Demonstrated experience implementing automated testing frameworks, data profiling, and pipeline validation.
- Strong documentation habits and technical writing skills.
- Ownership mindset with the ability to solve complex problems independently.
- Strong communication skills for interacting with technical and non-technical stakeholders.
Responsibilities
- Build and maintain complex data pipelines using AWS Glue, Step Functions, or Databricks Workflows.
- Manage scalable data storage using AWS S3, optimizing storage formats like Delta, Iceberg, and Parquet.
- Develop real-time ingestion pipelines using AWS Kinesis or Kafka, including CDC implementation.
- Own end-to-end data validation and QA by building automated checks into ETL/ELT pipelines.
- Engineer ML-ready datasets and manage feature stores to support data science initiatives.
- Collaborate with Product and ML teams to translate designs into functional code while adhering to best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
