Data Engineer (Salesforce Focus)
I
In All MediaData engineering
Location: Colombia / Costa Rica / Argentina / Peru / Nicaragua, US Central Time (CT); full-time business-hour alignment with US Central TimeContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 6+ years of hands-on data engineering experience
- Required Skills
- PythonSQLApache AirflowSalesforceSnowflakeApache KafkaSparkPySpark
Requirements
- Have 6+ years of hands-on data engineering experience designing, deploying, and maintaining distributed production data pipelines on petabyte-scale datasets.
- Demonstrate high proficiency in Python for pipeline scripting and data manipulation.
- Use advanced SQL, including complex CTEs, window functions, schema design, and query optimization.
- Have production expertise with Apache Spark/PySpark for batch and streaming transformations.
- Have hands-on experience authoring and maintaining complex Apache Airflow DAGs.
- Have experience configuring cross-regional event pipelines with Apache Kafka.
- Have direct experience managing AWS S3 data lakes using Apache Iceberg and Parquet.
- Have hands-on experience with Snowflake schema modeling, warehouse configuration, and query tuning.
- Be able to operate within an enterprise AWS WorkSpace (VDI) environment and complete the mandatory AWS network health-check verification.
- Align full-time business hours with US Central Time (CT).
- Conduct interviews, technical documentation, architectural reviews, team syncs, and operational communications in English.
Responsibilities
- Migrate mission-critical datasets, legacy data workflows, and orchestrated DAGs to modernized cloud infrastructure.
- Convert legacy Hive table architectures to Apache Iceberg on AWS S3.
- Reconfigure, validate, and manage Apache Kafka connections, brokers, and topics across multiple AWS regions.
- Adapt, model, and tune data pipelines in Snowflake using advanced SQL techniques.
- Author, schedule, and debug Apache Airflow DAGs, resolving upstream failures and optimizing sensor dependencies.
- Define and execute data reconciliation and validation strategies to maintain data integrity across migrations.
- Diagnose and resolve performance issues across Spark/PySpark jobs, Kafka consumer groups, and AWS storage layers.
View Full Description & ApplyYou'll be redirected to the employer's site
