Senior Data Engineer - Digital Marketing

T
TruelogicMarketing analytics
Location: Brazil; Workplace: RemoteFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
5–7 years of hands-on data engineering experience
Required Skills
PythonETLData engineeringDatabricksPySpark

Requirements

  • Have 5–7 years of hands-on data engineering experience building production-grade solutions.
  • Demonstrate strong proficiency in PySpark.
  • Have extensive hands-on experience with Databricks.
  • Bring advanced knowledge of Databricks AutoLoader.
  • Have strong Python skills.
  • Understand end-to-end ETL processes and complex data transformations.
  • Have experience with pipeline optimization and performance tuning.
  • Understand compute cost optimization.
  • Demonstrate problem-solving skills.
  • Communicate technical concepts clearly across technical and business teams.

Responsibilities

  • Design, build, and maintain scalable ETL pipelines for large-scale data processing.
  • Use PySpark and Databricks to execute data transformations and workflows.
  • Tune data pipelines for performance, scalability, and cloud cost efficiency.
  • Partner with engineering and business teams to translate requirements into data solutions.
  • Debug, resolve, and prevent data processing and pipeline bottlenecks.
  • Enforce data quality, governance, and system performance best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now