Senior Data Engineer (Python/SQL)
New
T
TruelogicMobility-as-a-service
LatAmFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience in Data Engineering, building and maintaining data infrastructure and pipelines.
- Required Skills
- PythonSQLETLHadoopJavaAirflowGoSparkDocumentationScalaData modeling
Requirements
- 5+ years of experience in Data Engineering, building and maintaining data infrastructure and pipelines.
- Strong expertise in SQL, including joins, aggregations, unions, and window functions.
- Hands-on experience with data modeling and schema design for analytical systems.
- Experience building ETL pipelines using Airflow or similar orchestration tools.
- Experience with Big Data ecosystems, including Hadoop, Hive, Spark, or related technologies.
- Programming experience in Python, Java, Scala, or Go.
- Familiarity with UNIX/Linux environments and shell scripting.
- Understanding of software engineering best practices, including testing, monitoring, and documentation.
- Strong collaboration and communication skills when working with analysts and cross-functional stakeholders.
- Ability to troubleshoot and resolve data issues across pipelines and BI tools.
Responsibilities
- Design, build, and maintain scalable data infrastructure to support analytics and reporting across the organization.
- Develop and operate ETL pipelines to ingest, transform, and deliver large-scale datasets.
- Work with distributed data processing frameworks such as Spark, Hive, or similar MPP architectures.
- Use SQL and data modeling techniques to structure and optimize datasets for analytics use cases.
- Process and analyze large volumes of structured and semi-structured data using tools such as Spark and Presto.
- Write production-quality code using Python, Java, Scala, or Go.
- Ensure data reliability and availability, operating and monitoring hundreds of ETL pipelines with strict SLAs.
- Investigate and resolve complex data issues, including root-cause analysis of pipeline failures or data inconsistencies.
- Partner closely with Data Analysts and cross-functional stakeholders to provide reliable datasets and guide them in using data effectively.
- Troubleshoot data issues in dashboarding tools (e.g., Tableau, Power BI, MicroStrategy) and propose solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
