Senior Data Engineer

New

Remote –Jalisco,MEXFull-TimeSenior

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Bachelor's degree in Computer Science, Data Engineering, or a related field (Master's degree preferred).
Minimum 5+ years of experience in data engineering or full-stack development, with a focus on cloud-based environments.
Advanced expertise in managing big data technologies (Python, SQL, PySpark, Spark).
Strong Databricks experience.
Advanced database/backend testing with the ability to write complex SQL queries for data validation and integrity.
Strong experience in designing and implementing data pipelines, ETL processes, and workflow automation.
Experience with data warehousing concepts, dimensional modeling, and cloud-based data warehousing platforms (e.g., Google BigQuery, Snowflake).
Experience with cloud platforms such as Microsoft Azure, or Google Cloud Platform (GCP).
Experience working in DevOps model.
Proficiency in object-oriented programming and software design patterns.
Familiarity with cutting-edge AI technologies.

Design and implement robust, scalable data pipelines using Databricks, Apache Spark, and Delta Lake as well as BigQuery.
Design and implement efficient data pipeline frameworks, ensuring the smooth flow of data from various sources to data lakes, data warehouses, and analytical platforms.
Troubleshoot and resolve issues related to data processing, data quality, and data pipeline performance.
Document data infrastructure, data pipelines, and ETL processes, ensuring knowledge transfer and smooth handovers.
Create automated tests and integrate them into testing frameworks.
Configure and optimize Databricks workspaces, clusters, and job scheduling.
Implement security best practices including access controls, encryption, and audit logging.
Collaborate with data scientists, analysts, and other stakeholders to deliver data solutions that meet their needs.

View Full Description & ApplyYou'll be redirected to the employer's site