Senior Data Engineer
New
J
JobgetherData Engineering
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLApache AirflowGCPAzureSparkScalaDatabricksR
Requirements
- Proven experience as a Senior Data Engineer working with Databricks in enterprise environments.
- Databricks certification is required.
- Strong proficiency in SQL across relational database platforms such as SQL Server, PostgreSQL, MySQL, or Oracle.
- Experience with Python, Scala, R, or another programming language used in data engineering.
- Hands-on expertise with Apache Spark and distributed data processing frameworks.
- Solid knowledge of cloud platforms, including Azure, AWS, or Google Cloud Platform.
- Experience implementing CI/CD pipelines, source code versioning, and modern development practices.
- Knowledge of data governance, data quality, and enterprise data architecture standards.
- Experience with data orchestration tools such as Azure Data Factory, Apache Airflow, or similar platforms.
- Strong background in data modeling for BI and analytics solutions.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and orchestration tools.
- Build robust data ingestion, transformation, and processing workflows for large-scale datasets.
- Create and optimize data models to support business intelligence and analytics initiatives.
- Ensure data quality, governance, security, and compliance across the data ecosystem.
- Manage and optimize Databricks environments, including clusters, jobs, workspaces, and related resources.
- Develop cloud-native data solutions across platforms such as Azure, AWS, or Google Cloud.
- Collaborate closely with engineering, analytics, and business teams to deliver reliable and efficient data solutions.
- Contribute to architectural decisions and promote best practices in data engineering and platform management.
View Full Description & ApplyYou'll be redirected to the employer's site
