Senior Data Developer
New
J
JobgetherData Engineering
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English and Portuguese
- Required Skills
- PythonSQLMicrosoft AzureData engineeringSparkScalaDatabricks
Requirements
- Solid professional experience in Data Engineering, particularly in the design and development of data pipelines.
- Hands-on experience with Databricks and Apache Spark.
- Strong SQL knowledge and experience working with large datasets.
- Proficiency in Python or Scala for data engineering applications.
- Professional experience with Microsoft Azure and cloud-based data solutions.
- Strong analytical and problem-solving abilities, including experience troubleshooting complex data-related issues.
- Excellent communication skills in both English and Portuguese.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Responsibilities
- Design, develop, and maintain robust and scalable data pipelines using Databricks, Apache Spark, SQL, and Python or Scala.
- Build and optimize solutions capable of processing and transforming large volumes of data efficiently.
- Monitor existing data pipelines and workflows, identifying opportunities to improve performance, scalability, throughput, and reliability.
- Work closely with data scientists, analysts, engineers, and business stakeholders to understand data requirements and translate them into effective technical solutions.
- Implement data quality controls and governance practices to maintain accurate, consistent, and compliant data.
- Investigate complex data and pipeline incidents, identify root causes, and implement sustainable solutions.
- Create and maintain clear technical documentation and contribute to engineering standards, best practices, and continuous improvement initiatives.
View Full Description & ApplyYou'll be redirected to the employer's site
