Senior Data Engineer

New

CI&TData engineering

Listing location: Brazil; Workplace type: Remote; Structured job location: BrazilFull-TimeSenior

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Required Skills: SQLMicrosoft Power BIMicrosoft SQL ServerAzureSparkDatabricks

Have solid experience in the Azure Cloud data ecosystem, with focus on ADF, Synapse, Databricks/Spark, and ADLS.
Have experience developing reports with Reporting Services and dashboards with Power BI.
Design, build, and test ETL/ELT data pipelines, ensuring performance and reliability.
Be comfortable learning and integrating new frameworks and cloud-native technologies.
Be able to share knowledge with more junior team members.
Have knowledge of the Microsoft SQL Server technology stack.
Have robust experience in dimensional modeling and strong SQL domain knowledge for building data marts and data warehouses.
Contribute to technical references, help define data standards, and participate in code reviews.
Apply software engineering principles, including advanced Git use with branches and pull requests, and implement or maintain CI/CD for data solutions.
Nice to have: knowledge of unit, integration, and end-to-end testing.
Nice to have: an Azure or AWS cloud certification.
Nice to have: knowledge of data catalog and lineage processes and tools, such as Azure Purview.
Nice to have: Python or Scala scripting and data process automation experience.
Nice to have: experience with orchestration tools such as Airflow.

Define, build, and deliver high-quality data pipelines in Azure and, when necessary, on-premises platforms.
Monitor and maintain existing data pipelines, troubleshoot failures, handle complex incident and problem tickets, and fix bugs.
Propose and implement architectural and code improvements.
Participate in data validation.
Ensure systems meet business and non-functional requirements, including performance, security, privacy, GDPR, and LGPD.
Integrate data management and software engineering technologies into existing data structures.
Analyze, ingest, and transform raw data and make it available in data lakes and data marts.
Collaborate with BI, Data Science, and Software Engineering teams to document and deliver consistent data solutions.

View Full Description & ApplyYou'll be redirected to the employer's site