Senior Data Developer
New
C
CI&TData engineering
Listing location: Brazil; Workplace type: RemoteFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLAzureSparkData modelingPySpark
Requirements
- Have solid data engineering experience and experience building pipelines in the Azure ecosystem.
- Have advanced SQL skills for data manipulation, transformation, and analysis.
- Have experience with Python and/or PySpark for ingestion and transformation scripts.
- Have experience with Azure Databricks, including Spark, PySpark, and Spark SQL.
- Have experience with Azure Data Factory (ADF) for pipeline orchestration and automation.
- Have experience with KPIs and indicators in the financial or banking sector.
- Have experience with layered architecture (Bronze, Silver, Gold / Medallion) and Delta Lake.
- Know analytics data modeling, including Star Schema, OBT, and fact and dimension tables.
- Be familiar with Data Lakehouse environments and MERGE/UPSERT operations.
- Have experience with data quality and governance.
Responsibilities
- Develop scripts and pipelines to load data into the Gold layer, ensuring the quality, consistency, and traceability of consolidated information.
- Structure tables with platform performance, usage, and availability indicators.
- Create analytical models optimized for use by business and management teams.
- Maintain quality, versioning, and documentation standards for pipelines and data models.
- Work with product, operations, and management teams to translate business needs into data engineering solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
