Senior Data Engineer
New
R
RacknerSoftware Consultancy
RemoteFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- SQLETLSparkCI/CDPySpark
Requirements
- Significant experience designing and implementing enterprise data pipelines and ETL/ELT processes
- Hands-on experience with Microsoft Fabric
- Experience administering or configuring enterprise cloud data environments
- Strong experience with Azure Data Factory or comparable data integration technologies
- Strong SQL proficiency
- Experience with Spark and PySpark for large-scale data processing
- Experience developing CI/CD pipelines and infrastructure-as-code
- Understanding of cloud security principles like RBAC and encryption
- Experience supporting production data environments
- Active Secret clearance
Responsibilities
- Lead the design, development, and optimization of enterprise data ingestion pipelines, transformation logic, and data platform components within Microsoft Fabric
- Configure, administer, and maintain Microsoft Fabric environments including capacity, security, and governance
- Implement and maintain Bronze, Silver, and Gold medallion architecture layers
- Build and maintain CI/CD deployment pipelines and infrastructure-as-code for platform deployments
- Troubleshoot complex pipeline, platform, performance, and data-quality issues
- Establish reusable engineering patterns, standards, and technical documentation
- Mentor mid-level and Associate Data Engineers
View Full Description & ApplyYou'll be redirected to the employer's site