Senior Data Engineer
New
N
Node.DigitalFederal Data Engineering
Washington, District of Columbia, United States; Herndon, VA (Remote Work)Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5 years
- Required Skills
- PythonSQLPandasCI/CD
Requirements
- Bachelor's degree in a technical field or 5 years of equivalent applied experience.
- 5 years of experience maintaining SQL databases and conducting advanced T-SQL operations.
- 5 years of experience designing and maintaining ELT/ETL processes in cloud data environments.
- 3 years of experience working in Azure Synapse and Azure Machine Learning.
- 3 years of experience manipulating data in Python, specifically Pandas.
- Strong proficiency in SQL, T-SQL, Python, and modern data stack tools.
- Experience with Azure SDK V1 and V2, source control, and CI/CD workflows.
- Demonstrated ability to perform entity resolution and attribute normalization.
- Ability to obtain and maintain a Public Trust Clearance.
Responsibilities
- Design, implement, and maintain data architecture and ELT/ETL pipelines in Azure Synapse and Azure Machine Learning.
- Migrate source data to Azure Data Lake Storage and normalize entity attributes.
- Establish quality controls, error handling, logging, and validation across all pipelines.
- Integrate source control into analytics codebases to ensure iterative development and architecture stability.
- Develop self-service capabilities for analysts to query and export data.
- Produce comprehensive documentation including data dictionaries and entity relationship diagrams.
- Optimize data ingestion and processing, utilizing columnar formats like Parquet.
View Full Description & ApplyYou'll be redirected to the employer's site
