Data Management Specialist - Data Engineer
New
J
JobgetherData engineering
Based in the United StatesFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 5 years of experience supporting federal government clients in the implementation and management of enterprise data management practices.
- Required Skills
- PythonSQLSparkData modelingDatabricks
Requirements
- Hold a bachelor's degree from an accredited college or university; a scientific or technical discipline is preferred.
- Have at least 5 years of experience supporting federal government clients in enterprise data management practices.
- Demonstrate experience with Python programming and data engineering solutions.
- Have experience with enterprise data platforms and tools, including Databricks, Databricks SQL Editor, and Erwin Data Modeler.
- Have current knowledge of Collibra Data Governance Center functionalities, including data cataloging, metadata management, and governance.
- Understand data modeling, pipeline development, ETL/ELT, data integration, and data quality management.
- Have experience with structured and unstructured datasets, normalization, deduplication, metadata reconciliation, and validation.
- Familiarity with distributed computing frameworks, particularly Apache Spark, is advantageous.
- Understanding of the Department of Defense Procurement Lifecycle, including Procure-to-Pay, is beneficial.
- Use Microsoft 365 effectively and demonstrate communication, writing, analytical, organizational, and time-management skills.
- Hold an active SECRET security clearance; an Interim SECRET clearance is also acceptable.
Responsibilities
- Design, build, optimize, and maintain scalable data pipelines and ETL/ELT processes.
- Develop data models for operational and analytical environments.
- Implement data ingestion, transformation, storage, and retrieval practices across environments.
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and deliver data solutions.
- Establish data quality, consistency, and governance through monitoring, testing, validation, and improvement.
- Develop and optimize SQL queries, stored procedures, and scripts.
- Integrate structured and unstructured data from databases, APIs, streaming platforms, and third-party feeds.
- Optimize large-scale processing using distributed computing technologies such as Apache Spark.
- Normalize data, build indexes, implement deduplication, investigate discrepancies, and reconcile metadata.
- Manage data cataloging, metadata, and business rules using platforms such as Collibra.
View Full Description & ApplyYou'll be redirected to the employer's site