Data Management Specialist - Data Engineer

New
J
JobgetherData engineering
Based in the United StatesFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
At least 5 years of experience supporting federal government clients in the implementation and management of enterprise data management practices.
Required Skills
PythonSQLSparkData modelingDatabricks

Requirements

  • Hold a bachelor's degree from an accredited college or university; a scientific or technical discipline is preferred.
  • Have at least 5 years of experience supporting federal government clients in enterprise data management practices.
  • Demonstrate experience with Python programming and data engineering solutions.
  • Have experience with enterprise data platforms and tools, including Databricks, Databricks SQL Editor, and Erwin Data Modeler.
  • Have current knowledge of Collibra Data Governance Center functionalities, including data cataloging, metadata management, and governance.
  • Understand data modeling, pipeline development, ETL/ELT, data integration, and data quality management.
  • Have experience with structured and unstructured datasets, normalization, deduplication, metadata reconciliation, and validation.
  • Familiarity with distributed computing frameworks, particularly Apache Spark, is advantageous.
  • Understanding of the Department of Defense Procurement Lifecycle, including Procure-to-Pay, is beneficial.
  • Use Microsoft 365 effectively and demonstrate communication, writing, analytical, organizational, and time-management skills.
  • Hold an active SECRET security clearance; an Interim SECRET clearance is also acceptable.

Responsibilities

  • Design, build, optimize, and maintain scalable data pipelines and ETL/ELT processes.
  • Develop data models for operational and analytical environments.
  • Implement data ingestion, transformation, storage, and retrieval practices across environments.
  • Collaborate with data scientists, analysts, and business stakeholders to define data requirements and deliver data solutions.
  • Establish data quality, consistency, and governance through monitoring, testing, validation, and improvement.
  • Develop and optimize SQL queries, stored procedures, and scripts.
  • Integrate structured and unstructured data from databases, APIs, streaming platforms, and third-party feeds.
  • Optimize large-scale processing using distributed computing technologies such as Apache Spark.
  • Normalize data, build indexes, implement deduplication, investigate discrepancies, and reconcile metadata.
  • Manage data cataloging, metadata, and business rules using platforms such as Collibra.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now