- Design, implement, and maintain data pipelines and ETL processes for mission data ingestion, transformation, and validation.
- Develop and optimize data models and schemas across relational and non-relational databases.
- Collaborate with system architects, integration developers, and data analysts to maintain data consistency, security, and integrity.
- Migrate and synchronize data between legacy systems, applications, and cloud platforms.
- Build and sustain scalable data infrastructure using AWS services including Glue, Lambda, S3, RDS, Redshift, and Kinesis.
- Integrate data from APIs, streaming sources, and file-based systems into repositories or data lakes.
- Automate data workflows using infrastructure-as-code and CI/CD principles.
- Monitor and troubleshoot pipeline performance and operational reliability.
- Implement encryption, masking, and access controls in line with DoD cybersecurity policies and RMF requirements.
- Maintain data dictionaries, lineage, metadata repositories, and technical specifications.
PostgreSQLPythonSQL+2 more