Sr. Data Integration Engineer
S
SparksoftIT Services
Remote/Hybrid if local to MarylandFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- AWSPythonJiraCI/CDJSONConfluence
Requirements
- 7+ years of relevant experience.
- Strong Python development skills (modular design, testing, debugging, packaging).
- Hands-on experience with AWS Glue, Amazon S3, and AWS Glue Data Catalog.
- Experience with AWS data, integration, security, and monitoring services.
- Expertise in ingesting/processing JSON and NDJSON formats.
- Proficiency in data modeling, schema design, and data quality practices.
- Experience with Git, CI/CD pipelines, and infrastructure-as-code.
- Strong analytical, documentation, and communication skills.
- Expertise in JIRA and Confluence.
- Must be able to obtain and maintain a Public Trust clearance.
Responsibilities
- Design and develop resilient batch and event-driven data pipelines using Python, AWS Glue, and AWS managed services.
- Build AWS Glue jobs, crawlers, workflows, and Data Catalog integrations.
- Ingest and process structured and semi-structured data from files, APIs, databases, and streaming sources.
- Create automated unit, integration, regression, and data reconciliation tests.
- Implement operational monitoring, logging, alerting, and error handling mechanisms.
- Automate infrastructure and deployment processes using infrastructure as code and CI/CD.
- Collaborate with Product Owners to refine stories, capture requirements, and track delivery.
- Provide ongoing support, maintenance, and documentation for implemented data solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
