Data Pipeline Engineer

View full description

Requirements:

• 5+ years of experience in Python.
• Proven experience designing, building, and maintaining scalable data pipelines.
• Demonstrated ability with Docker and Kubernetes.
• Experience with cloud-based storage solutions.
• Knowledge of how distributed systems work.
• Strong troubleshooting skills.

Responsibilities:

• Build and maintain proprietary data pipeline for batch geospatial data processing.
• Monitor and support data pipeline performance and reliability.
• Develop new data processing tasks to support evolving data requirements.
• Design and implement data storage solutions using cloud-based storage services.
• Develop and optimize data workflows using distributed systems.
• Rapid generation of functional prototypes.