Remote Data Automation Engineer

View full description

Requirements:

• 5+ years of experience in building data engineering pipelines on on-premise and cloud platforms (Snowflake, Databricks).
• Strong experience coding in Python, PySpark, SQL and building automations.
• Knowledge of Cybersecurity, IT infrastructure, and software concepts.
• Knowledge of IT Asset Management, ITIL, ITSM practices is a plus.
• 3+ years of experience using data warehousing/data lake techniques in cloud environments.
• 3+ years of developing data visualizations using Tableau, Plotly, and Streamlit.
• Experience with ELT/ETL tools like dbt, Airflow, Cribl, Glue, FiveTran, AirByte, etc.
• Experience capturing incremental data changes, streaming data ingestion, and stream processing.
• Experience in processes supporting data governance, data structures, and metadata management.
• Solid grasp of data and analytics concepts and methodologies including data science, data engineering, and data storytelling.

Responsibilities:

• Streamline the process of sourcing and organizing data from various sources using Python, PySpark, SQL, and Spark.
• Accelerate data for analysis to support analytics efforts.
• Support the data curation process by feeding the data catalog and knowledge bases.
• Create data tools to assist analytics and data science team members in building and optimizing data products.