Data Operations Engineer II
A
AccuWeatherWeather Forecasting
Remote or State College, PAFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- PythonSQLBashGitMicrosoft SQL ServerSnowflakeAzureCI/CDDatabricks
Requirements
- BA/BS in Computer Science, Information Technology, or a related field.
- 3+ years of experience in data operations, scripting, and automation.
- Intermediate proficiency in scripting languages such as Python, PowerShell, or Bash.
- Fully competent in Azure, Databricks, Snowflake, and SQL Server.
- Experience managing relational databases such as SQL.
- Experience with deployment automation (CI/CD) tools and processes.
- Experience with version control systems (e.g., Git).
- Experience working with cloud platforms (e.g., AWS, Azure, GCP).
- Exceptional analytical and problem-solving skills.
- Strong debugging and system troubleshooting skills.
Responsibilities
- Build, monitor, and maintain data ingestion processes and systems that move, store, and transform data across platforms, administering Databricks and our Data Marketplace and Ad Platform.
- Develop, maintain, and optimize complex scripts using Python, PowerShell, or similar languages to automate data collection and monitoring.
- Own the operational state of a defined set of data pipelines — monitoring, incident response, maintenance procedures, and escalation for systems in your scope.
- Own SQL database maintenance (Forecast, current, historical, locations) for data loading and deployment.
- Develop and maintain unit test coverage for Data Ops code bases, ensuring scripts and pipelines behave as expected before deployment.
- Build and manage end-to-end monitoring systems and automated alert mechanisms to optimize the health and performance of data pipelines.
- Own incident diagnosis and resolution, including root cause identification and documentation.
- Build and maintain CI/CD pipelines (GitHub Actions, Azure DevOps) to support reliable, repeatable deployments.
View Full Description & ApplyYou'll be redirected to the employer's site
