Azure Data Engineer
New
J
JobgetherCybersecurity, IT
Based in IndiaFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- PythonCybersecurityData engineeringJSON
Requirements
- 3+ years of relevant experience in cybersecurity, data engineering, log management, security operations, or a related technology discipline.
- Hands-on experience onboarding, managing, and validating log sources within SIEM, cloud data platforms, or security analytics environments.
- Strong understanding of data parsing, normalization, transformation, and validation, including experience with regex, JSON, XML, CSV, and both structured and unstructured data.
- Familiarity with security telemetry from network, endpoint, identity, application, cloud, and infrastructure environments.
- Experience working with cloud platforms and associated logging, monitoring, and analytics services, particularly within the Azure ecosystem.
- Strong troubleshooting and analytical skills, with the ability to diagnose pipeline, ingestion, schema, and data-quality problems.
- Understanding of compliance and regulatory requirements related to logging, retention, auditability, and data integrity.
- Experience with scripting or automation technologies such as Python, PowerShell, or similar tools is preferred.
- Familiarity with query languages used to validate, investigate, and analyze ingested security data.
- Ability to coordinate complex onboarding initiatives across internal teams, vendors, and multiple stakeholders.
- Strong organizational skills and the ability to balance operational support, project delivery, and continuous improvement.
Responsibilities
- Design, build, and maintain scalable security data ingestion pipelines for SIEM and cloud data platforms, including Azure Data Explorer and Log Analytics.
- Parse, normalize, transform, enrich, and validate structured and unstructured security telemetry using regex, JSON parsing, schema mapping, and other data-processing techniques.
- Partner with application owners, infrastructure and cloud teams, vendors, security stakeholders, and other internal groups to onboard new log sources and validate end-to-end data flows.
- Ensure the integrity, completeness, timeliness, and quality of security telemetry used for monitoring, detection, incident response, reporting, and risk management.
- Align security data with established schemas, naming conventions, governance standards, and organizational requirements to support downstream analytics and automation.
- Troubleshoot ingestion, parsing, transformation, schema, and data-quality issues across diverse platforms and environments.
- Maintain clear documentation covering log onboarding procedures, source requirements, data mappings, pipeline configurations, and operational support processes.
- Collaborate with detection engineering and security operations teams to ensure telemetry supports investigation, threat detection, response, and cyber risk use cases.
- Support infrastructure-as-code, scripting, and automation initiatives that streamline deployment and ongoing pipeline maintenance.
View Full Description & ApplyYou'll be redirected to the employer's site