Senior Cribl Pipeline Engineer / Security Data Engineer
New
T
TSG Risk ManagementSecurity data
Charlotte, NC preferred. Candidates in New York City, Los Angeles, Southern California, or other locations may also be considered. Work Model: Flexible hybrid or remoteFull-TimeSenior
Salary170,000 - 220,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 3 years of substantial hands-on experience using Cribl LogStream/Stream; at least 2 years of hands-on Snowflake administration, architecture, or data-engineering experience in a large enterprise environment.
- Required Skills
- PythonJavascriptSnowflake
Requirements
- Have at least 3 years of substantial hands-on experience using Cribl LogStream/Stream to develop and maintain pipelines, packs, routes, functions, parsers, and field-level transformations.
- Demonstrate Cribl field extraction, parsing, enrichment, filtering, normalization, transformation, and routing experience.
- Be able to explain an end-to-end data flow, including its source, Cribl processing, and downstream destination.
- Have experience building and supporting large-scale enterprise data-ingestion and processing pipelines.
- Have experience onboarding data into SIEM, security data lake, observability, analytics, or similar enterprise platforms.
- Have experience troubleshooting pipeline failures, malformed events, missing fields, schema changes, performance problems, and data-quality issues.
- Have experience with Python, JavaScript, or a similar scripting language for pipeline automation.
- Have at least 2 years of hands-on Snowflake administration, architecture, or data-engineering experience in a large enterprise environment.
- Have experience designing or maintaining Snowflake databases, schemas, tables, views, streams, tasks, stored procedures, or ingestion pipelines.
- Have problem-solving, debugging, documentation, and communication skills.
- Be able to work with technical teams across security, data, infrastructure, operations, and analytics.
Responsibilities
- Develop, implement, and maintain enterprise data-processing pipelines using Cribl LogStream/Stream.
- Build and maintain Cribl pipelines, packs, routes, functions, parsers, and reusable content.
- Extract, parse, filter, mask, enrich, normalize, and transform data fields.
- Map security telemetry to OCSF or other standardized data schemas.
- Build and support integrations between Cribl and Snowflake, Databricks, AWS, SIEM platforms, security tools, observability platforms, and enterprise data lakes.
- Onboard and validate endpoint, firewall, identity, cloud, audit, application, infrastructure, and network telemetry.
- Validate transformed events for the needs of SIEM, detection engineering, threat-hunting, incident-response, and security-analytics teams.
- Troubleshoot pipeline logic, malformed events, parsing failures, schema drift, field-mapping problems, dropped data, and data-quality issues.
- Monitor pipeline performance and optimize routing, transformations, and data volumes.
- Create and maintain Snowflake databases, schemas, tables, views, streams, tasks, stored procedures, and data pipelines.
View Full Description & ApplyYou'll be redirected to the employer's site
