Senior Software Engineer, Data Ingestion
New
H
Horizon3Cybersecurity
US, RemoteFull-TimeSenior
SalaryBase salary range: $199,750 - $260,000 annually. Additional compensation: All full-time roles are eligible for an equity package in the form of stock options.
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of professional software engineering experience with production backend systems
- Required Skills
- AWSDockerPostgreSQLPythonETLKafkaKubernetesRabbitmqGo
Requirements
- 5+ years of professional software engineering experience with production backend systems.
- Strong proficiency in Go and/or Python.
- Demonstrated experience building and operating production data pipelines or ETL systems, using streaming or batch processing.
- Working knowledge of message queues or event streaming systems such as Kafka or RabbitMQ.
- Experience with relational databases such as PostgreSQL, including schema design, query optimization, and migrations.
- Understanding of data normalization trade-offs, schema evolution, and backward compatibility.
- Experience running services on Kubernetes and containerized environments using Docker.
- Comfort deploying and debugging distributed systems in AWS or an equivalent cloud.
- Ability to instrument code, write runbooks, and own services through their full lifecycle.
- Ability to define data contracts with downstream consumers and collaborate across team boundaries.
- Clear written communication for design documents, pull request descriptions, and asynchronous updates.
- Graph database or graph data model familiarity is an asset; cybersecurity, security tooling, vulnerability or threat data, and pentest workflow experience are nice to have.
Responsibilities
- Design, implement, and operate data ingestion pipelines for pentest results, discovered assets, vulnerability findings, and network topology data.
- Own end-to-end delivery of pipeline features, including schema design, implementation, testing, deployment, and monitoring.
- Build and maintain Go and/or Python ETL components that normalize heterogeneous inputs from NodeZero execution engines.
- Partner with Asset Inventory and Data Platform teams to define and evolve data contracts for downstream consumers.
- Diagnose and resolve production issues involving pipeline latency, data correctness, and throughput.
- Contribute to code and design reviews and provide engineering guidance to P3 engineers.
View Full Description & ApplyYou'll be redirected to the employer's site
