AI Pipeline Engineer - Security Automation Platform
New
C
CloudLinux Inc.Cybersecurity / Security Automation
Warsaw, Masovian Voivodeship, Poland. Belgrade, Vojvodina, Serbia. Sofia, Sofia City Province, Bulgaria. Madrid, Community of Madrid, Spain. Tbilisi, Tbilisi, Georgia. Yerevan, Yerevan, ArmeniaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 5+ years
- Required Skills
- DockerPythonAirflowClickhouseGoGrafanaPrometheusRust
Requirements
- 5+ years of professional backend, platform, or infrastructure engineering experience.
- Demonstrable experience building and operating multi-stage automation or data pipelines (CI/CD, ETL/ELT, ML/data platforms).
- Deep proficiency in at least one of Python, Go, or Rust.
- Proven systems design judgment with a focus on reliability and failure handling.
- Practical experience with workflow orchestration and job scheduling (e.g., Airflow, Temporal, Prefect, Argo).
- Strong understanding of reliability engineering principles (idempotency, retries, checkpointing, backpressure).
- Hands-on experience with observability tools like Prometheus/Grafana or LGTM stack.
- Deep CI/CD expertise, ideally with GitLab CI, including dynamic pipelines and container-based environments.
- Experience with object storage (S3/Ceph) and large-scale columnar databases like ClickHouse.
- Experience designing state machines for long-running, concurrent processes.
- Excellent debugging skills across system, network, and data layers.
- Upper-intermediate proficiency in spoken and written English.
Responsibilities
- Design, build, and operate end-to-end automated protection pipelines.
- Transform complex multi-stage batch jobs into resilient, idempotent, and observable systems.
- Define and enforce latency budgets and service-level objectives (SLOs) per pipeline stage.
- Develop observability layers including metrics, dashboards, and automated alerting.
- Implement system guardrails such as automated rollbacks, blast-radius limits, and kill switches.
- Eliminate manual operational tasks to minimize maintenance requirements.
- Maintain unit and integration tests for high-complexity logic including concurrency and state management.
- Collaborate with security analysts and server teams on system architecture.
View Full Description & ApplyYou'll be redirected to the employer's site
