Data Engineer 1
New
F
FlashpointThreat Intelligence
Remote in the United StatesPart-TimeEntry
Salary$107,500 - $150,000/yr. base + target bonus
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLGrafanaPrometheusLinux
Requirements
- Hands-on production experience building or operating streaming data pipelines (Pub/Sub, Kafka, or similar).
- Demonstrated ability to debug and optimize GCP Dataflow or Beam-based stream processing.
- Strong background as a first responder for systems with no tolerance for downtime.
- Proven experience building monitoring and alerting systems using tools like Prometheus, Grafana, or Stackdriver.
- Experience integrating LLMs like Vertex AI and Gemini into data pipelines.
- Understanding of prompt engineering in a data context.
- Experience working with terabyte-to-petabyte scale datasets.
- Proficiency with Python, SQL, and Linux.
- Reliability mindset with fluency in SLAs, observability, on-call rotation, and incident postmortems.
Responsibilities
- Own end-to-end operations of real-time pipelines that ingest, enrich, filter, and route data through Vertex AI and Gemini.
- Manage Pub/Sub infrastructure including message delivery, consumer groups, and production incident response.
- Scale, monitor, and optimize Dataflow streaming and batch jobs processing petabytes of data.
- Build and maintain monitoring, alerting, and incident-response tooling for critical systems.
- Safeguard data integrity to ensure timely and accurate data delivery to customers.
- Partner with Product, Data, and Intelligence teams to translate requirements into operational reality.
View Full Description & ApplyYou'll be redirected to the employer's site
