Senior Data Platform Engineer
New
D
DEFCON AIData platforms
Location: Remote, USAFull-TimeSenior
Salary$165,000—$200,000. Competitive salary, bonus, and equity package
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years in data engineering or data platform engineering
- Required Skills
- PostgreSQLPythonSQLData engineering
Requirements
- Have 6+ years in data engineering or data platform engineering.
- Bring production experience with versioned, temporal, or historized data models.
- Have experience designing storage where history, provenance, and source disagreement are first-class.
- Be comfortable building on probabilistic upstream output rather than a clean shared key.
- Have strong Python and SQL skills.
- Have production experience with PostgreSQL or a comparable system.
- US citizenship is required.
- Hold an active US Secret clearance.
- Preferred: experience building storage downstream of an entity-resolution or record-linkage system.
- Preferred: production experience with bi-temporal, event-sourced, graph, or temporal data modeling.
- Preferred: federal, government, or regulated-industry experience requiring historical decisions to be reproducible on demand.
- Preferred: active Top Secret clearance.
Responsibilities
- Design and build the storage layer to preserve source disagreement and history rather than resolving them away at write time.
- Build the first release’s result and evidence store, linking saved per-person results to originating records and retaining prior results and human feedback separately.
- Record configuration versions on every result.
- Implement provenance and lineage across every node and edge against the platform’s evidence-record contract.
- Store the versioned rule library and configuration, and record exact rule versions and ordered context supplied to model-assisted steps.
- Ensure every write is traceable to its origin and every decision is reproducible.
- Carry match confidence and other uncertainty forward through the platform.
- Support point-in-time questions about what the platform believed about an entity and the evidence behind it.
- Define storage inputs and downstream requirements with entity resolution and ML teammates.
View Full Description & ApplyYou'll be redirected to the employer's site
