Senior Data Engineer, Blockchain data and/or NLP pipelines
New
I
Inca DigitalDigital-asset analytics
Location: United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSDockerPostgreSQLPythonSQLETLGitAirflowFastAPITerraform
Requirements
- Advanced proficiency in Python and SQL.
- Proven experience building and operating production ETL/ELT pipelines using orchestrators like Airflow, Dagster, Prefect, or Step Functions.
- Hands-on experience managing schema drift, backfills, idempotency, and retries.
- Experience with PostgreSQL/RDS and object storage (S3).
- Experience building and versioning APIs (e.g., FastAPI, Kong OSS).
- Proficiency with Docker, Git, and CI/CD tools (e.g., GitHub Actions, AWS CodeBuild).
- Experience with IaC tools like Terraform or CDK.
- Deep expertise in either blockchain ledger data (RPCs, indexers, ABIs) or NLP/LLM workflows (embedding, vector search, model evaluation).
- Must be able to maintain on-call responsibilities for own pipelines.
Responsibilities
- Design, build, and operate end-to-end batch and incremental ETL/ELT pipelines.
- Manage high-throughput data acquisition from relational databases, vendor APIs, blockchain nodes, and social/web text.
- Implement NLP and LLM-assisted processing including extraction, classification, and enrichment for downstream risk models.
- Model and query data across relational, object, and graph stores.
- Maintain data provenance, reproducibility, and versioning for all datasets.
- Ensure data quality through validation, lineage, reconciliation, and freshness monitoring.
- Partner with R&D, engineering, and investigations teams to deliver scalable, client-facing products.
- Contribute to technical design and architecture within a formal written process.
View Full Description & ApplyYou'll be redirected to the employer's site
