Senior Data Engineer, AI Platform
New
Z
ZipFintech
Remote-first opportunity for US-based employees with the option to work in-person out of our Manhattan office.Full-TimeSenior
Salary$134,000 - $168,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years
- Required Skills
- PythonSQLKafkaSnowflakeAirflowSparkdbtDatabricks
Requirements
- 8+ years of experience designing, building, and operating enterprise-scale data platforms.
- Deep expertise with modern cloud data platforms such as Snowflake, Databricks, Microsoft Fabric, BigQuery, Redshift, or similar.
- Advanced SQL and Python skills.
- Experience in data modeling, ELT/ETL development, and dbt.
- Experience with orchestration frameworks such as Airflow or Dagster.
- Experience building scalable streaming and event-driven architectures using technologies such as Kafka, Azure Event Hubs, or Spark.
- Understanding of modern data architecture patterns, including dimensional modeling, semantic layers, data governance, and metadata management.
- Experience supporting AI and machine learning workloads through vector search, metadata enrichment, RAG, and knowledge retrieval systems.
- Experience with modern lakehouse technologies and open table formats such as Apache Iceberg or Delta Lake.
- Cloud platform experience (Azure preferred; AWS or GCP acceptable).
- Experience in testing, CI/CD, infrastructure automation, and operational excellence.
- Proven ability to lead technical initiatives and mentor engineers.
Responsibilities
- Design, build, and scale Zip’s enterprise Data & AI Platform supporting analytics, machine learning, Generative AI, and Agentic AI initiatives.
- Develop scalable data pipelines and architectures for structured, unstructured, batch, and real-time data workloads.
- Build AI-ready data products, semantic models, and retrieval capabilities that enable intelligent agents and AI-powered applications.
- Design and optimize vector search, hybrid search, and Retrieval-Augmented Generation (RAG) capabilities.
- Implement streaming and event-driven solutions that support near real-time business insights, operational intelligence, fraud detection, and risk monitoring.
- Establish engineering best practices for data modeling, testing, observability, governance, security, and platform reliability.
- Drive self-service and automation capabilities that improve developer productivity and accelerate time-to-insight.
- Partner with cross-functional teams to deliver trusted, high-quality data solutions.
- Mentor engineers, influence architecture decisions, and help define the future direction of Zip’s data platform.
View Full Description & ApplyYou'll be redirected to the employer's site