Junior Forward Deployed Engineer

S
SedgwickData engineering
United StatesFull-TimeJunior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
Six (6) years of hands-on data engineering experience
Required Skills
AWSDockerPythonSQLMicrosoft AzureSnowflakeAirflowPySpark

Requirements

  • Have six years of hands-on data engineering experience building production-grade pipelines for Data Science and AI in multi-cloud environments, or equivalent education and experience.
  • Bring expert-level proficiency in Snowflake architecture, including data sharing, performance tuning, and integration with external cloud AI services.
  • Have advanced hands-on knowledge of AWS data services, including S3, Glue, and Lambda.
  • Have advanced hands-on knowledge of Azure data services, including Data Factory and Synapse.
  • Demonstrate mastery of Python, SQL, and PySpark.
  • Have deep experience with data orchestration and Docker containerization.
  • Be able to work with on-premise SQL, mainframe extracts, and flat files and transform data for cloud consumption.
  • Understand machine learning data needs, including feature engineering.
  • Understand generative AI data needs, including vectorization and embedding pipelines.
  • A master’s degree in Computer Science, Data Engineering, or a related field is preferred.

Responsibilities

  • Design, build, and maintain ETL/ELT pipelines that ingest data from on-premise systems, AWS, and Azure for Snowflake and downstream AI services.
  • Develop feature stores and optimized datasets that are clean, versioned, reproducible, and statistically valid for Data Science teams.
  • Build generative AI data pipelines to extract, transform, chunk, and load structured and unstructured data into vector databases across AWS and Azure.
  • Implement Snowflake data modeling, Snowpipe automation, and compute and storage optimization for analytics and AI workloads.
  • Extract data from legacy systems while preserving system stability and avoiding disruption to core business operations.
  • Manage cross-platform data workflows using Airflow, AWS Step Functions, and Azure Data Factory.
  • Partner with IT, database, infrastructure, and security teams to resolve connectivity and access challenges and secure approval for integrations.
  • Implement automated data quality, validation, and observability frameworks to detect data drift, anomalies, and integrity issues.
  • Optimize storage, compute usage, and query performance across Snowflake, AWS, and Azure.
  • Work with MLOps, Data Science, and AI teams to turn evolving and experimental data requirements into production-ready solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now