Data Engineer - AWS/Databricks - REMOTE

10+ years of experience in data engineering and Agile analytics. 5+ years of experience architecting and maintaining complex data products at enterprise scale. 3+ years of experience with structured and unstructured data processing. 3+ years of experience building scalable ETL and ELT workflows. 3+ years of experience with AWS and Databricks for enterprise data solutions. Experience with data quality and validation frameworks. BA or BS degree. US Citizen with ability to obtain and maintain US Suitability.

Build and maintain scalable PySpark-based data pipelines in Databricks notebooks. Design and implement Delta Lake tables optimized for ACID compliance and query performance. Develop robust ETL and ELT workflows integrating multiple source systems into a data warehouse architecture. Leverage Spark SQL and DataFrame APIs to implement business rules and aggregation logic. Collaborate with data architects to implement cloud-native data solutions on AWS. Optimize pipeline performance through intelligent partitioning and adaptive query tuning. Deploy and version data engineering assets using Git-integrated workflows and CI/CD tools. Monitor pipeline health and optimize cost-performance tradeoffs. Conduct technical discovery of legacy systems and design end-to-end data flows. Implement governance practices including metadata tagging and data quality validation.