Staff Data Engineer (Remote)

View full description

Requirements:

• 7+ years of experience programming in SQL
• 5+ years programming in Snowflake
• 3+ years working with FiveTran
• 3+ years of experience in ETL/data movement including both batch and real-time data transmission using dbt
• 5+ years of experience data modeling including normalizing and dimensional modelling
• 5+ years of experience optimizing performance in ETL and reporting layers
• 3+ years of hands-on development and deployment experience with Azure cloud using .NET, T-SQL, Azure SQL, Azure Storage, Azure Data Factory, Cosmos DB, GitHub, Azure DevOps, and CI/CD pipelines
• 3+ years with APIs, microservices
• 3+ years of experience programming in Python/Java/C#

Responsibilities:

• Build next generation distributed streaming and data pipelines and analytics data stores using streaming frameworks (Kafka, Spark Streaming etc.) using Programming languages like Python and ELT tools like Fivetran, DBT etc.
• Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance.
• Develop and deploy structured, semi-structured, and unstructured data storage models such as data lake and dimensional modeling
• Evaluate and define functional requirements for data and analytical solutions
• Monitor system performance, identify issues related to performance, scalability, and reliability, and design solutions to remediate
• Partner with IT, Data Governance, and subject matter experts to create, automate, and deploy effective data quality monitors.
• Develop and maintain enterprise data dictionary of data warehouse transformations and business rules
• Ensure healthcare information security best practice controls are in place and they adhere to HIPAA utilizing a common control framework (i.e. NIST, HITRUST)
• Implement master data management (MDM) solutions to collect, maintain, and leverage data for common business entities
• Implement metadata management solutions to collection, maintain, and leverage application and system metadata