Data Engineer (Family Networking)

View full description

Requirements:

• 5+ years of experience working with high-volume data infrastructure;
• Deep expertise with Databricks and AWS cloud platforms;
• Proficiency in Python programming and SQL, with the ability to optimize queries;
• Experience with large-scale data processing using Spark and/or Presto/Trino;
• Familiarity with data transformation frameworks like dbt and job orchestration tools like Airflow;
• Hands-on experience with data ingestion frameworks such as Fivetran;
• Strong background in data modeling and database design;
• Experience with modern development lifecycle tools including Agile methodology, CI/CD, Terraform, and GitHub Actions;
• Knowledge of modern data platform tech stacks and tools;
• Ability to stay up to date with the latest advancements in data engineering;
• Excellent communication skills and the ability to work independently;
• Bachelor’s degree in Computer Science, Software Engineering, Mathematics, or equivalent experience;

Responsibilities:

• Design, implement, and maintain scalable data processing platforms for real-time analytics and exploratory data analysis;
• Manage diverse types of data from ingestion through ETL to storage and batch processing;
• Automate, test, and enhance data workflows for robustness and scalability;
• Architect logical and physical data models to meet business requirements;
• Collaborate with analytics teams, applying best practices to optimize workflows;
• Develop systems and algorithms for distributed real-time analytics and data processing;
• Implement strategies for acquiring and transforming data to uncover new insights;
• Champion data engineering best practices to foster innovation and growth within the team;