Staff Data Engineer / Tech Lead (Distribution Center)
New
A
AfreshAI Grocery
Reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WIFull-TimeSenior
SalarySalary Range in CAD: $148K - $222K
Apply NowOpens the employer's application page
Job Details
- Experience
- 2+ years of experience in a technical lead role
- Required Skills
- PythonSQLETLSnowflakedbtDatabricksPySpark
Requirements
- Significant experience designing and maintaining ETLs that process large-scale datasets.
- Proficiency with Python, PySpark, and SQL.
- Experience working on platforms and tools such as Databricks, Snowflake, or dbt.
- 2+ years of experience in a technical lead role (e.g., Tech Lead or Engineering Manager).
- Willingness to mentor and help others grow.
- Strong problem-solving skills with the ability to work with ambiguous or incomplete requirements.
- Experience working directly with complex, unclean datasets.
- Proven knack for identifying areas where tooling or automation can simplify workflows.
- Excellent communication skills for both technical and non-technical audiences.
Responsibilities
- Design, build, and optimize robust ETLs using PySpark and dbt to process large-scale customer datasets.
- Develop tools and frameworks to streamline data integrations and improve platform scalability.
- Define the technical vision for distribution center data architecture.
- Mentor engineers and manage external contractors to ensure high-quality, practical solutions.
- Partner with product, engineering, and applied science teams to scope work and address data quality challenges.
View Full Description & ApplyYou'll be redirected to the employer's site
