6 years of experience in PySpark Experience writing and optimizing SQL queries Hands-on experience with Databricks for building big data solutions Experience with Hadoop/Hive Experience with data versioning tools like GIT Experience with Airflow, Dagster Experience with Azure