Staff Software Engineer, Data Catalog
A
AirbnbData Infrastructure
This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity.Full-TimeStaff
Salary$212,000 — $265,000 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 9+ years of experience
- Required Skills
- PythonSQLApache AirflowJavaSparkScala
Requirements
- BS/MS/PhD in Computer Science or a related field, or equivalent work experience.
- 9+ years of experience in software engineering, with a focus on data infrastructure.
- Experience working with data storage and distributed processing technologies (e.g., Hive, Spark, Trino, Flink, SQL).
- Strong programming skills in Java, Python, or Scala.
- Experience with data catalog products, metadata infrastructure, metadata management, and integration frameworks.
- Experience with workflow orchestration solutions (e.g., Apache Airflow, Prefect, Kubeflow).
- Strong knowledge of data governance frameworks, policies, and processes (data classification, lineage, quality, privacy, retention).
- Excellent communication and collaboration skills for working with cross-functional teams.
- Ability to work in areas outside of usual comfort zone.
- Excellent analytical and problem-solving skills.
Responsibilities
- Develop and implement data catalog products to support data discovery, metadata management, data quality, and data lineage.
- Develop and implement metadata infrastructure to support data governance, ownership management, data classification, privacy, access control, and retention.
- Build end-to-end data lineage products across online, offline, machine learning, metrics, visualizations, and third-party datasets.
- Collaborate with cross-functional teams to ensure all datasets are cataloged, governed, and meet business and regulatory requirements.
- Identify, design, and build metadata integrations with various data infrastructure frameworks.
- Build infrastructure toolings and processes for scalable metadata onboarding and integrations.
- Develop and implement metadata-driven data policies and procedures.
View Full Description & ApplyYou'll be redirected to the employer's site
