- Design, build, and maintain scalable data pipelines for ingesting, processing, and enriching large datasets.
- Develop Python-based automation for data collection, transformation, validation, and workflow orchestration.
- Build and optimize data processing workflows using Databricks, PySpark, SQL, and Delta Lake.
- Integrate and process data from multiple SaaS platforms through REST APIs and other integrations.
- Develop scalable workflows for lead generation, company and contact enrichment, and sales intelligence.
- Implement processes for data cleansing, deduplication, entity resolution, normalization, and contact/company matching.
- Process structured, semi-structured, and JSON data from a variety of internal and external sources.
- Collaborate with product, engineering, and go-to-market teams to translate business requirements into scalable technical solutions.
- Identify opportunities to automate repetitive processes and improve operational efficiency.
- Continuously evaluate and adopt new AI tools and technologies that improve development speed and data quality.
PythonSQLGit+4 more