Apply📍 USA
🧭 Full-Time
💸 190000.0 - 220000.0 USD per year
🔍 B2B data / Data as a Service (DaaS)
- 5-7+ years industry experience with strategic technical problem-solving.
- Strong software development fundamentals.
- Experience with Python.
- Expertise in Apache Spark (Java, Scala, or Python-based).
- Proficiency in SQL.
- Experience building scalable data processing systems.
- Familiarity with data pipeline orchestration tools (e.g., Airflow, dbt).
- Knowledge of modern data design and storage patterns.
- Experience working in Databricks.
- Familiarity with cloud computing services (e.g., AWS, GCP, Azure).
- Experience in data warehousing technologies.
- Understanding of modern data storage formats and tools.
- Build infrastructure for ingestion, transformation, and loading of data using Spark, SQL, AWS, and Databricks.
- Create an entity resolution framework for merging billions of entities into clean datasets.
- Develop CI/CD pipelines and anomaly detection systems to enhance data quality.
- Provide solutions to undefined data engineering problems.
- Assist Engineering and Product teams with data-related technical issues.
AWSPythonSQLKafkaAirflowData engineeringPandasCI/CD
Posted 15 days ago
Apply