Senior AI Data Engineer
New
S
Scorpion Enterprises, LLCMarketing Technology
Remote - United StatesFull-TimeSenior
Salary155,000 - 185,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- PythonSQLSnowflakeAirflowSparkBigQuerydbtDatabricks
Requirements
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
- 7+ years of data engineering experience, including designing and operating production-scale analytical data platforms.
- Deep expertise with Databricks, Delta Lake, and Apache Spark.
- Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
- Advanced SQL skills, including query optimization, execution planning, and performance tuning.
- Strong Python skills for data pipeline development, automation, and transformation.
- Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar tools.
- Strong understanding of lakehouse architecture, data partitioning, metadata management, and security best practices.
Responsibilities
- Evaluate and improve data quality, completeness, and consistency across 30+ databases, applications, platforms, and APIs.
- Design and build Scorpion's analytical data platform, creating a trusted source of truth for business and client data.
- Develop and maintain scalable data pipelines that efficiently move data from operational systems into the analytical platform.
- Help teams transition from querying production databases directly to using trusted analytical data sources.
- Design data access patterns that enable AI agents and applications to quickly retrieve relevant client and business information.
- Build secure, scalable solutions that deliver client context and business insights to internal applications and AI-powered experiences.
- Define, monitor, and improve service level agreements (SLAs) for data freshness, availability, reliability, and performance.
- Partner with engineering, product, and data science teams to establish data standards, governance practices, and data contracts.
- Continuously improve the scalability, performance, and reliability of Scorpion's data ecosystem.
View Full Description & ApplyYou'll be redirected to the employer's site
