Senior Data Engineer
New
S
SpyCloudCybersecurity
Flexible and remote-friendly work optionsFull-TimeSenior
Salary144,000 - 187,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of experience in data engineering or closely related disciplines; 2+ years in a technical leadership or senior engineering role
- Required Skills
- AWSPythonDynamoDBElasticSearchETLMachine LearningSparkDatabricksLLM
Requirements
- 8+ years of experience in data engineering or closely related disciplines
- 2+ years in a technical leadership or senior engineering role
- Experience building and operating Lakehouse, Databricks, or large-scale distributed data lake architectures in AWS
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience building and managing large Elasticsearch/Opensearch data stores
- Hands-on experience building ETL scripts
- Hands-on experience preparing and managing data for machine learning and LLM workflows
- Strong development skills in Python, especially in building data-intensive systems
- Practical experience using DynamoDB and other AWS-native data services at scale
- Effective communication and collaboration across technical and non-technical stakeholders
- Proven ability to mentor and grow engineering talent and lead large-scale initiatives
Responsibilities
- Redesign and modernize data architecture for scalability, performance, and AI-readiness
- Use Databricks and Spark to prepare, transform and serve data to customers
- Build and optimize real-time and batch data pipelines using AWS tools
- Design systems to prepare and serve high-quality data for ML models and LLM applications
- Optimize cost and performance of daily data ingestion, transformation, and storage workflows
- Evaluate and implement modern tooling for data processing, ML data workflows, and observability
- Guide and mentor data engineers, championing best practices and technical excellence
- Lead long-term data architecture planning aligned with company and AI-driven goals
View Full Description & ApplyYou'll be redirected to the employer's site
