Senior Data Engineer

New

Lumin DigitalDigital banking

Remote - United StatesFull-TimeSenior

Salary$180K - $200K; $180K – $200K • Offers Bonus; Estimated Salary Range $180K – $200K • Offers Bonus

Apply NowOpens the employer's application page

More jobs in this role

Job Details

Experience: 5+ years of experience in software engineering, data engineering, or related technical disciplines. 5+ years of hands-on Databricks experience designing, developing, administering, and maintaining scalable cloud-based data platforms.
Required Skills: AWSPythonSQLApache KafkaSparkCI/CDScalaDatabricks

Requirements

Have a bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
Have 5+ years of experience in software engineering, data engineering, or related technical disciplines.
Have 5+ years of hands-on Databricks experience designing, developing, administering, and maintaining scalable cloud-based data platforms.
Have experience building data pipelines, integrations, automation, and reusable tools.
Have experience configuring, monitoring, troubleshooting, and optimizing data platform infrastructure.
Have experience with cloud infrastructure and services, preferably AWS; Azure or Google Cloud experience is also valued.
Have experience with Scala, Python, SQL, Apache Spark, or similar data engineering technologies.
Have experience with infrastructure-as-code, CI/CD, automated infrastructure provisioning, configuration management, and deployment processes.
Have experience supporting production environments, resolving technical issues, and improving platform stability and operational efficiency.
Understand Databricks platform capabilities, Apache Spark, Delta Lake, distributed data processing, and data storage optimization.
Understand cloud infrastructure, security, networking, resource management, data governance, access controls, and platform reliability.
Familiarity with streaming data platforms and event-driven architectures such as Apache Kafka or Confluent is preferred.
Travel is minimal, generally 12 days or less per year, with approximately two team get-togethers per year.

Responsibilities

Design, develop, and maintain scalable, reliable, and cost-effective data platform architecture and foundational capabilities, primarily using Databricks.
Build and optimize data pipelines, integrations, and reusable tools for data processing and developer productivity.
Monitor and optimize platform performance, reliability, and resource utilization to improve efficiency and reduce operational costs.
Collaborate with security and engineering teams to align platform solutions with security standards, data governance, and regulatory requirements.
Partner with cross-functional stakeholders to identify shared platform needs, prioritize improvements, and contribute to technical planning and architectural decisions.

View Full Description & ApplyYou'll be redirected to the employer's site