Senior Data Engineer
New
C
Capital Technology GroupData Analytics
Location: RemoteFull-TimeSenior
Salary$130k to $165k annually
Apply NowOpens the employer's application page
Job Details
- Experience
- 9+ years
- Required Skills
- PostgreSQLPythonSQLJavaSparkCI/CDdbtDatabricks
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related technical field.
- 9+ years of professional experience in data engineering or related domains.
- Hands-on expertise with Databricks, Apache Spark (PySpark), Python, PostgreSQL, and dbt.
- Experience designing and maintaining AWS-native data platforms using Glue, EMR, Airflow, Lambda, Step Functions, S3, Redshift, RDS, DMS, and CloudWatch.
- Proficiency with modern data lake technologies like Apache Iceberg and data formats including Parquet, ORC, and Avro.
- Experience with relational and NoSQL databases such as Oracle, Redshift, and GraphDB.
- Java development experience and familiarity with modern CI/CD practices using Harness.
- Proven experience building, tuning, and optimizing enterprise-scale ETL/ELT architectures.
- Experience working in agile, iterative software development environments.
- Excellent written and verbal communication skills.
Responsibilities
- Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models.
- Develop and optimize AWS-native data platforms leveraging services like AWS Glue, EMR, and Airflow.
- Build high-performance ingestion, transformation, and orchestration workflows.
- Integrate enterprise and external data sources across relational and NoSQL platforms.
- Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies.
- Develop cloud infrastructure using IaC and CI/CD pipelines.
- Support mission-critical analytics and reporting solutions compliant with FedRAMP and NIST 800-53 security controls.
- Lead modernization initiatives migrating legacy platforms to cloud-native AWS services.
- Mentor junior engineers through technical guidance and code reviews.
- Collaborate in an Agile environment to define requirements and deliver high-quality data solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
