Junior Data Engineer
New
C
Capital Technology GroupIT Consulting
Location: RemoteFull-TimeJunior
Salary$75k to $115k annually
Apply NowOpens the employer's application page
Job Details
- Experience
- 5 years of professional experience in data engineering or related domains
- Required Skills
- AWSPostgreSQLPythonSQLETLSparkData modelingdbtDatabricks
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related technical field.
- 5 years of professional experience in data engineering or related domains.
- Deep hands-on experience with Databricks for large-scale data engineering and ETL/ELT development.
- Strong proficiency with dbt, SQL (PostgreSQL), and Python.
- Strong hands-on experience with AWS services including Redshift, RDS, S3, Glue, Lambda, DMS, and CloudWatch.
- Experience with data pipelines, data modeling, system maintenance, and data integration.
- Experience working in agile, iterative software development environments.
- Strong analytical and problem-solving skills.
- Ability to quickly learn and apply new technologies.
- Excellent written and verbal communication skills.
Responsibilities
- Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Databricks, dbt, Apache Spark, SQL, and Python.
- Develop and optimize AWS-native data solutions leveraging services including AWS Glue, Amazon EMR, Amazon MWAA, Lambda, Step Functions, S3, Redshift, RDS, DMS, and CloudWatch.
- Build high-performance data ingestion, transformation, and orchestration workflows across structured and semi-structured data using Parquet, ORC, Avro, and Apache Iceberg.
- Integrate data from enterprise and external sources including relational and NoSQL databases.
- Improve the reliability, scalability, and performance of enterprise data platforms through monitoring and continuous optimization.
- Develop and maintain automated deployment pipelines using Harness.
- Collaborate with cross-functional teams in an Agile environment to define requirements and deliver data solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
