ETL Developer
New
B
Bright Vision TechnologiesData integration
100% Remote (U.S.)Full-TimeSenior
Salary115,000 - 175,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- SQL
Requirements
- Have five or more years of professional experience developing enterprise ETL solutions.
- Have hands-on experience with ETL platforms such as Informatica PowerCenter, SSIS, Talend, IBM DataStage, or Pentaho.
- Have advanced SQL development skills with SQL Server, Oracle, PostgreSQL, Snowflake, or Teradata.
- Understand relational databases, dimensional modeling, star and snowflake schemas, and data warehousing principles.
- Have experience designing ETL workflows with complex transformations, joins, aggregations, lookups, and data validation.
- Have implemented CDC, SCD Type 1 and Type 2, and incremental loading techniques.
- Have experience with cloud data platforms such as Azure Data Factory, AWS Glue, or Google Cloud Data Fusion.
- Have worked with structured and semi-structured formats including JSON, XML, CSV, Parquet, and Avro.
- Be familiar with Python, PowerShell, or Shell scripting for ETL automation.
- Have experience scheduling workflows with Control-M, Autosys, Apache Airflow, Azure Data Factory, or enterprise schedulers.
- Have experience with Git, Azure DevOps, Jenkins, or other CI/CD tools for ETL deployments.
- Have debugging, troubleshooting, and ETL performance-tuning skills, and experience with Agile Scrum and enterprise SDLC processes.
Responsibilities
- Design, develop, and maintain enterprise ETL/ELT pipelines for large-scale data integration projects.
- Build scalable ingestion workflows that extract data from relational databases, cloud applications, APIs, flat files, and enterprise systems.
- Develop transformation logic to cleanse, standardize, validate, and enrich datasets.
- Design and optimize batch and near real-time data processing pipelines for reporting and analytics.
- Implement SCD, CDC, incremental loading, and data reconciliation processes.
- Develop reusable ETL frameworks, metadata-driven workflows, and parameterized jobs.
- Perform source-to-target mapping, data profiling, and data quality analysis.
- Optimize ETL job performance through SQL query, partitioning, indexing, and parallel-processing improvements.
- Monitor workflows, troubleshoot production failures, and implement alerting and recovery mechanisms.
- Collaborate on cloud migration, data architecture, code reviews, deployment planning, and production support.
View Full Description & ApplyYou'll be redirected to the employer's site
