Senior Data Engineer – Hadoop
New
B
Bright Vision TechnologiesTechnology Consulting
100% Remote (U.S.)Full-TimeSenior
Salary145,000 - 165,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years
- Required Skills
- PythonSQLApache AirflowHadoopKafkaNosqlSparkScala
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related technical discipline.
- 5+ years of professional experience designing and operating big-data pipelines on Hadoop.
- Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
- Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
- Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
- Strong SQL skills and experience with relational and NoSQL data stores.
- Experience with workflow orchestration tools such as Airflow or Oozie.
- Solid understanding of distributed systems concepts (partitioning, replication, fault tolerance).
- Strong scripting skills in Python or Shell.
- Excellent troubleshooting, debugging, and documentation skills.
Responsibilities
- Design and build large-scale data processing pipelines.
- Operate and maintain analytics platforms on Hadoop.
- Ingest and transform massive volumes of structured and unstructured data.
- Support enterprise analytics, machine learning, and reporting workloads.
- Deliver reliable, performant, and cost-effective data platforms in production.
View Full Description & ApplyYou'll be redirected to the employer's site
