Senior Data Engineer 4B
New
J
JobgetherData engineering
Fully remote work arrangement within India.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Proficiency in English at C2 level.
- Required Skills
- DockerPythonGitKubernetesSnowflakeApache KafkaSparkDatabricks
Requirements
- Bachelor's or master's degree in Computer Science, Data Science, Statistics, or a related field.
- Strong professional experience in data engineering, including designing and implementing scalable data solutions.
- Proficiency in Python.
- Experience with Apache Spark and Apache Kafka.
- Experience with cloud platforms and the Databricks ecosystem.
- Knowledge of data ETL, integration, streaming, data quality, and data warehousing concepts.
- Experience with Snowflake and data-system performance optimization.
- Familiarity with Docker, Kubernetes, Git, and process orchestration tools.
- Understanding of quality assurance practices and system performance monitoring.
- Proficiency in English at C2 level.
- Relevant certifications listed include Microsoft Certified: Azure Solutions Architect Expert; Databricks Certified Associate Developer for Apache Spark 3.0; Databricks Certified Data Engineer Professional; and Microsoft Certified: Azure Data Engineer Associate.
Responsibilities
- Design, develop, and maintain scalable data processing systems for structured and unstructured data.
- Build and manage pipelines for data ingestion, processing, transformation, integration, and storage.
- Optimize data infrastructure, workflows, and processing systems for performance, scalability, and reliability.
- Collaborate with data scientists, data analysts, and technical stakeholders to translate requirements into engineering solutions.
- Troubleshoot data pipeline, integration, data quality, and infrastructure issues.
- Monitor system performance and data quality, and implement improvements to maintain operational stability.
- Apply engineering best practices across ETL, streaming, warehousing, orchestration, and quality assurance.
- Stay up to date with emerging technologies, tools, and trends in big data and cloud engineering.
- Mentor junior data engineers and share technical knowledge and best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
