Big Data Engineer
AnywhereFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 6+ years of experience working as a Developer, 5+ years of experience in Big Data
- Required Skills
- AWSPythonData AnalysisGCPIoTJavaJavascriptMachine LearningRubyAzure
Requirements
- 6+ years of experience working as a Developer
- 5+ years of experience in Big Data
- Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement
- Proficient in analysis, troubleshooting, and problem-solving
- Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones)
- Advanced English level
- Experience with Ruby (preferred)
- Experience with Python (preferred)
- Experience with Java (preferred)
- Experience with JavaScript (preferred)
- Building Data Lakes with Lambda/Kappa/Delta architecture (desirable)
- DataOps, particularly creating and managing batch and real-time data ingestion and processing processes (desirable)
- Hands-on experience with managing data loads and data quality (desirable)
- Modernizing enterprise data warehouses and business intelligence environments with open-source tools (desirable)
- Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure) (desirable)
- Performing real-time data visualization and time series analysis using open-source and commercial solutions (desirable)
Responsibilities
- Face numerous business-impacting challenges
- Use state of the art technologies
- Be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT
- Work alongside Developers, Tech Leads, and Architects to build solutions that transform users’ experience
- Impact the core of business by improving existing architecture or creating new ones
- Create scalable and high availability solutions, contribute to the key differential of each client
View Full Description & ApplyYou'll be redirected to the employer's site
