Big Data Architect

Posted 20 days agoViewed

📍 Location: Canada, United States, Latin America

🔍 Industry: Cloud services and data engineering

🏢 Company: Caylent👥 251-500💰 Private about 2 years agoIaaS DevOps Cloud Computing Cloud Infrastructure

🗣️ Languages: English

🪄 Skills: AWSAgileElasticSearchETLHadoopKafkaRabbitmqAmazon Web ServicesData engineeringRedisNosqlSparkCommunication SkillsCI/CDDevOpsTerraformCompliance

Requirements:

Design and implementation of at least two of the following: ETL, Orchestration and CI/CD pipelines; Data Lakes; Data Warehouses; Analytics and visualization.
Design and implementation of at least two of the following: Data processing (Hadoop, Spark, EMR); Streaming/Messaging (Kafka, RabbitMQ, Kinesis); NoSQL DBs (KeyValue stores, Document Databases, Graph Databases); Caching (Redis, Memcache); Search (ElasticSearch, Solr).
Design and implementation of at least one of the following: Large scale application migration and modernization; Security, access controls and governance on cloud.
Experience with IaC tools such as CloudFormation, CDK, Terraform.
Experience with AWS Glue, Lambda, SDK.
Experience with CI/CD tools.
Excellent written and verbal communication skills.

Responsibilities:

Work with a team to deliver top-quality data solutions on AWS for customers.
Participate in daily standup meetings and address technical issues.
Design, optimize, and migrate web-scale data processing operations.
Write code whenever needed and possible.
Lead and help engineers without any direct supervision.

Apply