Big Data Architect
Company:Caylent
Location:Canada, United States, Latin America, EST, PST
Languages:English
Skills:
AWSAgileElasticSearchETLHadoopKafkaSoftware ArchitectureData engineeringRedisNosqlSparkCI/CDDevOps
Requirements:
Experience designing and implementing at least two of: ETL, orchestration, CI/CD pipelines; Data lakes, data warehouses; Analytics and visualization Experience with at least two of: Hadoop, Spark, EMR; Streaming/Messaging (Kafka, RabbitMQ, Kinesis); NoSQL (document, graph, or key-value stores); Caching (Redis, memcache); Search (Elasticsearch, Solr) Experience with at least one of: Legacy data modernization; Cloud security and governance Familiarity with IaC tools and AWS data services (Glue, Lambda)
Responsibilities:
Guide Cayliens and Customers through Agile ceremonies Translate customer requirements into a backlog of tickets Delegate tickets to engineers Lead requirements gathering, backlog grooming, and architecture discussions Apply understanding of DevOps pipelines Troubleshoot and resolve issues in customer environments Automate software testing Write production quality code with tests Deliver cloud-native applications on AWS Communicate and document designs, processes, and procedures Mentor peers and learn new technologies Coach and mentor less experienced teammates
