Apply

Data Engineer SR - Apache Flink

Posted 14 days agoViewed

View full description

💎 Seniority level: Senior

📍 Location: Brazil

🔍 Industry: Software Development

🏢 Company: Encora👥 10001-10001💰 $200,000,000 Private over 5 years agoBig DataCloud ComputingSoftware

🪄 Skills: DockerPythonSQLGCPGitJavaKafkaKubernetesData engineeringCI/CDData modeling

Requirements:
  • Experience as a Data Engineer
  • Strong experience with Apache Flink, including knowledge of the DataStream and Table APIs
  • Experience with Kafka and Kafka Connect for data integration · Experience with containerization (Docker) and orchestration (Kubernetes)
  • Experience in Cloud Infrastructure platforms such as AWS, GCP
  • Solid SQL skills with specific experience in BigQuery SQL dialect
  • Experience with data modeling and schema design
  • Proficient in at least one programming language (Java or Python)
  • Experience with version control systems (Git) and CI/CD pipelines
Responsibilities:
  • Design, develop, and optimize data pipelines using Apache Flink for stream and batch processing
  • Implement and maintain Kafka Connect connectors for seamless data integration
  • Build and maintain data infrastructure on Google Cloud Platform (GCP)
  • Design and optimize BigQuery tables, views, and stored procedures
  • Collaborate with product managers and analysts to understand data requirements
  • Ensure data quality, reliability, and proper governance
  • Troubleshoot and resolve data pipeline issues
  • Document data flows, transformations, and architecture
Apply