Tech Lead - Data Platform
BrazilFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonApache AirflowJavaKubernetesData engineeringSparkCI/CDDistributed Systems
Requirements
- Proven experience in technical leadership or engineering management, with a strong focus on mentoring and team development.
- Strong proficiency in Python and Java, applied to backend systems and data engineering environments.
- Advanced experience with Apache Spark (PySpark/Scala) for large-scale data processing.
- Advanced experience with Apache Airflow for workflow orchestration.
- Hands-on experience with Google BigQuery and Bigtable, including data modeling and query optimization.
- Solid understanding of cloud infrastructure and DevOps practices, including Kubernetes and CI/CD pipelines (GitLab/GitHub).
- Ability to design distributed systems with high availability, scalability, and performance in mind.
- Strong communication skills to translate complex business requirements into technical solutions and collaborate across technical and non-technical stakeholders.
- Critical mindset focused on code quality, innovation, and continuous process improvement.
Responsibilities
- Lead, mentor, and support a team of software and data engineers, fostering a culture of technical excellence, collaboration, and continuous learning.
- Define, prioritize, and manage technical tasks, adapting agile methodologies to improve delivery efficiency and team performance.
- Conduct code reviews and actively guide engineers in adopting best practices, design patterns, and high engineering standards.
- Define and evolve the technical vision and architecture for systems integrating backend services, data pipelines, and infrastructure components.
- Ensure the selection of appropriate technologies, evaluating trade-offs related to scalability, performance, cost, and maintainability.
- Design, build, and optimize scalable ETL/ELT data pipelines supporting Feature Store datasets and Machine Learning applications.
- Develop and maintain robust, high-performance APIs and web services for data consumption and system integration.
View Full Description & ApplyYou'll be redirected to the employer's site