Mid-Level/Senior Data Engineer
New
C
CI&TData engineering
Listing location: Brazil; Workplace type: RemoteFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PostgreSQLPythonSQLApache Kafka
Requirements
- Know OCI Streaming or Apache Kafka.
- Have PostgreSQL schema and performance knowledge.
- Use Python for data processing.
- Have advanced SQL skills.
- Understand transactional and event-driven data modeling.
- Have experience with AI.
- Have cloud experience.
- Oracle Autonomous Database knowledge is desirable.
- OCI Object Storage Lifecycle knowledge is desirable.
- Data governance and LGPD knowledge is desirable.
- Redis for semantic caching knowledge is desirable.
- Langfuse integration experience is desirable.
Responsibilities
- Build and maintain the asynchronous data pipeline connecting service channels to intelligence systems.
- Ensure the integrity, durability, and governance of data flowing through OCI Streaming.
- Model schemas for service events.
- Implement idempotent consumers in Python.
- Manage the lifecycle of audio and transcription objects in Object Storage.
- Mask PII in traces and logs to support LGPD compliance.
View Full Description & ApplyYou'll be redirected to the employer's site
