Senior Data Developer (Databricks / MongoDB)
New
J
JobgetherData Engineering
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLKafkaMongoDBSparkCI/CDDatabricksMLOpsPySpark
Requirements
- Solid experience as a Data Engineer, Senior Data Engineer, or equivalent role.
- Strong knowledge of Python applied to data engineering, automation, analytics, and AI-related solutions.
- Advanced SQL skills and experience working with structured data exploration and manipulation.
- Strong knowledge of MongoDB and non-relational database environments.
- Hands-on experience with Databricks, PySpark, and Spark.
- Experience building, optimizing, and supporting scalable data pipelines.
- Experience working with cloud environments, preferably Azure Databricks.
- Knowledge of near-real-time data processing, preferably with Kafka.
- Experience deploying machine learning models in Databricks environments and applying MLOps practices.
- Experience with CI/CD pipelines, especially GitHub and GitHub Actions.
- Knowledge of data engineering best practices, including version control, testing, code reviews, and data quality management.
Responsibilities
- Design, develop, and maintain scalable data pipelines for data ingestion, processing, transformation, and integration.
- Build and optimize solutions using Databricks, Python, PySpark, Spark, and SQL.
- Develop workflows that enable the availability of reliable data for business and technology consumers.
- Work with structured and non-structured data sources, including relational databases and MongoDB environments.
- Monitor pipelines and data processes, identifying and resolving operational issues proactively.
- Implement performance improvements and contribute to the continuous evolution of data architecture.
- Develop and maintain CI/CD practices, ensuring proper version control, testing, and code quality.
- Collaborate on machine learning model operationalization and MLOps practices within data platforms.
View Full Description & ApplyYou'll be redirected to the employer's site
