Associate Data Engineer
New
B
BeyondTrustIdentity security
Remote United StatesFull-TimeJunior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSparkCI/CDDatabricksDistributed Systems
Requirements
- Have programming and technology knowledge in cloud data processing.
- Have experience with data warehousing for analytics use cases.
- Be proficient in Python or another object-oriented programming language.
- Have experience with a distributed processing framework.
- Have experience working with distributed systems and data processing on object stores.
- Have an understanding of software engineering principles, data structures, and distributed data processing concepts.
- Have Spark experience; Databricks knowledge is a plus.
- Realtime processing experience is highly preferred.
- Some experience with graph data stores is ideal.
- Demonstrate an ability to learn quickly and a strong desire to develop.
- Have an interest in cybersecurity; an interest in identity security is preferred.
- Be able to work autonomously and collaboratively.
Responsibilities
- Contribute to data modelling for identity security use cases and analytical requirements.
- Develop and maintain data pipelines that bring together information from disparate systems for security analysis in the data lake.
- Optimize data workloads by improving processing efficiency.
- Work with senior engineers to identify and implement process improvements.
- Apply monitoring and observability practices to support pipeline performance.
- Assist with ML operations to support model efficiency.
- Use CI/CD practices to develop and release source code.
- Participate in code reviews and collaborate with team members to improve engineering practices.
View Full Description & ApplyYou'll be redirected to the employer's site
