Senior Data Engineer, AI/ML Platforms
New
J
JobgetherIT Security
Based in the United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5–7 years
- Required Skills
- AWSPythonSQLETLGCPAzureSpark
Requirements
- 5–7 years of relevant professional experience in data engineering or a closely related technical discipline.
- Bachelor’s degree in a relevant field.
- Strong experience working with agile methodologies.
- Proven track record in designing and building large, complex data pipelines.
- Advanced SQL scripting skills.
- Hands-on experience with relational databases such as SQL Server and Oracle.
- Experience with cloud platforms like AWS, Azure, or Google Cloud Platform and associated ETL tools.
- Strong programming expertise in Python and Apache Spark.
- Advanced knowledge of large-scale, distributed data processing engines.
- Knowledge of database security, data governance, and compliance controls.
- Strong documentation skills with the ability to translate business needs into technical specifications.
Responsibilities
- Collaborate with data architects, analysts, and business stakeholders to document requirements for pipelines and automation.
- Design, build, document, test, deploy, and maintain scalable data pipelines using engineering best practices.
- Develop systems for processing large volumes of data across multiple platforms and structures.
- Execute ETL/ELT operations while adhering to enterprise governance and security standards.
- Implement data quality processes, including validation and anomaly detection to ensure accuracy.
- Provide technical guidance and mentorship to junior engineers and peers.
- Create clear technical documentation for pipelines, processes, and integrations.
View Full Description & ApplyYou'll be redirected to the employer's site
