Senior Data Engineer

New
S
S5 StratosSaaS AI/ML
United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Required Skills
PythonSQLBashCloud ComputingETLGCPGitRESTful APIsData modeling

Requirements

  • Expert-level understanding of relational databases (columnar and row-based)
  • Expertise in SQL
  • Proven hands-on experience building complex ETLs with large-scale, complex datasets
  • Scripting experience in Python and bash shell
  • Fully proficient in pipeline building and job automations
  • Proficiency with Git
  • Experience building RESTful APIs
  • Experience with error handling and data validation
  • Experience working in GCP or other cloud platforms
  • Bachelors in Computer Science, Engineering or similar

Responsibilities

  • Develop and automate large scale, high-performance data processing systems (batch and/or streaming)
  • Translate business needs into data models: implement data strategies, build data flows and develop conceptual data models
  • Implement deployment and infrastructure automation strategies
  • Build data support for experimentation efforts, from statistical test automation to real-time M/L pipelines
  • Automate manual processes, optimize data delivery, and re-design infrastructure for scalability
  • Promote data modeling standardization and drive adoption
  • Build analytics and reporting tools utilizing the data pipeline
  • Maintain and improve existing ETL pipelines
  • Perform routine maintenance and upgrades of server architecture
  • Collaborate with stakeholders to assist with data-related technical issues
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now