Data Engineering Lead

Posted about 2 months agoViewed
180000 - 240000 USD per year
United StatesFull-TimeHealth Tech
Company:Arbiter AI
Location:United States
Languages:English
Seniority level:Lead, 8+ years
Experience:8+ years
Skills:
LeadershipProject ManagementPythonSQLApache AirflowCloud ComputingGCPSoftware ArchitectureAlgorithmsData engineeringData StructuresCI/CDRESTful APIsMicroservicesCollaborationMentoringData modelingCross-functional collaboration
Requirements:
8+ years of hands-on experience in Data Engineering, Data Infrastructure, or building Data Engineering Tools. Proven experience in a technical leadership role, mentoring engineers and leading projects. Exceptional expertise in data structures, algorithms, and distributed systems. Mastery in Python for large-scale data processing. Extensive experience designing and building fault-tolerant data pipelines (batch and real-time streaming). Profound hands-on experience with cloud-native data platforms, especially Google Cloud Platform (GCP) services like BigQuery, Dataflow, Composer, Dataproc. Demonstrated experience with modern data orchestration (e.g., Airflow), data transformation (dbt), and data warehousing. Experience with project management and breaking down complex problems. Intimate knowledge of unit, integration, and functional testing strategies. Friendly communication skills and ability to work well in a diverse, cross-functional setting. Demonstrated experience leading a software product or component vision and delivery plan.
Responsibilities:
Lead the design and build of data processing systems (batch and real-time streaming). Oversee the data engineering roadmap, guide team members, and manage project timelines. Mentor and develop data engineers, set technical standards, and enforce best practices. Drive data model design for optimal storage, retrieval, and analytical performance. Champion the development of core data platform tooling and frameworks. Partner with stakeholders to understand data needs and deliver solutions. Assist engineering leadership in hiring and onboarding new team members.
About the Company
Arbiter AI
View Company Profile
Similar Jobs:
Posted 6 months ago
United States, CanadaFull-TimeSoftware Development
Forbes Advisor - Data Engineering Lead
Company:Nexthire
Posted about 1 month ago
United States, California, New York, NevadaFull-TimeCannabis Wholesale
Engineering Lead
Company:NABIS
Posted about 1 month ago
California, New York, NevadaFull-TimeCannabis Technology
Engineering Lead