Sr. Data Engineer

Posted 2 months agoViewed
United StatesFull-TimeMarketing Technology
Company:Channel Factory
Location:United States
Languages:English
Seniority level:Senior, 7+ years
Experience:7+ years
Skills:
AWSPostgreSQLPythonSQLETLRabbitmqData modeling
Requirements:
7+ years of experience in data engineering or related roles Proven track record of building and maintaining scalable data pipelines in production Experience designing and developing large-scale, efficient batch and streaming data processing pipelines Strong SQL proficiency, with experience in both transactional RDBMS systems and distributed systems Expert-level proficiency in Python In-depth experience with distributed data technologies: RabbitMQ, Celery, Pyspark In-depth experience with AWS data services (ECS, EC2, Glue, OpenSearch, RDS) Experience with modern Data Lakehouse technologies such as: Apache Iceberg, S3 Tables, StarRocks Knowledge of digital advertising is a plus
Responsibilities:
Modernize core ETL processes by refactoring existing Python / OpenSearch / SQL (PostgreSQL) based ETL systems to land data in our Data Lakehouse (Apache Iceberg) Collaborate with product managers and business stakeholders to understand complex business requirements to translate business needs into well-designed and maintainable solutions Ensure data quality and reliability by implementing robust data quality checks, monitoring, and alerting to ensure the accuracy and timeliness of all data pipelines Create data governance policies and develop data models and schemas optimized for analytical workloads Influence the direction for key infrastructure and framework choices for data pipelining and data management Manage complex initiatives by setting project priorities, deadlines, and deliverables Collaborate effectively with distributed team members across multiple time zones, including offshore development teams Build relationships and foster team cohesion across geographical and cultural boundaries
Similar Jobs:
Posted 2 days ago
United StatesFull-TimeSoftware Development
Senior Full Stack Engineer
Company:Five9
Posted 2 days ago
United StatesFull-TimeSoftware Development
Software Engineer
Company:Socket
Posted 2 days ago
United States, CanadaFull-TimeHealthcare Technology
AI Solutions Engineer (Remote Opportunity)
Company:VetsEZ