Principal Data Engineer

View full description

Requirements:

• Bachelor's or master's degree in computer science, Information Technology, or a related field.
• 12+ years of experience in data architecture, data engineering, or similar roles, with a focus on cloud technologies and data platforms.
• Proven experience in designing and scaling highly available data platforms, including data warehouses, data lakes, operational reporting, data science, and integrated data stores.
• Strong expertise in modern data stack: Cloud data technologies (Databricks, Snowflake), data storage formats (Parquet, etc.), and query engines.
• Extensive experience in data modeling, ETL processes, and both batch and real-time analytics frameworks.
• Familiarity with modernizing data architectures and managing complex data migrations.
• Proficiency in SQL and strong knowledge/proven experience with programming languages such as Python, Java, Scala, and tools like Airflow, dbt, and CI/CD tools (Git, Jenkins, Terraform).
• Experience with streaming platforms like Kafka and integrating with BI tools like PowerBI, Tableau, or Looker.
• Advanced analytical and problem-solving skills, with the ability to conduct complex data analysis and present findings in a clear, actionable way.
• Strong communication and collaboration skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Strong management experience, particularly in managing and mentoring technical teams, and driving large-scale, cross-functional data initiatives.
• Ability to work in a fast-paced, dynamic environment, managing multiple projects effectively and meeting deadlines.
• A mindset focused on innovation and continuous improvement, with a track record of initiating and running projects that have significantly improved data processes or outcomes.

Responsibilities:

• Play a key role in defining and executing the data strategy for the organization, driving innovation, and influencing business outcomes through advanced data solutions.
• Architect, design, and implement scalable data solutions that support diverse business needs across the organization.
• Take full ownership of the entire data pipeline, from data ingestion and processing to storage, management, and delivery, ensuring seamless integration and high data quality.
• Stay ahead of industry trends and emerging technologies, researching and experimenting with new tools, methodologies, and platforms to continually enhance the data infrastructure.
• Drive the adoption of cutting-edge technologies that align with the company’s strategic goals.
• Leverage cloud platforms to ensure the scalability, performance, and reliability of our data infrastructure.
• Optimize databases through indexing, query optimization, and schema design, ensuring high availability and minimal downtime.
• Run the modernization of existing data architectures, implementing advanced technologies and methodologies.
• Plan and execute complex migrations to cutting-edge platforms, ensuring minimal disruption and high data integrity.
• Work closely with various departments, including Data Science, Analytics, Product, Compliance, and Engineering, to design cohesive data models, schemas, and storage solutions.
• Translate business needs into technical specifications, driving projects that enhance customer experiences and outcomes.
• Create and set best practices for data ingestion, integration, and access patterns to support both real-time and batch-based consumer data needs.
• Implement and maintain robust data governance practices to ensure compliance with data security and privacy regulations.
• Establish and enforce standards for data ingestion, integration, processing, and delivery to ensure data quality and consistency.
• Mentor and guide junior team members, fostering a culture of continuous improvement and technical excellence.
• Develop detailed documentation to capture design specifications and processes, ensuring ongoing maintenance is supported.
• Manage design reviews to verify that proposed solutions effectively resolve platform and stakeholder obstacles while adhering to business and technical requirements.
• Craft and deliver clear communications that articulate the architectural strategy and its alignment with the company's goals.