Senior Data Engineer
New
T
ThoughtworksData engineering
Location: Raleigh, North Carolina, USA; No. of days in office: Fully RemoteFull-TimeSenior
Salary134,000 - 203,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLETLSnowflakeData modelingBigQueryDatabricks
Requirements
- Build and operate data pipelines and maintain data storage within distributed systems.
- Have hands-on experience with data modeling and modern data engineering tools and platforms.
- Have experience writing clean, high-quality code using a preferred programming language.
- Have built and deployed large-scale data pipelines and data-centric applications using distributed storage and processing platforms in production.
- Have experience with data visualization techniques and communicating insights to different audiences.
- Have experience using data-driven approaches and applying data security and privacy strategies to business problems.
- Have experience with databases, including SQL, NoSQL, data lakes, and data schemas.
- Have experience with Python, SQL, ETL/data pipelines, and Databricks.
- Have experience with modern data warehousing, data lakes, or Delta lakes, including Snowflake, Redshift, or BigQuery.
- Have experience with one or more major cloud platforms: AWS, Azure, or GCP.
- Have experience with machine learning, AI, generative AI, or LLMs.
- Be able to manage stakeholders and liaise with clients and other project stakeholders.
Responsibilities
- Develop and operate modern data architecture approaches to meet business objectives and provide end-to-end data solutions.
- Build intricate data processing pipelines to address client problems.
- Collaborate with data scientists to design scalable implementations of their models.
- Write clean, iterative code using TDD and use continuous delivery practices to deploy, support, and operate data pipelines.
- Use distributed storage and computing technologies.
- Select data modeling techniques and implement data models using appropriate technology stacks.
- Collaborate with the team on data governance, data security, and data privacy.
- Incorporate data quality into day-to-day work.
View Full Description & ApplyYou'll be redirected to the employer's site
