Data Engineer

Posted 2024-10-15

View full description

💎 Seniority level: Senior, 5-7 years

📍 Location: United States

💸 Salary: $45/hr - $75/hr

🔍 Industry: Consulting

🏢 Company: Sand Cherry Associates

🗣️ Languages: English

⏳ Experience: 5-7 years

🪄 Skills: PythonSQLETLMicrosoft AzureAzureData engineeringCommunication SkillsAnalytical SkillsCollaboration

Requirements:

Bachelor's degree in Computer Science or related field
5-7 years of experience in data management, database architecture, data modeling
Proficiency in using Azure, XML, SQL
Proficiency in ETL and ELT tools and techniques
Excellent scripting and programming skills including Python and R
Proven ability to work with team members in a robust BI environment
Proven ability to document and adhere to business requirements
Proven ability to communicate with clients at any level
Proven professional business acumen
Data-oriented, well-organized and detail oriented individual
Ability to work independently, be succinct in communication and deliver insightful data

Responsibilities:

Responsible for the design, structure, and maintenance of data, usually organized in relational databases.
Determines end user requirements for data usage including analytics and visualization.
Ensures the accuracy and accessibility of data relevant to client’s organization or project.
Identifies and creates connections to relevant data sources from within the organization as well as third party sources including government data sources.
Assists in defining how data will be stored, consumed, integrated, and managed by different data entities.
Assesses existing data architecture and data management processes to determine gaps and means of optimization.
Supports BI reporting and analytic requirements including GIS data visualization.
Defines supplemental data collection methods including manual survey processes as necessary.
Defines user access models for internal and public models and techniques to allow user inquiry and presentation of quantitative and visual findings from data analytics.
Leverages strong skills in data modeling and logic.
Creates effective quality and data integrity standards and processes.
Creates vision and documents resource requirements for organizational structure to support all phases of client data initiatives.

Apply

Related Jobs

Apply

🔥 Senior Data Engineer

Posted 2024-11-24

📍 United States, Latin America, India

🧭 Full-Time

🔍 Modern data stack and cloud data services

At least 4+ years experience as a Software Engineer, Data Engineer, or Data Analyst.
Ability to develop end-to-end technical solutions in production environments.
Proficient in Java, Python, or Scala.
Experience with core cloud data platforms like Snowflake, AWS, Azure, Databricks, and GCP.
Strong SQL skills, capable of writing, debugging, and optimizing queries.
Client-facing communication skills for presentations and documentation.
Bachelor's degree in Computer Science or a related field.

Develop end-to-end technical solutions and ensure their performance, security, and scalability.
Help with robust data integration and contribute to the production deployment of solutions.
Create and deliver detailed presentations to clients.
Document solutions including POCs, roadmaps, diagrams, and logical system views.

AWSPythonSoftware DevelopmentSQLElasticSearchGCPHadoopJavaKafkaSnowflakeAirflowAzureCassandraElasticsearchNosqlSparkCommunication SkillsDocumentation

Posted 2024-11-24

Apply

🔥 Lead Data Engineer (SAP)

Posted 2024-11-23

📍 North America, Latin America, Europe

🔍 Data Consultancy

Bachelor’s degree in engineering, computer science or equivalent area.
5+ years in related technical roles, including data management, database development, ETL, and data warehouses.
Experience with data ingestion technologies and architectural decisions for high-throughput frameworks.
Familiarity with Snowflake, SAP, AWS, Azure, GCP, and relevant ETL tools.

Develop database architectures and data warehouses.
Ensure optimal data delivery architecture throughout ongoing customer projects.
Lead technical teams in data system optimization and development.

AWSLeadershipPythonSQLAgileETLOracleSAPSnowflakeData engineeringSparkCollaborationProblem Solving

Posted 2024-11-23

Apply

🔥 Data Engineer (Remote in US)

Posted 2024-11-23

📍 US

💸 84000 - 120000 USD per year

🔍 Consumer insights

Strong PL/SQL, SQL development skills.
Proficient in multiple data engineering languages such as Python and Java.
3-5 years of experience in data engineering specific to Oracle and MS SQL.
Experience with data warehousing technologies and cloud-based services like Snowflake.
Experience with cloud platforms such as Azure and infrastructure knowledge.
Familiarity with data orchestration tools like Azure Data Factory and DataBricks workflows.
Understanding of data privacy regulations and best practices.
Experience working on a remote team.
Familiarity with CI/CD processes and tools like Git, Jira.

Design, implement, and maintain scalable data pipelines and architecture.
Unit test and document solutions to meet product quality standards.
Identify and resolve performance bottlenecks in data pipelines.
Implement data quality checks and validation processes.
Collaborate with cross-functional teams to address data needs.
Ensure technology solutions support customer and organizational needs.
Define and document technical requirements.

PythonSQLETLGitJavaOracleQASnowflakeJiraAzureData engineeringCI/CD

Posted 2024-11-23

Apply

🔥 Senior Data Engineer

Posted 2024-11-22

📍 Ontario

🔍 Customer engagement platform

🏢 Company: Braze

5+ years of hands-on experience in data engineering, cloud data warehouses, and ETL development.
Proven expertise in designing and optimizing data pipelines and architectures.
Strong proficiency in advanced SQL and data modeling techniques.
A track record of leading impactful data projects from conception to deployment.
Effective collaboration skills with cross-functional teams and stakeholders.
In-depth understanding of technical architecture and data flow in a cloud-based environment.
Ability to mentor and guide junior team members on best practices for data engineering and development.
Passion for building scalable data solutions that enhance customer experiences and drive business growth.
Strong analytical and problem-solving skills, with a keen eye for detail and accuracy.
Extensive experience working with and aggregating large event-level data.
Familiarity with data governance principles and ensuring compliance with industry regulations.
Preferable experience with Kubernetes for container orchestration and Airflow for workflow management.

Lead the design, implementation, and monitoring of scalable data pipelines and architectures using tools like Snowflake and dbt.
Develop and maintain robust ETL processes to ensure high-quality data ingestion, transformation, and storage.
Collaborate closely with data scientists, analysts, and other engineers to design and implement data solutions that drive customer engagement and retention.
Optimize and manage data flows and integrations across various platforms and applications.
Ensure data quality, consistency, and governance by implementing best practices and monitoring systems.
Work extensively with large-scale event-level data, aggregating and processing it to support business intelligence and analytics.
Implement and maintain data products using advanced techniques and tools.
Collaborate with cross-functional teams including engineering, product management, sales, marketing, and customer success to deliver valuable data solutions.
Continuously evaluate and integrate new data technologies and tools to enhance our data infrastructure and capabilities.

SQLBusiness IntelligenceETLSnowflakeData engineeringCollaborationCompliance

Posted 2024-11-22

Apply

🔥 Senior Data Engineer

Posted 2024-11-22

📍 United States of America

💸 90000 - 154000 USD per year

🏢 Company: VSPVisionCareers

Bachelor’s degree in computer science, data science, statistics, economics or related area.
Excellent written and verbal communication skills.
6+ years of experience in development teams focusing on analytics.
6+ years of hands-on experience in data preparation and SQL.
Knowledge of data architectures like event-driven architecture and real-time data.
Familiarity with DataOps practices and multiple data integration platforms.

Design, build, and optimize data pipelines for analytics.
Collaborate with multi-disciplinary teams for data integration.
Analyze data requirements to develop scalable pipeline solutions.
Profile data for accuracy and completeness in data gathering.
Drive automation of data tasks to enhance productivity.
Participate in architecture and design reviews.

AWSSQLAgileETLKafkaOracleSCRUMSnowflakeApache KafkaData scienceData StructuresCommunication SkillsCollaboration

Posted 2024-11-22

Apply

🔥 Data Engineer (Remote in US)

Posted 2024-11-21

📍 United States

🔍 Consumer insights

Strong PL/SQL and SQL development skills.
Proficient in Python and Java.
3-5 years of experience in Data Engineering with Oracle and MS SQL.
Experience with cloud services like Snowflake and Azure.
Familiar with data orchestration tools such as Azure Data Factory and DataBricks.
Understanding of data privacy regulations.

Design, implement and maintain scalable data pipelines and architecture.
Unit test and document solutions that meet product quality standards.
Identify and resolve performance bottlenecks in data processing workflows.
Implement data quality checks to ensure accuracy and consistency.
Collaborate with cross-functional teams to address data needs.

PythonSQLETLGitJavaOracleQASnowflakeJiraAzureData engineeringCI/CD

Posted 2024-11-21

Apply

🔥 Staff Data Engineer, Ads

Posted 2024-11-21

📍 US

🧭 Full-Time

💸 206700 - 289400 USD per year

🔍 Social media / Online community

MS or PhD in a quantitative discipline: engineering, statistics, operations research, computer science, informatics, applied mathematics, economics, etc.
7+ years of experience with large-scale ETL systems, building clean, maintainable, object-oriented code (Python preferred).
Strong programming proficiency in Python, SQL, Spark, Scala.
Experience with data modeling, ETL concepts, and manipulating large structured and unstructured data.
Experience with data workflows (e.g., Airflow) and data visualization tools (e.g., Looker, Tableau).
Deep understanding of technical and functional designs for relational and MPP databases.
Proven track record of collaboration and excellent communication skills.
Experience in mentoring junior data scientists and analytics engineers.

Act as the analytics engineering lead within Ads DS team and contribute to data science data quality and automation initiatives.
Ensure high-quality data through ETLs, reporting dashboards, and data aggregations for business tracking and ML model development.
Develop and maintain robust data pipelines and workflows for data ingestion, processing, and transformation.
Create user-friendly tools for internal use across Data Science and cross-functional teams.
Lead efforts to build a data-driven culture by enabling data self-service.
Provide mentorship and coaching to data analysts and act as a thought partner for data teams.

LeadershipPythonSQLData AnalysisETLTableauStrategyAirflowData analysisData engineeringData scienceSparkCommunication SkillsCollaborationMentoringCoaching

Posted 2024-11-21

Apply

🔥 Data Engineer (Remote in US)

Posted 2024-11-21

📍 US

🔍 Consumer insights

Strong PL/SQL and SQL development skills.
Proficient in multiple data engineering languages such as Python and Java.
Minimum 3-5 years of experience in Data engineering with Oracle and MS SQL.
Experience with data warehousing concepts and cloud-based technologies like Snowflake.
Experience with cloud platforms such as Azure.
Knowledge of data orchestration tools like Azure Data Factory and DataBricks workflows.
Understanding of data privacy regulations and best practices.
Experience working with remote teams.
Familiarity with tools like Git, Jira.
Bachelor's degree in Computer Science or Computer Engineering.

Design, implement and maintain scalable pipelines and architecture to collect, process, and store data from various sources.
Unit test and document solutions that meet product quality standards prior to release to QA.
Identify and resolve performance bottlenecks in pipelines to ensure efficient data delivery.
Implement data quality checks and validation processes.
Work with Data Architect to implement best practices for data governance, quality, and security.
Collaborate with cross-functional teams to address data needs.

PythonSQLETLGitJavaOracleQASnowflakeJiraAzureData engineeringCI/CD

Posted 2024-11-21

Apply

🔥 Senior Data Engineer

Posted 2024-11-20

📍 USA

🧭 Full-Time

💸 140000 - 160000 USD per year

🔍 Health tech

🏢 Company: Carrum Health

10+ years professional experience as a data engineer, including ownership of data products.
Proficiency with data engineering technologies including Python, PostgreSQL, AWS Athena, and Docker.
History of designing systems focused on data quality and scalability.
Experience in the healthcare space or another highly-regulated industry.
Strong interpersonal skills and the ability to work collaboratively.

Develop and maintain creative solutions to evolving challenges that span data ingestion, processing, and modeling.
Collaborate closely with internal and external stakeholders to understand data needs.
Grow and maintain pipelines that power analytics, machine learning, and data products.
Participate early in the development of data foundation and infrastructure, implementing quality control and reporting systems.
Understand HIPAA compliance and support Carrum’s success in this area.

AWSDockerPostgreSQLPythonBashETLMachine LearningRubyTableauData engineeringData scienceDevOpsCompliance

Posted 2024-11-20

Apply

🔥 QA Data Engineer

Posted 2024-11-17

📍 United States

🧭 Full-Time

💸 95000 - 110000 USD per year

🔍 Healthcare

🏢 Company: Wider Circle

Degree in Computer Science, Information Systems, or equivalent education or work experience.
3+ Years experience with AWS or similar technologies (S3, Redshift, RDS, EMR).
3+ Years strong abilities with SQL and Python.
Experience building test automation suites for test and production environments.
Experience using APIs for data extraction and updating.
Experience with Git and version control.

Develop and maintain data quality and accuracy dashboards, and scorecards to track data quality and model performance.
Develop, maintain, and enhance a comprehensive data quality framework that defines data standards, quality and accuracy expectations, and validation processes.
Enhance data quality through rapid testing, feedback, and insights.
Partner with Engineering & Product to predict data quality issues and production flaws.
Conceptualize data architecture (visually) and implement practically into logical structures.
Perform testing of data after ingesting and database loading.
Manage internal SLAs for data quality and frequency.
Provide expert support for solving complex problems of data integration across multiple data sets.
Update and evolve data ecosystem to streamline processes for maximum efficiency.

AWSPythonSQLGitProduct DevelopmentData engineering

Posted 2024-11-17

Apply

Data Engineer

Requirements:

Responsibilities:

Related Jobs

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities