Apply

Senior Data Engineer - Verikai

Posted 27 days agoViewed

View full description

💎 Seniority level: Senior, at least 5 years of relevant experience

📍 Location: United States of America

💸 Salary: 110000.0 - 160000.0 USD per year

🔍 Industry: Insurance industry

🏢 Company: Verikai_External

⏳ Experience: At least 5 years of relevant experience

🪄 Skills: AWSPythonSQLDynamoDBETLSpark

Requirements:
  • Bachelor's degree or above in Computer Science, Data Science, or a related field.
  • At least 5 years of relevant experience.
  • Proficient in SQL, Python, and data processing frameworks such as Spark.
  • Hands-on experience with AWS services including Lambda, Athena, Dynamo, Glue, Kinesis, and Data Wrangler.
  • Expertise in handling large datasets using technologies like Hadoop and Spark.
  • Experience working with PII and PHI under HIPAA constraints.
  • Strong commitment to data security, accuracy, and compliance.
  • Exceptional ability to communicate complex technical concepts to stakeholders.
Responsibilities:
  • Design, build, and maintain robust ETL processes and data pipelines for large-scale data ingestion and transformation.
  • Manage third-party data sources and customer data to ensure clean and deduplicated datasets.
  • Develop scalable data storage systems using cloud platforms like AWS.
  • Collaborate with data scientists and product teams to support data needs.
  • Implement data validation and quality checks, ensuring accuracy and compliance with regulations.
  • Integrate new data sources to enhance the data ecosystem and document data strategies.
  • Continuously optimize data workflows and research new tools for the data infrastructure.
Apply