Apply📍 United States
🧭 Full-Time
💸 150363.0 - 180870.0 USD per year
🔍 Software Development
🏢 Company: phData👥 501-1000💰 $2,499,997 Seed about 7 years agoInformation ServicesAnalyticsInformation Technology
- At least a Bachelors Degree or foreign equivalent in Computer Science, Computer Engineering, Electrical and Electronics Engineering, or a closely related technical field, and at least five (5) years of post-bachelor’s, progressive experience writing shell scripts; validating data; and engaging in data wrangling.
- Experience must include at least three (3) years of experience debugging data; transforming data into Microsoft SQL server; developing processes to import data into HDFS using Sqoop; and using Java, UNIX Shell Scripts, and Python.
- Experience must also include at least one (1) year of experience developing Hive scripts for data transformation on data lake projects; converting Hive scripts to Pyspark applications; automating in Hadoop; and implementing CI/CD pipelines.
- Design, develop, test, and implement Big Data technical solutions.
- Recommend the right technologies and solutions for a given use case, from the application layer to infrastructure.
- Lead the delivery of compiling and installing database systems, integrating data from a variety of data sources (data warehouse, data marts) utilizing on-prem or cloud-based data structures.
- Drive solution architecture and perform deployments of data pipelines and applications.
- Author DDL and DML SQL spanning technical tacks.
- Develop data transformation code and highly complex provisioning pipelines.
- Ingest data from relational databases.
- Execute automation strategy.
AWSPythonSQLETLHadoopJavaKafkaSnowflakeData engineeringSparkCI/CDLinuxScala
Posted 7 days ago
Apply