Data Engineer (SC Clearance)

Posted 20 days agoViewed
United KingdomContractConsultancy, Technology
Company:Default Portal
Location:United Kingdom
Languages:English
Skills:
AWSPythonETLSpark
Requirements:
Strong experience with AWS EMR and other AWS data services (Glue, S3, Lambda, Redshift, Athena, etc.) Proficiency in Python and PySpark for big data processing Hands-on experience working with distributed computing frameworks such as Spark Ability to take ownership of tasks, work autonomously, and engage confidently with stakeholders Previous experience working on government or public sector projects Proven track record of working in client-facing consulting roles Strong analytical and troubleshooting skills
Responsibilities:
Design, develop, and optimize ETL/ELT pipelines using AWS EMR, Python, and PySpark Build and manage scalable data processing solutions on AWS, leveraging services such as S3, Lambda, Glue, and Redshift Work with large-scale datasets in distributed computing environments Develop scripts to automate data ingestion, transformation, and validation processes Work closely with clients, data scientists, and business analysts Provide strategic guidance on best practices in data engineering and analytics within the public sector Implement data validation, monitoring, and governance best practices
Similar Jobs:
Posted 11 months ago
United KingdomContract
SC Cleared Devops Engineer
Posted about 1 year ago
England, GBFull-TimeTechnology consultancy
AWS DevOps Engineer (SC Cleared)
Posted 20 days ago
United Kingdom, EuropeContractTechnology Consultancy
Java Developer (SC Cleared)