Senior Data Engineer

Commercial experience developing Spark Jobs using Scala Commercial experience using Java and Scala (Python nice to have) Experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS - S3) Experience designing data models and data warehouses Hands-on experience applying Gen AI tools to accelerate coding, debugging, or system design Strong understanding and application of data structures and algorithms Experience in SQL, NoSQL database management systems (PostgreSQL and Cassandra) Commercial experience using messaging technologies (RabbitMQ, Kafka) Experience using orchestration software (Chef, Puppet, Ansible, Salt) Confident in building complex ETL workflows (Luigi, Airflow) Good knowledge of working with cloud technologies (AWS, GCP) Good knowledge of using monitoring software (ELK stack) Motivated problem-solving skills, ability to bring ideas forward and adapt solutions to complex challenges

Understand distributed technologies and best practices Build and maintain services/features/libraries as examples for new engineers Design and write effective, complex Spark jobs Design and write complex asynchronous, highly parallel, low-latency APIs and processes Use Gen AI tools to boost speed, quality, and team efficiency Maintain, improve, and monitor data collection processes using Scala and Java Apply industry practices like TDD and SOLID Understand and apply data structures and algorithms Understand Adthena's data architecture and use appropriate design patterns Design and implement databases for relational and non-relational storage technologies Support Data Science team in deploying machine learning models Be empathetic towards team members and customers