AI Researcher - (Infrastructure)

View full description

Requirements:

• Proficiency in writing and optimising high-performance code. Especially in Python
• Experience with AWS services, particularly S3 and using Terraform.
• Experience with database management (SQL and NoSQL).
• Knowledge of managing headless servers and automation in Bash.
• Familiarity with integrating APIs from various providers.
• Highly adaptable and comfortable working in a team that requires rapid iteration.

Responsibilities:

• Design and implement reusable modules and tools for AI research projects, including custom workflow prototypes using ComfyUI nodes.
• Create and optimise high-performance code, ensuring efficient execution for R&D tasks.
• Collaborate with DevOps to integrate AWS services into research tooling using reusable modules.
• Implement and maintain automated systems for data collection from websites and online platforms.
• Maximise throughput in the ETL (Extract, Transform, Load) pipeline, optimising I/O bandwidth across threads and implementing efficient storage mechanisms.
• Manage network configurations, including proxies, SSH, NAT management, and VPNs, to ensure smooth data acquisition processes.
• Optimise existing code and workflows to improve performance and efficiency.
• Collaborate with teams to ensure best practices in handling large datasets and efficient data processing.
• Work with geographically dispersed AI Research teams to support ongoing research projects.
• Identify opportunities to create and implement reusable tooling for AI research.
• Work independently, managing deadlines and delivering high-quality solutions.