AI Software Engineer

View full description

Requirements:

• At least four years of proven experience in a data engineer role.
• A degree in Computer Science, Applied Math, Informatics, Information Systems or similar.
• Experience building processes for data transformation, data structure, metadata, dependency, and workload management.
• Advanced working knowledge of relational databases and familiarity with SQL and NoSQL.
• Experience building and optimizing data pipelines and architectures.
• Proficient in Python or Scala.
• Experience with distributed computing and object-oriented design.
• Knowledge of pipeline and workflow management tools (e.g., Airflow, Argo Workflows).
• Experience with CI/CD tools (e.g., Jenkins, Travis, Argo CD, Terraform).
• Good understanding of Cloud and data models (data warehouse, data lake).
• Experience with MLOps and HPC is a plus.

Responsibilities:

• Create and maintain optimal data pipeline architectures.
• Assemble large, complex data sets that meet functional and business requirements.
• Identify, design, and implement improvements to internal practices such as automating manual processes.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from various sources.