Senior HPC Data Engineer

Posted 7 days agoViewed

View full description

💎 Seniority level: Senior, 3+ years

📍 Location: Argentina, Brazil, Bulgaria, Colombia, Poland, Romania

🔍 Industry: Data Engineering

🏢 Company: N-iX👥 1001-5000 IT Services and IT Consulting

🗣️ Languages: English

⏳ Experience: 3+ years

🪄 Skills: PythonSQLFortranC++Data engineeringData Structures

Requirements:

Bachelor's or Master's in Computer Science or related field
3+ years experience in developing data services for HPC
Expertise with HDF5 in parallel I/O operations
Strong proficiency in C++, Python, GoLang, or Fortran
In-depth knowledge of HDF5 APIs
Experience with MPI I/O, POSIX I/O or similar frameworks
Skills in profiling I/O operations
Proficiency in SQL and any RDMS

Responsibilities:

Design and implement the data service module using HDF5
Develop parallel and concurrent I/O mechanisms
Ensure integration with HPC workflows
Optimize I/O for CPU/GPU workflows
Implement caching and compression strategies
Design data structures for simulation outputs
Ensure data integrity during concurrent operations
Develop test cases for performance validation
Conduct benchmarking for scalability
Document architecture and APIs
Provide technical support for data integration