Working Student in Visual Representation of Technical Diagrams for LLMs - remote possible

Education: Master studies in Computer Science, Data Science or a comparable field. Experience and Knowledge: Proficiency in Python, prior experience in building RAG systems or chatbots is ideal. Personality: Self-driven, proactive, solution-oriented individual with an independent work ethic. Enthusiasm: Strong passion for developing optimal solutions. Languages: Fluent in English.

Research optimal methods for processing and representing technical diagrams for integration with LLMs. Design and implement a pipeline for creating a synthetic dataset linking technical diagrams to textual descriptions. Investigate how synthetic dataset quality influences model training and performance. Test trained models on real-world technical diagrams from various domains. Develop metrics to assess model interpretation and outputs. Conduct comparative analysis of multi-modal models' strengths and weaknesses with technical diagrams. Explore an abstract markup syntax to improve model interpretability and efficiency.