대규모 언어 모델의 최적화를 위한 지시형 미세 조정과 LoRA 결합 접근법
Instruction Fine-tuning and LoRA Combined Approach for Optimizing Large Language Models
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study introduces and experimentally validates a novel approach that combines Instruction fine-tuning and Low-Rank Adaptation (LoRA) fine-tuning to optimize the performance of Large Language Models (LLMs). These models have become revolutionary tools in natural language processing, showing remarkable performance across diverse application areas. However, optimizing their performance for specific domains necessitates fine-tuning of the base models (FMs), which is often limited by challenges such as data complexity and resource costs. The proposed approach aims to overcome these limitations by enhancing the performance of LLMs, particularly in the analysis precision and efficiency of national Research and Development (R&D) data. The study provides theoretical foundations and technical implementations of Instruction fine-tuning and LoRA fine-tuning. Through rigorous experimental validation, it is demonstrated that the proposed method significantly improves the precision and efficiency of data analysis, outperforming traditional fine-tuning methods. This enhancement is not only beneficial for national R&D data but also suggests potential applicability in various other data-centric domains, such as medical data analysis, financial forecasting, and educational assessments. The findings highlight the method's broad utility and significant contribution to advancing data analysis techniques in specialized knowledge domains, offering new possibilities for leveraging LLMs in complex and re- source-intensive tasks. This research underscores the transformative potential of combining Instruction fine-tuning with LoRA fine-tuning to achieve superior performance in diverse applications, paving the way for more efficient and effective utilization of LLMs in both academic and industrial settings.
Abstract
This study introduces and experimentally validates a novel approach that combines Instruction fine-tuning and Low-Rank Adaptation (LoRA) fine-tuning to optimize the performance of Large Language Models (LLMs). These models have become revolutionary tools in natural language processing, showing remarkable performance across diverse application areas. However, optimizing their performance for specific domains necessitates fine-tuning of the base models (FMs), which is often limited by challenges such as data complexity and resource costs. The proposed approach aims to overcome these limitations by enhancing the performance of LLMs, particularly in the analysis precision and efficiency of national Research and Development (R&D) data. The study provides theoretical foundations and technical implementations of Instruction fine-tuning and LoRA fine-tuning. Through rigorous experimental validation, it is demonstrated that the proposed method significantly improves the precision and efficiency of data analysis, outperforming traditional fine-tuning methods. This enhancement is not only beneficial for national R&D data but also suggests potential applicability in various other data-centric domains, such as medical data analysis, financial forecasting, and educational assessments. The findings highlight the method's broad utility and significant contribution to advancing data analysis techniques in specialized knowledge domains, offering new possibilities for leveraging LLMs in complex and re- source-intensive tasks. This research underscores the transformative potential of combining Instruction fine-tuning with LoRA fine-tuning to achieve superior performance in diverse applications, paving the way for more efficient and effective utilization of LLMs in both academic and industrial settings.
참고문헌 (23)
- Bilgram, V., "Accelerating Innovation With Generative AI : AI-Augmented Digital Prototyping and Innovation Methods", IEEE Engineering Management Review, 51(2), pp.18~25 (2023)
- Crothers, E., "Machine-Generated Text : A Comprehensive Survey of Threat Models and Detection Methods", IEEE Access, 11, pp.70977~71002 (2023)
- Cámara, J., "On the assessment of generative AI in modeling tasks : an experience report with ChatGPT and UML", Software and Systems Modeling, 22(3), pp.781~793 (2023)
- Hassija, V., "Unleashing the Potential of Conversational AI : Amplifying Chat-GPT's Capabilities and Tackling Technical Hurdles", IEEE Access, 11, pp.143657~143682 (2023)
- Hommel, B., "Expanding the methodological toolbox : Machine-based item desirability ratings as an alternative to human-based ratings", Personality and Individual Differences, 213, pp.112307~ (2023)
- Hu, E. J., "LoRA: Low-Rank Adaptation of Large Language Models", ICLR 2022Conference Poster, pp.1~26 (2022)
- Kamnis, S., "Generative pre-trained transformers(GPT)for surface engineering", Surface and Coatings Technology, 466, pp.129680~ (2023)
- Karkera, N., "Leveraging pre-trained language models for mining microbiome-disease relationships", BMC Bioinformatics, 24(1) (2023)
- Kheddar, H., "Deep transfer learning for automatic speech recognition : Towards better generalization", Knowledge-Based Systems, 277, pp.1~34 (2023)
- Kim, J., "Unsupervised Video Anomaly Detection Based on Similarity with Predefined Text Descriptions", Sensors, 23(14), pp.6256~ (2023)
- Kolides, A., "Artificial intelligence foundation and pre-trained models:Fundamentals, applications, opportunities, and social impacts", Simulation Modelling Practice and Theory, 126, pp.102754~ (2023)
- Lankford, S., "adaptMLLM : Fine-Tuning Multilingual Language Models on Low-Resource Languages with Integrated LLM Playgrounds", Information(Switzerland), 14(12), pp.1~24 (2023)
- Lin, K., "Text2Motion : from natural language instructions to feasible plans", Autonomous Robots, 47(8), pp.1345~1365 (2023)
- Mazumdar, H., "GPTFX: A Novel GPT-3 Based Framework for Mental Health Detection and Explanations", IEEE Journal of Biomedical and Health Informatics (2023)
- Megahed, F., "How generative AI models such as ChatGPT can be(mis)used in SPC practice, education, and research? An exploratory study", Quality Engineering, pp.278~315 (2023)
- Nicula, B., "Automated Assessment of Comprehension Strategies from Self-Explanations Using LLMs", Information(Switzerland), 14(10), pp.567~ (2023)
- Pan, W., "Research on automatic pilot repetition generation method based on deep reinforcement learning", Frontiers in Neurorobotics, 17 (2023)
- Porsdam Mann, S., "AUTOGEN : A Personalized Large Language Model for Academic Enhancement— Ethics and Proof of Principle", American Journal of Bioethics, 23(10), pp.28~41 (2023)
- Singh, I., "ProgPrompt : Program generation for situated robot task planning using large language models", Autonomous Robots, 47(8), pp.999~1012 (2023)
- Sætra, H., "Generative AI: Here to stay, but for good?", Technology in Society, 75, pp.102372~ (2023)
- Yin, C., "PowerPulse: Power energy chat model with LLaMA model fine-tuned on Chinese and power sector domain knowledge", Expert Systems (2023)
- Zhao, C., "ERRA : An Embodied Representation and Reasoning Architecture for Long-Horizon Language-Conditioned Manipulation Tasks", IEEE Robotics and Automation Letters, 8(6), pp.3230~3237 (2023)
- Zhu, Q., "Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers", Journal of Mechanical Designs, 145(4), pp.1~23 (2023)