baumhaus.digital/Miscellanous/Presentations/AE54/0th Berlin Symposium on Artificial Teacher Avatars/Introduction/Definitions/fine-tuning & optimizing
During today's workshop, I will introduce You to two methods how You can fine-tune Your model to allow it to provide better inferences for the task You want to solve.
Lora training :: here You just have a bunch of data
Direct Preference Optimization :: here You have data which contains list of tasks (e.g. questions) and associated correct and incorrect answers