ModelLock: Locking Your Model With a Spell

摘要

This paper presents a novel model protection paradigm Model Locking that locks the performance of a finetuned model on private data to make it unusable or unextractable without the right key. Specifically, we proposed a diffusion-based framework dubbed ModelLock that explores text-guided image editing to transform the private finetuning data into unique styles or blend new objects into the background. A model finetuned on this edited dataset will be locked and can only be unlocked by the key prompt, i.e., the same text prompt used to edit the data. We conduct extensive experiments on both image classification and segmentation tasks and show that 1) ModelLock can effectively lock finetuned models without significantly reducing their unlocked performance, and more importantly, 2) the locked model cannot be easily unlocked without knowing both the key prompt and the diffusion model. Our work opens up a new direction for intellectual property protection of private models.