1. Gabatarwa & Bayyani
Shawarwarin Tsari (SR) yana nufin tsinkayar mu'amalar mai amfani na gaba bisa jerin halayensa na tarihi. Duk da cewa samfurori na zurfin koyo kamar SASRec da BERT4Rec sun sami sakamako na zamani, galibi suna yin watsi da wani muhimmin abu: ainihin niyyoyin mai amfani. Ayyukan mai amfani (misali, siyan kayan kamun kifi, duba kyaututtukan hutu) suna faruwa ne saboda manufofi na asali, waɗanda ba a gani ba. Takarda "Koyon Kwatancen Niyya don Shawarwarin Tsari" (ICL) ta nuna cewa ƙirƙirar da amfani da waɗannan niyyoyin a sarari na iya inganta daidaiton shawarwari da ƙarfinsa sosai.
Babban ƙalubalen shi ne cewa ba a iya gani kai tsaye niyyoyin. ICL tana magance wannan ta hanyar gabatar da sabon tsarin koyon kai wanda ya haɗa koyon rarraba niyyoyi tare da inganta samfurin SR. Hanyar tana musanya tsakanin tattara jerin halaye don gano niyyoyi da amfani da koyon kwatancen don daidaita wakilcin jerin da niyyoyinsu da aka gano, duk a cikin tsarin Tsammani-Matsakaici (EM).
Mahimman Fahimta
- Niyya a matsayin Maɓalli Mai ɓoye: Halin mai amfani yana ƙarƙashin niyyoyi masu ɓoye, waɗanda za a iya ƙirƙira su azaman maɓalli mai ɓoye don wadatar wakilcin jerin.
- Tattarawa don Gano Niyya: Tattarawa mara kulawa akan jerin mai amfani yana aiki azaman wakili don gano niyya ba tare da buƙatar bayanan gefe ba.
- Daidaitawar Kwatancen: Asarar kwatancen tana ƙara yarjejeniya tsakanin ra'ayin jerin da niyyar da aka sanya taron, yana haifar da wakilci mai ƙarfi da sanin niyya.
- Ribobi na Ƙarfi: Wannan hanyar tana inganta aikin samfur a ƙarƙashin ƙarancin bayanai da mu'amaloli masu hayaniya, ƙalubalen duniya na yau da kullun.
2. Hanyar Aiki: Koyon Kwatancen Niyya (ICL)
ICL tsarin koyo ne na gabaɗaya wanda za'a iya haɗa shi da samfurori daban-daban na SR (misali, GRU, Transformer).
2.1 Tsarin Matsala
Idan aka ba mai amfani $u$ tare da jerin mu'amala $S^u = [v_1^u, v_2^u, ..., v_t^u]$, manufar ita ce tsinkayar abu na gaba $v_{t+1}^u$. ICL ta gabatar da maɓalli mai ɓoye na niyya $z$ ga kowane jerin, wanda ke wakiltar ainihin manufar da ke motsa mu'amaloli.
2.2 Ƙirƙirar Niyya ta hanyar Tattarawa
Tunda ba a yiwa niyyoyi lakabi ba, ICL tana amfani da tattarawa akan wakilcin jerin don kusantar nau'ikan niyya. Bari $h^u$ ya zama wakilcin jerin daga mai ɓoye SR. Algorithm na tattarawa (misali, K-means) yana sanya kowane jerin zuwa taro $c$, wanda ke aiki azaman wakili ga niyyarsa $z$. An ƙirƙira rarraba sanya taro $p(c|S^u)$.
2.3 Koyon Kwatancen Kai
Wannan shine jigon ICL. Ga jerin $S^u$, an ƙirƙiri ra'ayoyi biyu masu alaƙa ($S^{u,1}$, $S^{u,2}$) ta hanyar haɓaka bayanai (misali, rufe fuska, yanke). Dukansu an ɓoye su kuma an sanya su cikin taruka ($c^1$, $c^2$). Asarar kwatancen tana nufin jawo wakilcin ra'ayoyin biyu na jerin ɗaya kusa yayin da take tura su daga ra'ayoyin wasu jerin, idan aka yi la'akari da niyyarsu.
Za a iya tsara asarar kwatancen mai sanin niyya kamar haka: $$\mathcal{L}_{ICL} = -\log \frac{\exp(\text{sim}(h^{u,1}, h^{u,2}) / \tau)}{\sum_{k \in \mathcal{B}} \mathbb{1}_{[c^k = c^u]} \exp(\text{sim}(h^{u,1}, h^{k}) / \tau)}$$ inda $\text{sim}$ shine aikin kamanceceniya (misali, cosine), $\tau$ shine ma'aunin zafin jiki, kuma $\mathcal{B}$ shine rukuni. Aikin nuna alama $\mathbb{1}_{[c^k = c^u]}$ yana mai da hankali kan samfuran mara kyau akan jerin tare da niyya ɗaya, yana haifar da aikin kwatancen mai wahala, mafi bayani.
2.4 Horarwa ta Tsarin EM na Gabaɗaya
Horarwa tana musanya tsakanin matakai biyu a cikin yanayin EM:
- Mataki-E (Gano Niyya): Kayyade sigogin samfurin SR, lissafta wakilcin jerin, da aiwatar da tattarawa don sabunta sanya niyya $p(c|S^u)$.
- Mataki-M (Inganta Samfur): Kayyade sanya niyya, kuma inganta sigogin samfurin SR ta amfani da haɗaɗɗiyar asara: $\mathcal{L} = \mathcal{L}_{SR} + \lambda \mathcal{L}_{ICL}$, inda $\mathcal{L}_{SR}$ shine babban asarar shawarwari (misali, giciye-entropy) kuma $\lambda$ yana sarrafa nauyin asarar kwatancen.
3. Cikakkun Bayanai na Fasaha & Tsarin Lissafi
Babban aikin manufa na ICL shine: $$\mathcal{L}_{total} = \underbrace{-\sum_{u} \log P(v_{t+1}^u | S^u)}_{\text{Asarar Tsinkaya na Abu na Gaba}} + \lambda \underbrace{\mathcal{L}_{ICL}}_{\text{Asarar Kwatancen Niyya}}$$ Tattarawa a cikin Mataki-E ana iya ganinsa azaman ƙara yuwuwar samfurin maɓalli mai ɓoye $p(S^u, c)$. Asarar kwatancen a cikin Mataki-M tana aiki azaman mai daidaitawa wanda ke tilasta daidaiton niyya, yana haifar da wakilci waɗanda ba su canzawa ga hayaniya a cikin taron niyya ɗaya—ra'ayi mai kama da ƙa'idar rashin canzawa a cikin wallafe-wallafen koyon kwatancen kamar SimCLR da MoCo.
4. Sakamakon Gwaji & Nazari
Takardar ta tabbatar da ICL akan bayanan duniya guda huɗu: Kyakkyawa, Wasanni, Kayan wasa, da Yelp.
4.1 Bayanan Gwaji & Ma'auni
Ma'auni sun haɗa da na gargajiya (BPR-MF), na tsari (GRU4Rec, SASRec, BERT4Rec), da hanyoyin koyon kwatancen (CL4SRec). An yi amfani da ICL a saman SASRec da BERT4Rec.
4.2 Kwatancen Aiki
ICL ta ci gaba da fiye da duk ma'auni a cikin ma'aunin Tunawa@N da NDCG@N. Misali, akan bayanan Kyakkyawa, ICL (BERT4Rec) ta inganta Tunawa@20 da kusan 8% fiye da BERT4Rec na asali. Wannan yana nuna fa'idar haɗa ƙirar niyya gabaɗaya.
Haɓaka Aiki (Misali: Bayanan Kyakkyawa)
Tushe: BERT4Rec
Tunawa@20: +7.9%
NDCG@20: +9.1%
4.3 Nazarin Ƙarfi
Wani muhimmin da'awa shine ingantaccen ƙarfi. Gwaje-gwaje a ƙarƙashin ƙarancin bayanai (ta amfani da gajerun jerin) da mu'amaloli masu hayaniya (maye gurbin abubuwa ba da gangan ba) sun nuna ICL tana raguwa cikin ladabi fiye da ma'auni. Tattarawar niyya tana ba da siginar daidaitawa, yana ba da damar samfurin ya dogara da tsarin niyya da aka raba maimakon alaƙa mara tushe a cikin ƙayyadaddun bayanai/masu hayaniya.
4.4 Nazarin Cirewa
Nazarin cirewa ya tabbatar da wajibcin duka sassa:
- Ba tare da Tattarawa ba: Amfani da niyyoyi na bazuwar ko ƙayyadadden yana cutar da aiki, yana tabbatar da buƙatar gano niyya mai ma'ana.
- Ba tare da Asarar Kwatancen ba: Kawai amfani da lambobin taro azaman siffofi ba shi da tasiri fiye da daidaitawar kwatancen, yana nuna mahimmancin manufar koyon wakilci.
- Tasirin $\lambda$: Aiki ya kai kololuwa a matsakaicin $\lambda$, yana nuna daidaito tsakanin koyon aiki na musamman da sanin niyya.
5. Tsarin Nazari: Ainihin Fahimta & Tsarin Ma'ana
Ainihin Fahimta: Nasarar takardar ba sabon tsarin jijiyoyi ba ne, amma tsarin koyo. Ta gano daidai cewa ƙafar Achilles na SR na zamani shine makanta ga "dalilin" da ke bayan ayyukan mai amfani. Ta hanyar sanya niyya a matsayin maɓalli mai ɓoye da amfani da kayan aiki masu sauƙi amma masu ƙarfi na tattarawa da koyon kwatancen, ICL tana shigar da tsarin ma'ana a cikin abin da in ba haka ba shine kawai daidaita tsari akan jerin. Wannan yana tunawa da yadda takardar CycleGAN ta gabatar da daidaiton zagayowar don ba da damar fassarar hoto mara biyu—ƙa'idar ra'ayi ce wacce ke jagorantar koyo inda babu kulawa kai tsaye.
Tsarin Ma'ana: Hujjar tana da ban sha'awa kuma an tsara ta da kyau: 1) Lura cewa halin mai amfani yana da niyya (Hoto 1). 2) Yardar cewa niyyoyi suna ɓoye. 3) Shawarar gano su ta hanyar tattarawa akan hali (wakili mai ma'ana). 4) Amfani da niyyoyin da aka gano don ƙirƙirar aikin koyon kwatancen mai hikima—maimakon bambanta duk marasa kyau daidai, mai da hankali kan marasa kyau masu wahala a cikin taron niyya ɗaya. 5) Saka wannan a cikin madauki na EM don ingantaccen maimaitawa. Gudu daga gano matsala zuwa gine-ginen mafita yana da tsabta kuma yana da ma'ana.
6. Ƙarfafawa, Kurakurai & Fahimta Mai Aiki
Ƙarfafawa:
- Tsarin fiye da Gine-gine: Yanayin toshe-kuma-wasa tare da samfuran SOTA na yanzu (SASRec, BERT4Rec) babban ƙarfi ne don sauƙin karɓa.
- Ingantaccen Bayanai: Ribobin ƙarfi suna magance matsalolin duniya masu tsada kai tsaye kamar farawa sanyi da rajistan hayaniya.
- Kyawawan Ra'ayi: Yana haɗa samfuran maɓalli mai ɓoye (na kowa a cikin shawarwari na gargajiya) tare da zurfin koyon kai na zamani.
Kurakurai & Zargi:
- Zato na Niyya Mai Tsayi: Tattarawa tana ba da niyya ɗaya ga jerin gabaɗaya. A zahiri, niyyoyi na iya haɓaka a tsakiyar zaman (misali, daga "bincike" zuwa "siye"). Samfurin ba shi da ƙirar niyya mai laushi, na ɗan lokaci.
- Matsalar Ingancin Taro: Duk tsarin yana dogara ne akan ingancin tattarawa mara kulawa. Tarukan hayaniya ko marasa kyau na iya yada kurakurai. Takardar tana amfani da K-means; ana iya bincika hanyoyin da suka ci gaba (misali, Samfuran Gauraye na Gaussian, tattarawa mai zurfi).
- Ƙarin Kuɗin Lissafi: Horarwar EM mai maimaitawa da tattarawa kan layi suna ƙara farashi mara mahimmanci idan aka kwatanta da horarwar ƙarshe-zuwa-ƙarshe.
Fahimta Mai Aiki ga Masu Aiki:
- Aiwatar da ICL azaman Mai Daidaitawa: Lokacin da kuka fuskanci bayanai marasa yawa ko masu hayaniya, yi amfani da asarar kwatancen ICL azaman mai daidaitawa a saman samfurin SR ɗin ku na yanzu. Fara da ƙaramin $\lambda$.
- Kula da Haɗin Taro: Kar a ɗauki tattarawa azaman akwatin baƙar fata. Kimanta haɗin taro (misali, ta maki silhouette) akan saiti don tabbatar da cewa "niyyoyin" da aka gano suna da ma'ana.
- Bincika Niyya Mai Ƙarfi: Don dogon lokaci ko rikitattun zaman, gwada rarraba jerin kafin tattarawa ko amfani da hanyoyin kulawa don auna abubuwa dangane da alaƙar niyya da aka gano.
7. Hangar Aikace-aikace & Hanyoyin Gaba
Aikace-aikace na Gajeren Lokaci:
- Kasuwancin E & Dillali: Ana iya amfani da shi kai tsaye don shawarar samfur na gaba, nazarin kwando, da inganta shawarwari a cikin sabon mai amfani/yanayin farawa sanyi.
- Kwararar Abun ciki: Ƙirƙirar "niyyoyin" kallo (misali, "hayaniyar bango," "koyo mai zurfi," "daren fim na iyali") na iya inganta jerin waƙoƙi da shawarwarin bidiyo na gaba akan dandamali kamar Netflix ko YouTube.
Hanyoyin Bincike na Gaba:
- Niyyoyi Masu Daraja & Masu Ƙarfi: Matsawa daga niyya ɗaya na matakin jerin zuwa matakin niyyoyi ko ƙirƙirar canjin niyya a cikin zaman.
- Haɗawa tare da Bayanan gefe: Duk da yake ICL tana guje wa bayanan gefe, haɗa shi tare da siginoni masu rauni (misali, nau'ikan abu, lokacin rana) zai iya tayar da kai da inganta gano niyya.
- Tushen Ka'idoji: Nazari na yau da kullun na kaddarorin haɗuwa na tsarin EM na gabaɗaya da iyakokin gabaɗaya na asarar kwatancen mai sanin niyya.
- Canja Niyya Tsakanin Yankuna: Bincika ko niyyoyin da aka koya a wani yanki (misali, siyayya) na iya ba da labari ko canjawa zuwa wani (misali, shawarar labarai).
8. Nassoshi
- Chen, Y., Liu, Z., Li, J., McAuley, J., & Xiong, C. (2022). Koyon Kwatancen Niyya don Shawarwarin Tsari. Proceedings of the ACM Web Conference 2022 (WWW '22).
- Kang, W. C., & McAuley, J. (2018). Shawarwarin tsari mai son kai. 2018 IEEE International Conference on Data Mining (ICDM).
- Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., & Jiang, P. (2019). BERT4Rec: Shawarwarin tsari tare da wakilcin mai ɓoye na bidirectional daga Transformer. Proceedings of the 28th ACM International Conference on Information and Knowledge Management.
- Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). Tsarin sauƙi don koyon kwatancen wakilcin gani. International conference on machine learning (ICML).
- Zhu, J. Y., Park, T., Isola, P., & Efros, A. A. (2017). Fassarar hoto-zuwa-hoto mara biyu ta amfani da cibiyoyin adawa masu daidaitaccen zagayowar. Proceedings of the IEEE international conference on computer vision (ICCV).
- Xie, J., Girshick, R., & Farhadi, A. (2016) Zurfin shigarwa mara kulawa don nazarin tattarawa. International conference on machine learning (ICML).