[Kiɗa]
[Mai Sanarwa] Wannan Albarkatun Jama'a ne
[Carl Malamud] Sannu, Ni Carl Malamud ne.
Barka da zuwa Babban Index.
Muna gabatarwa anan don kyauta kuma mara iyaka amfani da saitin n-gram da aka ciro daga miliyan 107,
Labarai 233 dubu, 728.
N-gram yana daga kalmomi guda ɗaya, wanda aka sani azaman unigrams, zuwa kalmomin jumla biyu (bigrams)
har zuwa jimlar kalmomi 5, da aka sani da gram 5.
Akwai, duk an fada, layuka biliyan 355 na n-gram a cikin wannan sakin babban jigon, kowane
daidai da bugawa a cikin labarin jarida.
An yi amfani da kayan aikin da ake kira Spacy don cirewa n-grams, wanda muka raba
a fadin fayiloli goma sha shida.
Haɗa tare da kowane jere shine md5 hash, wanda yana wakiltar labarin jarida.
Bugu da kari, mun lissafa mitar n-gram a cikin labarin.
Muna fata a kan lokaci don ma jera mitar a cikin corpus gaba ɗaya, ma'aunin ma'auni
wanda aka sani da TD/IDF.
Baya ga n-grams, Babban Index ya ƙunshi mahimman kalmomin da aka fitar ta amfani da Yake
Toolkit.Yake “yana kan ƙididdigar rubutu fasali da aka ciro daga takardu guda zuwa
zaɓi mahimman mahimman kalmomin rubutu. ”
Teburin maƙallan mahimman jigogi sun ƙunshi jimillar kalmomi biliyan 19.
A ƙarshe, babban jigon ya ƙunshi metadata tebur, yin taswirar md5 hash ga abubuwa irin wannan
adireshin musamman na DOI don labarin jarida, take, marubuci, da jarida.
Wannan farkon sakin babban jigon ne, aikin da ake yi.
A wasu lokuta, hakar rubutu ta gaza.
Wani lokaci, metadata baya samuwa, ko yana watakila ma ba daidai ba ne.
Duk da cewa gindin da ke ciki babba ne, yana da bai cika ba, kuma bai kasance na zamani ba.
Akwai hanyoyi da yawa da za a iya inganta wannan, kuma muna sa ran yin Janar
Index ya fi kyau akan lokaci.
Babban jeri yana ɗaukar kusan 38 terabytes na bayanai a cikin hanyar Postgres
juji, duk da haka tare da matsawa, wannan ASCII An rage bayanai zuwa terabytes 8.5.
Kuna iya saukar da bayanan kai tsaye daga nan, ko amfani da kayan aiki kamar bittorrent.
Jin kyauta don ƙirƙirar madubai ko wasu jama'a wuraren ajiya don sake rarraba babban jigon.
Fatan mu shi ne cewa za a iya sanya shi a lamba na amfani. Mun kasance muna amfani da bayanan Postgres,
da yin amfani da babban jigon don bincika sunayen shuke -shuke daga jerin manyan.
Ana iya amfani da alamar don neman wasu abubuwa, kamar sunadarai, kwayoyin halittu a iri -iri
rikodi, sunadarai, kayan aiki, sunayen wuri, ko wasu ƙungiyoyi.
Maimakon bayanan Postgres, wasu dabaru, kamar BERT, ana iya amfani da bayanan.
Wannan kayan bincike ne, ƙamus na ilimi, taswira don ilimi, kayan aiki da muka yi imani
wani muhimmin wuri ne na aikin ilimin kimiyya a wannan zamani namu.
Wannan babban jigo ga ilimi bai yi ba tushen gawar da ke akwai, Maimakon haka, gaskiya
ana fitar da su daga jikin gawa.
Wannan lamari ne da ba a yarda da shi ba da amfani mai canzawa.
Muna kallon wannan a matsayin amfanin jama'a. Mun tabbatar babu ikon mallaka akan babban jigo.
An sadaukar da shi ga yankin jama'a, jerin na abubuwan da ba a lissafa ba wanda zaku iya
yi abin da kuke so.
Babu haƙƙin haƙƙin mallaka.
Masana kan hanyar ganowa na iya tuntuba wannan taswirar hanya don hanzarta samun wurare
Suna nufin su ziyarce mu hallways na babban ɗakunan ajiya na duniya,
ƙungiyar gama gari ta masana da masana kimiyya da injiniyoyi da masu fasaha waɗanda suka ƙirƙira
wadannan haikalin ilmi.
Waɗannan temples, daga Laburaren Alexandria zuwa Labarin Alexandra, daga sufaye
na Ireland zuwa manyan ɗakunan karatu na zamani na yau, daga marubutan Larabawa da Yahudawa
aiki tare don gina Gidan Hikima a Bagadaza zuwa masana'antun ilimin da aka gina
a gidajen kasuwanci na Gabashin Indiya na zamani kamar injinan Oxford da Cambridge, waɗannan
sune wuraren da yakamata malamai su ziyarta don ci gaba da sana’arsu, koyi da su
wadanda suka zo kafin mu.
Waɗannan temples sun ƙunshi jimlar duk ilimin, amma dole ne mu iya samun wannan ilimin.
Manufa ta gaba ɗaya taswira ce.
Wannan ba taswira ba ce ga jimlar duk ilimin ɗan adam,
amma tabbas babban juzu'i ne mai mahimmanci.
Domin karuwa da yada ilimi don ci gaba, idan za mu tsaya a kan kafadu
na ƙattai, dole ne mu samar da waɗannan taswirorin hakan sararin duniya na ra'ayoyi.
Babban jigon kayan aiki ɗaya ne kawai, kayan aiki cewa muna fatan tsawon lokaci zai samu cikin inganci
kuma cikin fa'ida, kayan aikin da muke fatan zai samar taimako mai amfani
zuwa ga ilimin ku.
Muna fatan za ku sanya wannan babban jigon amfani mai ban mamaki, cewa zamu iya yin index
mafi kyau, cewa zaku iya ƙirƙirar wasu kayan aikin, wancan al'ummar malamai na iya aiki tare
a cikin neman gama gari don haƙa zurfin zurfin na wannan tekun na ilmantarwa.
Na yi imani dukkan mu muna da manufa ɗaya, fata na kowa.
Kamar yadda masana kimiyya, masana, masu fasaha, marubuta, a matsayin 'yan ƙasa na duniya, kamar yara masu fata
don koyo, a matsayin mutane masu son sani, na yi imani duk muna fatan cewa ƙaruwa da watsawa
ilimin zai sa duniyar mu ta zama mafi kyau wuri, cewa zai taimaka mana fahimtar namu
duniya, don warkar da cuta da talauci, don ci gaba ci gaban kimiyya da kasuwanci da
mutane da fasaha.
Kimiyya harshe ne tilas dukkanmu mu yi magana idan muna son inganta duniyarmu.
Godiya don sauraro.
[Siffar tana yin haushi]
[Kiɗa]