Leo's Garage

word embedding은 단어를 벡터로 바꿔서 의미를 수학적으로 다루는 방법이다.우리가 진짜로 얻고 싶은건 단어 백터 $w$인데, 말뭉치에서 직접 관측되는 건 단어가 어디서, 어떤 단어와 함께 등장했는지(분포) 뿐이다.그래서 거의 모든 임베딩은 아래 가정에서 출발한다.비슷한 의미의 단어는 비슷한 문맥에서 등장한다. (Distributional Hypothesis)이번 글은 아래 3가지를 "하나의 관점(내적, PMI)"으로 정리하고자 한다.내적이 임베딩에서 뭘 의미하는지PMI/PPMI가 왜 자꾸 나오는지GloVe, CBOW가 각각 어떻게 학습되는지 출처 GloVe: Pennington, Socher, Manning (2014), GloVe: Global Vectors for Word Representa..

Softmax가 뭘 하는 함수인가?Softmax는 여러 개의 "점수(score, logit)"을 받아서, 이를 확률처럼 해석 가능한 값들의 묶음으로 바꿔주는 함수이다.입력: 클래스별 점수 (예: 고양이 2.0, 개 1.0, 토끼 0.1)출력: 각 클래스에 대한 값 (0 ~ 1), 전체 합이 1즉, 결과는 "확률 분포 형태"가 되어, 한 샘플이 여러 클래스 중 '하나'일 때 "모델이 각 후보에 얼마나 무게를 두는지"를 직관적으로 볼 수 있다. "확률로 만든다"의 의미여기서 "확률"은 현실 세계의 진짜 확률을 보장한다는 뜻이 아니라여러 후보의 유력함을 0 ~ 1 사이의 '몫(지분)'으로 바꾸고, 그 몫들의 합이 1이 되게 만든 것그래서 마치 확률처럼 읽을 수 있음 비유 1: 케이크 지분 점수는 그냥 "선호..

Date: 02/11//2026=================Student: Dawoon KimTopic: How Reading Before Bed Can Help You Sleephttps://engoo.com/app/daily-news/article/how-reading-before-bed-can-help-you-sleep/22ZZSs_fEfCnBrfnFV_SCQSentence Construction:X I have presentation on this Friday. >> I have a presentation this Friday.X This is the last presentation before submitting to conference. >> This is the last presentati..

Date: 02/05/2026=================Student: Dawoon KimTopic: Korea to add 60,000 homes in Greater Seoul areahttps://www.koreaherald.com/article/10665681Sentence Construction:X As I told you before I will participate in the some presentation. >> As I told you before, I will participate in a presentation.X My role is presentating my materials. >> My role is presenting my materials.X Some class I hav..

Date: 02/03/2026=================Student: Dawoon KimTopic: What to know about the Nipah virushttps://edition.cnn.com/2026/01/29/health/nipah-virus-explainerSentence Construction:X I have a bread at the cafe. >> I am having bread at this café.X In the lab there is some devices. >> There are some devices in the lab.X I have to make 6 minutes videos. >> I have to make a 6-minute video. X Sometimes ..

Date: 02/02/2026=================Student: Dawoon KimTopic: The 2 p.m. Slump: The Most Tired Time of Dayhttps://engoo.com/app/daily-news/article/the-2-pm-slump-the-most-tired-time-of-day/sk1MYPevEfCEgy-HjGheuwSentence Construction:X My professor told me I have to participated in some special conference. >> My professor told me that I have to participate in a special conference.X I gave this snack..

Date: 01/26/2026=================Student: Dawoon KimTopic: Risk-taking in young chimps and teens is similarhttps://breakingnewsenglish.com/2601/260115-risky-behaviour.htmlSentence Construction:X I really enjoy every time in my home. >> I really enjoy every moment at home.X You can bring produced items. >> You can bring produced items.X The balance of supervision and freedom to make high performa..

Date: 01/23/2026=================Student: Dawoon KimTopic: Risk-taking in young chimps and teens is similarhttps://breakingnewsenglish.com/2601/260115-risky-behaviour.htmlSentence Construction:X We are good evening because I am in Korea now. >> It’s a really good evening because I’m in Korea now.X I came Korea from Japan and Germany. >> I came to Korea from Japan and Germany.X If I wanna buy the..

Date: 01/22/2026=================Student: Dawoon KimTopic: FREETALKING - English GrammarSentence Construction:X Yesterday night, I went to the Japan. >> Yesterday, I was in Japan.X 10 minutes ago, my flight arrive destination. >> My flight arrived at the destination 10 minutes ago.X My original plan is to heading to Korea. >> My original plan was to head to Korea.X My wife really enjoyed Korea l..

Date: 01/05/2026=================Student: Dawoon KimTopic: FREE TALKING: New YearSentence Construction:X Is it noise? >> Is it noise?X Why I am at the bank is because I have to change my money to dollars. >> I’m at the bank because I need to exchange my money for dollars.X I think I don't have enough time to write this paper. >> I don’t think I have enough time to finish this paper.X When I in t..