Dailywiki vs Learning Transformer

Learn something new every day, in just a few minutes. Dailywiki picks a handful of random Wikipedia articles for you: history, science, places, people, things you would never have searched for. Browse them over breakfast, on the train or before bed, or press play and listen. READ OR LISTEN Every article can be read aloud with your phone's voices. Pick a voice for each language, set the speed and follow along as the sentence and word being read are highlighted. Listening keeps going with the screen off or while you use other apps: learn while you walk or cook. A DAILY HABIT Choose how many articles you want per session. When the session ends, you decide whether to stop or keep going. Turn on a reminder, if you like, at the time that suits you. KEEP WHAT YOU LIKE Save the articles that surprise you and find them whenever you want, grouped by language. Listen to them again or open the full article on Wikipedia. IN YOUR LANGUAGE Choose the article language from any of Wikipedia's languages, even one different from the app's. — Article content comes from Wikipedia and is available under the CC BY-SA license. Dailywiki is an independent app, not affiliated with or endorsed by the Wikimedia Foundation.

A Transformer, built by hand and shown one step at a time. Twenty-three screens follow "Attention Is All You Need" (Vaswani et al., 2017) in the paper's own order: a word becoming numbers, the three vectors, the scores, the softmax, four heads merged into one, the mask, the second attention, and the loop that writes one word at a time. What this is not: a trained model. Every weight here was set by hand, so that each one can be read in a single line. Nine numbers stand for a word instead of 512. One encoder layer and one decoder layer instead of six of each. Four heads, four words of vocabulary, one short sentence. What it is: the paper's arithmetic at a size you can check by hand. Every number on every screen is computed while you look at it — no videos, no quizzes, no account, no network. Steps 1 to 10 are free. Steps 11 to 23 are one purchase, made once and kept.