数式を使わないTransformerの解説（前編） - conceptualization
2023/3/23 追記： こちら半年以上前に執筆したもので、その後私の理解も進んで内容的に更新したいところが結構あるため、近日中に非公開とさせていただき,更新後に再公開させていただくつもりです。現時点での本記事の内容は、大きく間違ってはいないけどちらほら微妙なところがあるという感じです。 （ざっくり理解するだけでも良いという人にはそれでも良いかもしれませんが、そういう方向けには 今執筆中のこちらの記事 をおすすめします。） −−−− 最近話題のmidjourneyやDALL-E、凄いですよね。中身はディープラーニング（DNN）のようです。DNNといっても色んな技術がありますが、それらにはTransformerという手法が使われています。本記事は、その手法がどんなものであるかを数式を使わずに説明してみよう、という主旨になります。 ※なお本記事は機械学習のプロの研究者ではない私の独自の解釈が
artima - Conditional Love: FOREACH Redux
Plowing through some devilish details of template argument deduction, the conditional operator and the macro preprocessor, Eric develops a robust FOR_EACH iterator. Whether you're using arrays, strings, or containers, this one does it all. Conditional Love: FOREACH Redux My CS201 "Software Development Methods" professor taught that all anyone would ever need to know about C++'s ternary conditional
Why learning Haskell/Python makes you a worse programmer « All Unkept
I've found, contrary to what you sometimes read, that learning Python and Haskell has not improved my programming using other languages. Haskell in particular, being so different from imperative languages, is supposed to give new insights into programming that will help you even when you are not using the language. My current experience doesn't exactly tally with this, and here is why: Demotivatio
ART OF MONEY GETTING
ART OF MONEY GETTING or, Golden Rules for Making Money by P. T. Barnum 1880
Computer Productivity: Why it is Important that Software Projects Fail
An essay on computer productivity Dr A Berglas, February/October 2008 / 2021 AXnthony@Berglas.org (Feedback welcome, remove X.) Copy at will but provide attribution. Abstract This paper boldly challenges the long established misconception that the catastrophic failure of expensive software projects is detrimental to society. Historical analysis of bureaucracies such as the Australian Tax Office
Archived MSDN and TechNet Blogs | Microsoft Docs
Archived MSDN and TechNet Blogs 2/7/2020 2 minutes to read MSDN and TechNet blog sites have been retired, and blog content has been migrated and archived here. Archived blogs are grouped alphabetically by the initial letter of the blog name. Blogs and blog posts can be searched by their names, using the Search box at the top of the page. Actively updated blogs have been moved to other blog sites,
Worse is Better
Lisp: Good News Bad News How to Win Big Richard P. Gabriel Abstract Lisp has done quite well over the last ten years: becoming nearly standardized, forming the basis of a commercial sector, achieving excellent performance, having good environments, able to deliver applications. Yet the Lisp community has failed to do as well as it could have. In this paper I look at the successes, the failures, an
Lisp in Ruby - { |one, step, back| }
I stumbled across this and it got me thinking … Update I’ve updated the Textile formatter on the site and the code for this entry is now displaying correctly. The previous version was swalling the == operators in the code. Lisp 1.5 Programmer’s Manual I stumbled across this in Bill Clementson’s blog and remembered using the Lisp 1.5 Prgrammers manual from the college years. I have strong memories
Catching Integer Overflows in C
Update 20150422: clang and gcc 5 have builtins now for this, look for __builtin_add_overflow and __builtin_mul_overflow in the documentation. That makes these macros obsolete. Note: This document and the macros make two important assumptions: There are 8 bits in a char. This is not guaranteed by the C standard, and is in fact not true on all platforms, most notably some ancient mainframes. You cou
The Mythical 5%
Computing Thoughts The Mythical 5% by Bruce Eckel December 28, 2007 Summary In November, I gave the commencement address for Neumont University, a school in Salt Lake City dedicated to teaching computer science where my coauthor lectures. This is that speech. So here you are, about to be unleashed upon the world. This is a lot like taking someone and teaching them all the parts of English speech a
Tips for Writing Technical Papers
Please excuse the retro formatting. This page was created back in early days when raw HTML was the norm, for those of us who actually made web pages back then. I haven't bothered to modernize it, figuring it's the content that actually counts. Here are the notes from a presentation I gave at the Stanford InfoLab Friday lunch, 1/27/06, with a few (not many) revisions when I reprised the talk on 12/
Become A Better Developer By Indexing Your Brain
This is the fourth post in the teaching and learning series. The teaching and learning series includes the following posts: All Developers Should Know How They Learn Best _The Secret Of Being A Great Mentor_** **__ _The Secret Of Being A Great Apprentice_ ____ _Become A Better Developer By Indexing Your Brain __(this post)___ Learn More – Faster By Using The World-Wide Community What Playing Cards
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Sriram Krishnan Lisp is Sin
The Higher Arithmetic » American Scientist
It’s Okay To Write Unit Tests
You Don’t Need Math Skills To Be A Good Developer But You Do Need Them To Be A Great One
Contributing is easy! | David [blogs.perl.org]
Programming languages that every developer should know – Fresh out of the labs
The Secret Of Being A Great Apprentice
The Secret Of Being A Great Mentor