超巨大高性能モデルGPT-3の到達点とその限界. この記事では、超巨大言語モデルGPT-3の技術的な解説、GPT-3達成したことと… | by akira | Jul, 2020 | Medium
この記事についてこの記事ではGPT-3[1]の解説をします。内容のサマリは以下の通りです。 GPT-3の前身であるGPT-2では、巨大なデータセット＋巨大なネットワークで言語モデルを構築し、各タスクで学習させなくても良い結果が得られた。GPT-3では、さらに巨大なデータセット＋さらに巨大なネットワークで言語モデルを構築し、数十のサンプルを見せると凄く良い結果が得られた一方、様々なタスクに言語モデルのスケールアップのみで対応することへの限界が見えてきた。人種、性別、宗教などへの偏見の問題や、悪用に対する課題もある。この記事の流れは以下の通りです。 Transformer, GPT-2の説明GPT-3のコンセプトと技術的な解説GPT-3ので上手くいくタスクGPT-3で上手くいかないタスク偏見や悪用への見解 Transformerまず、GPT-3の前身となったGPT-2に入る前に、その中に使われ
No thank you, Mr. Pecker
No thank you, Mr. PeckerSomething unusual happened to me yesterday. Actually, for me it wasn’t just unusual — it was a first. I was made an offer I couldn’t refuse. Or at least that’s what the top people at the National Enquirer thought. I’m glad they thought that, because it emboldened them to put it all in writing. Rather than capitulate to extortion and blackmail, I’ve decided to publish exactl
How JavaScript works: Event loop and the rise of Async programming + 5 ways to better coding with…
Welcome to post # 4 of the series dedicated to exploring JavaScript and its building components. In the process of identifying and describing the core elements, we also share some rules of thumb we use when building SessionStack, a JavaScript tool for developers to identify, visualize, and reproduce web app bugs through pixel-perfect session replay. Did you miss the first three chapters? You can f
Satoshi was wrong – Fairlayer – Medium
From https://bitcoin.org/bitcoin.pdf > Bitcoin: A Peer-to-Peer Electronic Cash System 9 years later, it didn’t become one. Satoshi’s paper offered a few of coupled together ideas, and most of them were broken. A cap at 21M. It made the currency deflationary by nature. Ask an economist, no one thinks it’s a good idea long term http://www.investopedia.com/articles/personal-finance/030915/why-deflati
Angular vs. React vs. Vue: A 2017 comparison
Deciding on a JavaScript framework for your web application can be overwhelming. Angular and React are very popular these days, and there is an upstart which has been getting a lot of traction lately: VueJS. What’s more, these are just a few of the new kids on the block. Javascripts in 2017 — things aren’t easy these days!So, how are we supposed to decide? A pros-and-cons list never hurts. We’ll d
The Simplest React Stack
I am in search of the simplest React Stack. It has to be future-proof and feature-packed, but most importantly it has to be a breeze to work with. In this series I will look for easy-to-use solutions to implement a buffed version of the classic React TodoMVC. When I think I can achieve something simpler, I will create helper libraries myself. The following topics will be likely covered before the
6 areas of AI and machine learning to watch closely
Distilling a generally-accepted definition of what qualifies as artificial intelligence (AI) has become a revived topic of debate in recent times. Some have rebranded AI as “cognitive computing” or “machine intelligence”, while others incorrectly interchange AI with “machine learning”. This is in part because AI is not one technology. It is in fact a broad field constituted of many disciplines, ra
Why Rails developers should learn React
Rails developers should learn React because there’s growing market demand for developers who know both. Learning to use React will make you more money and a better developer. React is an open-source JavaScript library for building user interfaces. Since Facebook released it in 2013, React has rapidly grown in popularity among developers — from solo hackers to small startups to large teams, a lot o
React on Railsの基本理念
原文: The React on Rails Doctrine ジャスティン・ゴードン(2016年1月24日) このドキュメントはRailsの基本理念(訳注: 日本語版)に対する拡張と補足です。まだそのドキュメントを読んでいない場合、先にそちらを読むことをお勧めします。 React on RailsのREADMEの中で述べているように、このプロジェクトの目的は、Ruby on RailsとモダンなJavaScriptのツールやライブラリを統合するための、強固で最適なフレームワークを提供することです。react_on_railsに何をいれるべきかを考えるとき、その機能が RailsとモダンなJavaScriptとの共通部分と関連があるかどうかを自問します。RailsのビューとReactコンポーネントを統合するためのビューヘルパーがよい例です。答えがイエスである場合、その機能はここにあるべきで
Angular 2 versus React: There Will Be Blood
Angular 2 has reached Beta and appears poised to become the hot new framework of 2016. It’s time for a showdown. Let’s see how it stacks up against 2015’s darling: React. Disclaimer: I enjoyed working in Angular 1 but switched to React in 2015. I’ve published Pluralsight courses on React and Flux and React and Redux in ES6 (free trial). So yes, I’m biased. But I’m attacking both sides. Alright, le
Medium’s Publishing API
Today is a very exciting day. We’re pleased to announce that Medium has launched a Publishing API. We’ve built a great tool for writing. But it’s not our editor that creates the main value — Medium is, first and foremost, a network for connecting people and ideas. With our Publishing API, you can now share your story on Medium from anywhere. It’s easier than ever to plug into our network and build
Would Steve Jobs Have Liked the New Biography? I Don’t Think So
I suspect that Steve Jobs would not be thrilled with Becoming Steve Jobs, a new business biography by Brent Schlender and Rick Tetzeli. While it’s a worthwhile book filled with previously unheard stories and insightful industry analysis, Steve would have disliked it because of the persistent negative spin it applies to the first half of his career. That’s why it’s puzzling to see Apple throw their
I made an NES emulator. Here’s what I learned about the original Nintendo.
I recently created my own NES emulator. I did it mostly for fun and to learn about how the NES worked. I learned some interesting things, so I wrote this article to share. There is a lot of documentation already out there, so this is just meant to highlight some interesting tidbits. Warning: this will be very technical! My emulator can record animated GIFs. Here I am playing Donkey Kong.The CPUThe
Maybe you should stop using Grunt
For approximately 18 months, most of my time at work was spent writing grunt tasks, wiring them up, using them in other projects, building a meta-layer that glued everything together, and hacking the hell out of Grunt when I wanted to make it do something it wasn’t designed for. I have spoken at a local meetup about using Grunt (slides). But a few months ago, my team decided we no longer needed Gr
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
俺の考えた最強のキーボード
Windows 10 May 2020 Update とDvorakJ での親指シフト入力の問題を解消する
How I got banned from CodeWars
Alan Kay on How Many Books You Can Read in a Lifetime
Solving a Tricky Problem
4 reasons why we are leaving Dropbox