A config file format for humans. TOML aims to be a minimal configuration file format that's easy to read due to obvious semantics. TOML is designed to map unambiguously to a hash table. TOML should be easy to parse into data structures in a wide variety of languages. # This is a TOML document title = "TOML Example" [owner] name = "Tom Preston-Werner" dob = 1979-05-27T07:32:00-08:00 [database] enab
GitHub - losvedir/transit-lang-cmp: Programming language comparison by reimplementing the same transit data app
This repository implements the same simple backend API in a variety of languages. It's just a personal project of mine to get a feel for the languages, and shouldn't be taken too seriously. So far I've built it in C#, Typescript (Deno), Elixir, Go, Rust, and Scala. Star the repository and/or follow me on Twitter (@losvedir) if you want updates on the project. I hope to eventually get to Swift, Kot
GitHub - zesterer/tao: A statically-typed functional language with generics, typeclasses, sum types, pattern-matching, first-class functions, currying, algebraic effects, associated types, good diagnostics, etc.
You can now test Tao in the browser! A statically-typed functional language with polymorphism, typeclasses, generalised algebraic effects, sum types, pattern-matching, first-class functions, currying, good diagnostics, and much more! For more example programs, see... hello.tao: Hello world input.tao: Demonstrates a more complex example of IO effects calc.tao: A CLI calculator, demonstrating parser
GitHub - OpenBMB/ChatDev: Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)
ChatDev stands as a virtual software company that operates through various intelligent agents holding different roles, including Chief Executive Officer , Chief Product Officer , Chief Technology Officer , programmer , reviewer , tester , art designer . These agents form a multi-agent organizational structure and are united by a mission to "revolutionize the digital world through programming." The
Trends in Natural Language Processing: ACL 2019 In Review - Mihail Eric
This week I had the great fortune to attend the Annual Meeting of the Association for Computational Linguistics (ACL) 2019 held in wonderful Florence in an old Medici family fortress. Conferences are some of my favorite events to attend because in a very short amount of time you are able to tap into the stream-of-consciousness of a community, to learn what people are thinking and where the field i
Kaggle のコンペティション、Feedback Prize - English Language Learningが終わり、約2650チーム中15位で金メダル取得となった。これで合計金メダル2つ、銀メダル1つを取得し、Kaggle Competitions Master の条件を満たし、コンペを始めた当初目指していた Master の称号を年内にとることができた。自分一人ではこの結果にはならなかったと思うので、チームメンバーの@masakiaota氏、@olivineryo氏に感謝だ。 Public LBではコンペ終了時に8位/2700チームの成績で金メダル圏内だったが、Public LB がLB全体の26%のデータでのスコア。スコア表示も小数点以下第二位まででLBのスコア表示がざっくりとしており、かつ我々のCVではかなり悪いスコアがPublic LB上ではやたら上位になったりとCV・
How to train a new language model from scratch using Transformers and Tokenizers
How to train a new language model from scratch using Transformers and Tokenizers Over the past few months, we made several improvements to our transformers and tokenizers libraries, with the goal of making it easier than ever to train a new language model from scratch. In this post we’ll demo how to train a “small” model (84 M parameters = 6 layers, 768 hidden size, 12 attention heads) – that’s th
We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3 trillion tokens, whose overall performance, as measured by both academic benchmarks and internal testing, rivals that of models such as Mixtral 8x7B and GPT-3.5 (e.g., phi-3-mini achieves 69% on MMLU and 8.38 on MT-bench), despite being small enough to be deployed on a phone. The innovation lies entirely in our dataset
GitHub - zevv/zForth: zForth: tiny, embeddable, flexible, compact Forth scripting language for embedded systems
From Wikipedia: A Forth environment combines the compiler with an interactive shell, where the user defines and runs subroutines called words. Words can be tested, redefined, and debugged as the source is entered without recompiling or restarting the whole program. All syntactic elements, including variables and basic operators are defined as words. Forth environments vary in how the resulting pro
2022年2月9日（水）- 11日（金）第6回 統計・機械学習若手シンポジウム での講演資料です。 CNNの画像認識におけるブレークスルーから10年、Transformerの機械翻訳におけるブレークスルーから5年。異なる様態のデータに対する機械学習応用の相互参入障壁が大きく緩和された現在、画像情報と言語情報による理解や変換・生成を目的とするVision and Languageは、その周辺分野も巻き込みながら勢いを増している研究分野です。本講演では、Vision and Languageと呼ばれる各研究課題の生い立ちや発展、そして今後の課題について概観します。 いままでもビジョン＆ランゲージの講演は何度とやらせて頂いておりますが、今回少し気合を入れて更新しました。ビジョン＆ランゲージは本当にタスクが色々増えて来て収集が付かない状況ですが、90分の講演で自分が考え得る限りでは最大のカバレッジ
単語をならべかえて英文を完成させよう(レベル5)「is Language man to unique」「言語は人間特有のものである。」#英語学習 | ならべかえ 英語 リスニング
LayoutLM (Layout Language Model)を試したら精度がめっちゃ上がった件について | 株式会社シナモン（シナモンAI）
技術 LayoutLM (Layout Language Model)を試したら精度がめっちゃ上がった件について 2021.01.18 こんにちは。シナモンAI広報担当です。 シナモンAIでは自然言語処理技術を用いたプロダクトの Aurora Clipper（オーロラ・クリッパー）をご提供しており、特定の文脈を持つ日付（イベント開催日や契約日等）や人物名（契約者の関係）の取得、長い文章からの要点抽出、テキストの分類など様々な用途で用いられる製品です。 今回は、Aurora Clipperの基礎となるモデルとして、LayoutLMと呼ばれるアルゴリズムを実験した結果をAurora Clipperの開発をリードする 藤井 からご紹介いたします。 テキストの位置を特徴として利用するLayoutLMとは？ LayoutLM（Layout Language Model）とは、Microsoft Re
GitHub - Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Model
If you're interested in the field of LLM, you may find the above list of milestone papers helpful to explore its history and state-of-the-art. However, each direction of LLM offers a unique set of insights and contributions, which are essential to understanding the field as a whole. For a detailed list of papers in various subfields, please refer to the following link: Awesome-LLM-hallucination -
GitHub - Dataherald/dataherald: Interact with your SQL database, Natural Language to SQL using LLMs
Query your structured data in natural language. | | Docs | Homepage Dataherald is a natural language-to-SQL engine built for enterprise-level question answering over structured data. It allows you to set up an API from your database that can answer questions in plain English. You can use Dataherald to: Allow business users to get insights from the data warehouse without going through a data analys
return to main site … A series about making a programming language called Eldiro using the Rust programming language. There’s an RSS Feed! Part Twenty: Testing 27 January 20213783 words19 minute readPart Nineteen: Code Representations 24 January 20214411 words22 minute readPart Eighteen: Errors 21 December 20206301 words32 minute readPart Seventeen: Crates 18 December 20202057 wordsten minute read
World Wide Web Consortium (W3C) brings a new language to the Web as WebAssembly becomes a W3C Recommendation
Following HTML, CSS and JavaScript, WebAssembly becomes the fourth language for the Web which allows code to run in the browser Read testimonials from W3C Members https://www.w3.org/ — 5 December 2019 — The World Wide Web Consortium (W3C) announced today that the WebAssembly Core Specification is now an official web standard, launching a powerful new language for the Web. WebAssembly is a safe, po
GitHub - nanochess/bootLogo: Logo language in 508 bytes (x86 boot sector)
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
GitHub - openai/CLIP: CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
GitHub - zag/js-pod6: Pod6 is an easy-to-use markup language. It can be used for writing language documentation, for documenting programs and modules, as well as for other types of document composition
Pod6 is an easy-to-use markup language. It can be used for writing language documentation, for documenting programs and modules, as well as for other types of document composition
Introduction to Go 1.19 The latest Go release, version 1.19, arrives five months after Go 1.18. Most of its changes are in the implementation of the toolchain, runtime, and libraries. As always, the release maintains the Go 1 promise of compatibility. We expect almost all Go programs to continue to compile and run as before. Changes to the language There is only one small change to the language, a
Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabilities for zero- and few-shot learning. Given their computational cost, these models are difficult to replicate without significant capital. For the few that are available through APIs, no access is granted to the full model weights, making them difficult to study. We present Open
Tier 4 Support § Support for these targets is entirely experimental. If this target is provided by LLVM, LLVM may have the target as an experimental target, which means that you need to use Zig-provided binaries for the target to be available, or build LLVM from source with special configure flags. zig targets will display the target if it is available. This target may be considered deprecated by
NVIDIA Releases Open Synthetic Data Generation Pipeline for Training Large Language Models
NVIDIA today announced Nemotron-4 340B, a family of open models that developers can use to generate synthetic data for training large language models (LLMs) for commercial applications across healthcare, finance, manufacturing, retail and every other industry. High-quality training data plays a critical role in the performance, accuracy and quality of responses from a custom LLM — but robust datas
Ian Lance Taylor 12 January 2021 Generics proposal We’ve filed a Go language change proposal to add support for type parameters for types and functions, permitting a form of generic programming. Why generics? Generics can give us powerful building blocks that let us share code and build programs more easily. Generic programming means writing functions and data structures where some types are left
// Simple predicates 'tacocat'.startsWith('taco') // Parameterized predicates over structured data account.balance >= transaction.withdrawal // JSON objects {'sub': '12345678', 'aud': 'example2.cel.dev', 'iss': 'https://example1.cel.dev/jwt-issuer'} // Strongly typed objects common.GeoPoint{ latitude: 10.0, longitude: -5.5 } Common Expression Language (CEL) is an expression language that’s fast, p
This book I got in a pile of FM TOWNS books turns out to be a lot more interesting that I was expecting an '80s C compiler manual to be. For as long as C and its relatives have been in mainstream use, it has been necessary to use vendor language extensions to actually get anything done with it, though in today's GCC/Clang/MSVC oligopoly those extensions tend to be focused on the yak-shaving detail
Epic Games released an initial public implementation of the Verse programming language. Verse has been designed by some people who really know what they’re doing: Lennart Augustsson Joachim Breitner Koen Claessen Ranjit Jhala Simon Peyton Jones Olin Shivers Tim Sweeney It’s amazing to see a CEO help design a programming language but Tim Sweeney has been advocating for functional programming in gam
A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
llrl programming language
github.com/yubrot/llrl Rust + LLVMで自作言語をセルフホスティングした話 Rust + LLVM による自作プログラミング言語処理系。大きな特徴は以下の 3 つ。 Hindley-Milner ベースの型推論による静的型付け (+型クラス) Lisp-like な S 式によるシンタックスと LLVM JIT によるマクロ 完全なセルフホスティングコンパイラ実装 目標: セルフホスティング llrl は複合的な理由で作り始めたが、とにかく一度完全にセルフホストされた言語処理系を実装したいという気持ちからセルフホスティングを最優先の目標とした。 プログラミング言語のセルフホスティングは、以下のような明確なゴールを設定できる。 何らかの既存のプログラミング言語によって自作言語コンパイラを実装する → 世代 0 自作言語、およびその標準ライブラリをコンパイラを実装
The use of NLP in the realm of financial technology is broad and complex, with applications ranging from sentiment analysis and named entity recognition to question answering. Large Language Models (LLMs) have been shown to be effective on a variety of tasks; however, no LLM specialized for the financial domain has been reported in literature. In this work, we present BloombergGPT, a 50 billion pa
KDL is a small, pleasing document language with xml-like semantics that looks like you're invoking a bunch of CLI commands! It's meant to be used both as a serialization format and a configuration language, much like JSON, YAML, or XML. It looks like this: package { name "my-pkg" version "1.2.3" dependencies { // Nodes can have standalone values as well as // key/value pairs. lodash "^3.2.1" optio
GitHub - HigherOrderCO/Kind: A next-gen functional language
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
A Tale of Yak Shaving: Accidentally Making a Language, for an Engine, for a Game
A Tale of Yak Shaving: Accidentally Making a Language, for an Engine, for a Game It's a wise saying, because we game developers have so much fun making the underlying foundations, that we never get around to adding the actual gameplay. This is an article about how badly I disregarded that advice, and what happened because of it. As you can guess, I made my own game engine. It was an gloriously unw
Language models (LMs) exhibit remarkable abilities to solve new tasks from just a few examples or textual instructions, especially at scale. They also, paradoxically, struggle with basic functionality, such as arithmetic or factual lookup, where much simpler and smaller models excel. In this paper, we show that LMs can teach themselves to use external tools via simple APIs and achieve the best of
GitHub - crablang/crab: A community fork of a language named after a plant fungus. All of the memory-safe features you love, now with 100% less bureaucracy!
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
Learn a language for free
Learn languages by playing a game. It's 100% free, fun, and scientifically proven to work.
GitHub - robertmuth/Cwerg: The best C-like language that can be implemented in 10kLOC.
Cwerg aims to be a complete "from-scratch" compiler for a C-like language. The frontend is WIP. The multi-target backend is fairly far along and can be used independently from the frontend. Documentation: Frontend Docs (misc. documentation) Cwerg Examples: Sexpr Syntax, Proposed Concrete Syntax Backend Docs (misc. documentation) Cwerg IR Examples (examples demonstrating backend API usage) Most com
Use lightweight templates to easily search and change code, HTML, or JSON. Comby is designed to work on any language or data format. Read the docs → Perform richer search and replace because Comby understands the syntax of code blocks, strings, and comments for your language. Install and try → Comby is ideal for touching up pieces of code. Use it to translate code like this Python 2 to 3 fixer on
Democratizing access to large-scale language models with OPT-175B
Democratizing access to large-scale language models with OPT-175B Large language models — natural language processing (NLP) systems with more than 100 billion parameters — have transformed NLP and AI research over the last few years. Trained on a massive and varied volume of text, they show surprising new capabilities to generate creative text, solve basic math problems, answer reading comprehensi
GitHub - holistics/dbml: Database Markup Language (DBML), designed to define and document database structures
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
TOML: Tom's Obvious Minimal Language
Kaggle コンペ Feedback Prize - English Language Learning でチーム参加15位金メダル取得で、Kaggle Master へ - A Day in the Life
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Vision and Language とその先へ
is Language man to unique | ならべかえ 英語 リスニング
Make A Language · Make A Language
Go 1.19 Release Notes - The Go Programming Language
OPT: Open Pre-trained Transformer Language Models
0.10.0 Release Notes ⚡ The Zig Programming Language
A Proposal for Adding Generics to Go - The Go Programming Language
CEL | Common Expression Language
The lost language extensions of MetaWare's High C Compiler
Type system of Fortnite's Verse language - BAM Weblog
GitHub - goccy/go-yaml: YAML support for the Go language
BloombergGPT: A Large Language Model for Finance
The KDL Document Language
Toolformer: Language Models Can Teach Themselves to Use Tools
Comby · Structural code search and replace for ~every language.