GitHub - nalgeon/sqlean: The ultimate set of SQLite extensions
SQLite has few functions compared to other database management systems. SQLite authors see this as a feature rather than a problem, because SQLite has an extension mechanism in place. There are a lot of SQLite extensions out there, but they are incomplete, inconsistent and scattered across the internet. sqlean brings them together, neatly packaged into domain modules, documented, tested, and built
Evidence-based policy - Wikipedia
Evidence-based policy (also known as evidence-based governance) is a concept in public policy that advocates for policy decisions to be grounded on, or influenced by, rigorously established objective evidence. This concept presents a stark contrast to policymaking predicated on ideology, 'common sense', anecdotes, or personal intuitions. The methodology employed in evidence-based policy often incl
DDSketch: A fast and fully-mergeable quantile sketch with relative-error guarantees
Summary statistics such as the mean and variance are easily maintained for large, distributed data streams, but order statistics (i.e., sample quantiles) can only be approximately summarized. There is extensive literature on maintaining quantile sketches where the emphasis has been on bounding the rank error of the sketch while using little memory. Unfortunately, rank error guarantees do not precl
GitHub - google/differential-privacy: Google's differential privacy libraries.
Note If you are unfamiliar with differential privacy (DP), you might want to go through "A friendly, non-technical introduction to differential privacy". This repository contains libraries to generate ε- and (ε, δ)-differentially private statistics over datasets. It contains the following tools. Privacy on Beam is an end-to-end differential privacy framework built on top of Apache Beam. It is inte
Zipf's law - Wikipedia
Zipf's Law on War and Peace.[1] The lower plot shows the remainder when the Zipf law is divided away. It shows that there remains significant pattern not fitted by Zipf law. A plot of the frequency of each word as a function of its frequency rank for two English language texts: Culpeper's Complete Herbal (1652) and H. G. Wells's The War of the Worlds (1898) in a log-log scale. The dotted line is t
Dieharder: A Random Number Test Suite - Robert G. Brown's General Tools Page
Welcome to the dieharder distribution website. Version 3.29.4beta is the current snapshot. Some of the documentation below may not quite be caught up to it, but it should be close. Dieharder is a random number generator (rng) testing suite. It is intended to test generators, not files of possibly random numbers as the latter is a fallacious view of what it means to be random. Is the number 7 rando
datamash - GNU Project - Free Software Foundation
GNU datamash GNU datamash is a command-line program which performs basic numeric, textual and statistical operations on input textual data files. Examples: calculate the sum and mean of values 1 to 10: $ seq 10 | datamash sum 1 mean 1 55 5.5 group text file by one column and calculate mean and sample standard deviation on another, with automatic sorting and header line processing: $ datamash --sor
新発見の統計的有意性のp値の閾値は5%から0.5%に下げよ - himaginary’s diary
と主張する論文が現下の統計学における最もホットなトピック／議論／展開である、としてFrancis Dieboldが紹介している。論文のタイトルはズバリ「統計的有意性の再定義（Redefine Statistical Significance）」で、Nature Human Behaviorに掲載予定との由。著者は総勢72名に及び、こちらのエントリで紹介したErnst Fehrも名を連ねているほか、日本人では今井耕介氏やShinichi Nakagawa氏の名前も見受けられる*1。 その1行要旨（One Sentence Summary）は概ね表題の通りで、原文は「We propose to change the default P-value threshold for statistical significance for claims of new discoveries from
Silence speaks louder than words when finding malware
In Android Security, we're constantly working to better understand how to make Android devices operate more smoothly and securely. One security solution included on all devices with Google Play is Verify apps. Verify apps checks if there are Potentially Harmful Apps (PHAs) on your device. If a PHA is found, Verify apps warns the user and enables them to uninstall the app. But, sometimes devices st
Don't use Bandit Algorithms - they probably won't work for you
Several years back, I wrote an article advocating in favor of using bandit algorithms. In retrospect, the article I wrote was incorrect, and I should have phrased it differently. I made no mathematical mistakes in the article. Every fact I said is true. But the implications of this article and the way it has been interpreted by others is deeply wrong, and I'm going to take the opportunity now to c
5 Common Mental Errors That Sway You From Making Good Decisions
5 Common Mental Errors That Sway You From Making Good Decisions I like to think of myself as a rational person, but I’m not one. The good news is it’s not just me — or you. We are all irrational, and we all make mental errors. For a long time, researchers and economists believed that humans made logical, well-considered decisions. In recent decades, however, researchers have uncovered a wide range
差分プライバシーとは何か？ （定義 & 解釈編）
本スライドは、弊社の梅本により弊社内の技術勉強会で使用されたものです。 近年注目を集めるアーキテクチャーである「Transformer」の解説スライドとなっております。 "Arithmer Seminar" is weekly held, where professionals from within and outside our company give lectures on their respective expertise. The slides are made by the lecturer from outside our company, and shared here with his/her permission. Arithmer株式会社は東京大学大学院数理科学研究科発の数学の会社です。私達は現代数学を応用して、様々な分野のソリューションに、新しい高度AIシステム
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
GitHub - dressipi/apv-median: C library for streaming median approximation
Survivorship Bias in Startups | HackerNoon
Sequential probability ratio test - Wikipedia
GitHub - google/rappor: RAPPOR: Privacy-Preserving Reporting Algorithms
GitHub - PAIR-code/facets: Visualizations for machine learning datasets
GitHub - CamDavidsonPilon/tdigest: t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark
GitHub - matsumotory/mruby-changefinder: ChangeFinder class detect change points via continuous outlier and smoothing.
statsmodels