Redis の SortedSets 同点問題について - blog.nekokak.org
WEB+DBのRedis特集をひろせまさあきさんと共同で執筆しました。 WEB+DB PRESS Vol.73posted with amazlet at 13.03.05設樂 洋爾 白土 慧 奥野 幹也 佐藤 鉄平 後藤 秀宣 mala 中島 聡 堤 智代 森田 創 A-Listers はまちや2 大和田 純 松田 明 後藤 大輔 ひろせ まさあき 小林 篤 近藤 宇智朗 まかまか般若波羅蜜 Mr. O 技術評論社 売り上げランキング: 335 Amazon.co.jpで詳細を見る 買ってください。 このRedis特集の第五章では、Redisを使ったリアルタイムランキングについて取り上げたのですが、 記事中にある同点問題について、執筆時から状況が変わりましたのでupdateします。 記事中では、RedisのSortedSetsはスキップリストというアルゴリズムを使っている特性上、 同じス
Releasing bitmapist.cohort - or how we saved over $2000/month! - amix.dk
I released bitmapist a while ago and I am happy to release an extension that makes the library much more powerful! Installation and source code sudo pip install -U bitmapist Fork the code at Github. The reason why I implemented this I want to tell you why I coded this (and how we saved over $2000/month by having this library). I looked at Mixpanel's retention feature - which seems amazing. The pro
redis-faina: a query analysis tool for Redis
Welcome to the Instagram Engineering Blog, where we share insights on building and scaling our service. As we mentioned in our previous blog, we’re big fans of tools and techniques for introspecting our live traffic to see what exactly is going on. One tool we use frequently is PGFouine, a query traffic analyzer for PostgreSQL. We recently found that we also needed a similar tool for Redis, our sw
LINE Storage: Storing billions of rows in Sharded-Redis and HBase per Month « NAVER Engineers' Blog
Hi, I’m Shunsuke Nakamura (@sunsuk7tp). Just half a year ago, I completed the Computer Science Master’s program in Tokyo Tech and joined to NHN Japan as a member of LINE server team. My ambition is to hack distributed processing and storage systems and develop the next generation’s architecture. In the LINE server team, I’m in charge of development and operation of the advanced storage system whi
Redisのメモリ管理ポリシーについて
オンメモリ KVS の Redis では、使用メモリに上限を設定し、閾値を超えた場合のポリシー(maxmemory-policy)を複数の中から設定できるようになっている。 パラメータとポリシーを整理したのが以下 使用メモリの上限値 redis.conf の次のパラメータで設定する。 maxmemory maxmemory-policy メモリ使用量が閾値を超えている状況でキー追加する場合の振る舞いを定義する。以下の 6 つの maxmemory-policy から選択できる。 volatile-lru : remove the key with an expire set using an LRU algorithm allkeys-lru : remove any key accordingly to the LRU algorithm volatile-random : remove
YouPorn - Targeting 200 Million Views a Day and Beyond - High Scalability -
Update: Here's the video of the talk. Erick Pickup, lead developer at YouPorn.com, presented their architecture in a talk titled Building a Website To Scale given at the ConFoo conference. As you might expect, YouPorn is a beast, streaming three full DVDs of video every second, handing 300K queries every second, and generating up to 15GBs of log data per hour. Unfortunately, all we have are the s
Sparsegraph DotCom: Playing with Redis scripting: Calculating fibonacci numbers
Wednesday, February 29, 2012 Playing with Redis scripting: Calculating fibonacci numbers 2.6 のリリース前に redis scripting を堪能してみたよーという内容（ネタ）です. Redis 2.6 is now officially in feature freeze. Only bug fixing, new tests, and the pending merges will be done in the next weeks.— Salvatore Sanfilippo (@antirez) February 26, 2012 いよいよ Redis 2.6 のリリースが近づいてまいりました. 2.6 から新たに eval コマンドが導入されるわけですが, これによりサーバーサイドでの
Redback - A high-level Redis library for Node.JS
What is it? A fast, high-level Redis library for Node.JS. Redback provides an accessible and extensible interface to the Redis data types. You can use Redback as a Cache backend, a Pub/Sub provider, or to create complex data structures such as the SocialGraph, KeyPair or DensitySet. How do I get it? npm install -g redback Don't have NPM or Node.JS? Learn more See the GitHub repository for more inf
Redis bitmaps - Fast, easy, realtime metrics -
At Spool, we calculate our key metrics in real time. Traditionally, metrics are performed by a batch job (running hourly, daily, etc.). Redis backed bitmaps allow us to perform such calculations in realtime and are extremely space efficient. In a simulation of 128 million users, a typical metric such as “daily unique users” takes less than 50 ms on a MacBook Pro and only takes 16 MB of memory. Spo
圧縮された redis の dump をチェックするときのメモリリーク - Standard ML of Yukkuri
仕事で必要だったので redis のパッチを書いた.https://github.com/antirez/redis/pull/146memcached のように key をいっぱい redis に突っ込むとメモリリークしてるせいで dump のチェックが困難になるよーということがありました. key の名前のために確保した領域が free されていない. 即マージされたので, この間リリースされた 2.4.2 で解決してるはずです.redis の dump は圧縮すると非常にコンパクトになりますが, 中身を把握しづらくなりデバッグが面倒になるというデメリットがあります. 圧縮された dump ファイルの中身を見てどうにかするプログラムを書きたいという要望があり, redis-check-dump をベースにプログラムを書く際に見つけた次第. 圧縮自体は lzf_d.c lzf_decom
Scripting branch released
Warning: the scripting API was modified in recent versions of 'scripting' and '2.2-scripting' branch. Now Lua can call Redis commands using Redis.call('get',...) instead of Redis('get',...). Also the EVALSHA command is now available in both branches. As expected I did not resisted to the temptation of implementing a branch with Lua scripting support for Redis, and this weekend was the right moment
Mneme: Scalable Duplicate Filtering Service - igvita.com
By Ilya Grigorik on March 24, 2011 Detecting and dealing with duplicates is a common problem: sometimes we want to avoid performing an operation based on this knowledge, and at other times, like in a case of a database, we want may want to only permit an operation based on a hit in the filter (ex: skip disk access on a cache miss). How do we build a system to solve the problem? The solution will d
SETBIT
SETBIT key offset value Available since: 2.2.0 Time complexity: O(1) ACL categories: @write, @bitmap, @slow, Sets or clears the bit at offset in the string value stored at key. The bit is either set or cleared depending on value, which can be either 0 or 1. When key does not exist, a new string value is created. The string is grown to make sure it can hold a bit at offset. The offset argument is r
Redis - The Real-time Data Platform
# Create a vector index using the HNSW algorithm, 768 dimension length, and inner product distance metric > FT.CREATE idx-videos ON HASH PREFIX 1 video: SCHEMA content_vector VECTOR HNSW 6 TYPE FLOAT32 DIM 768 DISTANCE_METRIC IP content TEXT metadata TEXT # Add a video vector with metadata > HSET video:0 content_vector “\xa4q\t=\xc1\xdes\xbdZ$<\xbd\xd5\xc1\x99<b\xf0\xf2<x[…\xf8<” content “SUMMARY:
Presentation: Redis, The Hacker's Database - amix.dk
Today I did a presentation on Redis for engineers at Google's Taipei office. My presentation isn't only about Redis, but on designing simple solutions, scaling to millions of users and the strategies and philosophy that I follow. I enjoyed giving this presentation, even thought it was a big challenge for me since presenting isn't something I regularly do, but I like challenges. Thanks for Ping and
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
GitHub - chriso/redback: A high-level Redis library
Redis and scripting
Easy comet with ruby and redis :: OpenHood
Google Code Archive - Long-term storage for Google Code Project Hosting.
1,250,000,000 Key/Value Pairs in Redis 2.0.0-rc3 on a 32GB Machine