Speeding up Linux disk encryption
Data encryption at rest is a must-have for any modern Internet company. Many companies, however, don't encrypt their disks, because they fear the potential performance penalty caused by encryption overhead. Encrypting data at rest is vital for Cloudflare with more than 200 data centres across the world. In this post, we will investigate the performance of disk encryption on Linux and explain how w
Everything I've seen on optimizing Postgres on ZFS
UPDATE (2021/12/21) After lots of feedback on Reddit (thanks /u/BucketOfSpinningRust!) and doing some more experimenting and digging, I've updated this post with more information -- new/updated sections are marked "Update". tl;dr - Tips for running Postgres on (Open)ZFS-on-Linux (ZoL), which I’m nicknaming “PoZoL”, check out the TOC (or skip to the resource list at the bottom) and browse to whatev
Fast CSV processing with SIMD
This article was discussed on Hacker News. I recently learned of csvquote, a tool that encodes troublesome CSV characters such that unix tools can correctly process them. It reverses the encoding at the end of the pipeline, recovering the original input. The original implementation handles CSV quotes using the straightforward, naive method. However, there’s a better approach that is not only simpl
GitHub - google/tcmalloc
All users of TCMalloc should consult the following documentation resources: The TCMalloc Quickstart covers downloading, installing, building, and testing TCMalloc, including incorporating within your codebase. The TCMalloc Overview covers the basic architecture of TCMalloc, and how that may affect configuration choices. The TCMalloc Reference covers the C and C++ TCMalloc API endpoints. More advan
条件分岐とcmovとmaxps
3. 自己紹介 光成滋生（サイボウズ・ラボ） 姑息な最適化が大好き 以前はコーデック系の趣味・仕事をやっていた 最近は仕事のために機械学習を勉強中 PRMLあんちょこ公開中（https://github.com/herumi/prml/） blog : http://homepage1.nifty.com/herumi/ mail : herumi@nifty.com twitter : @herumi 3 /24 5. プロファイル プロファイラ 関数組み込みタイプ プログラム自体に組み込まれる それ自体がプログラムに影響を与える 回数は正確 gprofやDevPartner, Vtune タイミング割り込みによる集計タイプ 割り込みでその瞬間のeipを取得し集計 プログラムに影響を（殆ど）与えない 回数は不正確，時間は概ね正確 CodeAnalys
高負荷システムでNVMeデバイス使用時のfstrimとdiscard mount optionの話 - たごもりすメモ
先にまとめると ディスクI/Oに高い負荷をかけるシステムでNVMeデバイスを使うときweekly cron jobでfstrimが走る状況になってたら停止しろ じゃないとfstrimが走った瞬間にI/Oパフォーマンスが刺さって死ぬ fstrimを停止するならdiscard mount optionを有効化しろ、ただしその状態でのI/O性能で問題ないかどうか測っておけ discard mount optionを有効化しても大きいファイルの削除には気をつけろ、プチfstrimみたいになるぞ 追記されるばかりで大きくなるファイル(そして削除されるファイル)はNVMeじゃないデバイスに置いとけ 高I/Oスループットを期待するシステムでのNVMeとfstrim 社内で小さめのインスタンスを多く並べてトラフィックを捌いてたのを色々要件があって大きめのインスタンスにまとめるようなシステムアップデートをや
Scaling SQLite to 4M QPS on a Single Server (EC2 vs Bare Metal)
Expensify has an unusual technology stack in many ways. For example, we don't use DNS internally -- just configuration-managed /etc/hosts files -- and it works great. Similarly, we only make limited use of AWS -- instead hosting our own hardware for the web and database layer -- and it works great. But most surprising of all is that we don't use MySQL or Postgres -- instead using none other tha
Intel MKL on AMD Zen | Daniël de Kok
Introduction Disclaimer: this post investigates how recent MKL versions behave on Zen CPUs. You should read the MKL license before using MKL. I shall not be held responsible for how you use MKL. Intel MKL has been known to use a SSE code paths on AMD CPUs that support newer SIMD instructions such as those that use the Zen microarchitecture. A (by now) well-known trick has been to set the MKL_DEBUG
Measuring the memory-level parallelism of a system using a small C++ program? – Daniel Lemire's blog
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Process priority and cpu speed
The container throttling problem
GitHub - cifsd-team/ksmbd: ksmbd kernel server(SMB/CIFS server)
GitHub - nitely/nim-regex: Pure Nim regex engine. Guarantees linear time matching
Bug #1856335 “Cache Layout wrong on many Zen Arch CPUs” : Bugs : QEMU
[PATCH RFC 2/2] futex: Implement mechanism to wait on any of several futexes - Gabriel Krisman Bertazi
The 5-year journey to bring restartable sequences to Linux - EfficiOS
GitHub - clearlinux/make-fmv-patch
Open Ecosystem
Intel® Memory Drive Technology
[RFC PATCH] mm, page_alloc: double zone's batchsize - Aaron Lu