サクサク読めて、アプリ限定の機能も多数!
トップへ戻る
Pixel 9
yahooeng.tumblr.com
By Jay Mahadeokar and Gerry Pesavento Automatically identifying that an image is not suitable/safe for work (NSFW), including offensive and adult images, is an important problem which researchers have been trying to tackle for decades. Since images and user-generated content dominate the Internet today, filtering NSFW images becomes an essential component of Web and mobile applications. With the e
(Yahoo Storm Team in alphabetical order) Sanket Chintapalli, Derek Dagit, Bobby Evans, Reza Farivar, Tom Graves, Mark Holderbaugh, Zhuo Liu, Kyle Nusbaum, Kishorkumar Patil, Boyang Jerry Peng and Paul Poulosky. DISCLAIMER: Dec 17th 2015 data-artisans has pointed out to us that we accidentally left on some debugging in the flink benchmark. So the flink numbers should not be directly compared to the
By Aaron Klish & Jon Kilroy Mobile and client-side web applications have been reshaping the design principles of service layer APIs. Business logic traditionally implemented on the server and exposed as functions (think RPC) has morphed into exposing data and shifting that logic to the application. Object hierarchies and graphs are one of the most common and natural forms for data representation a
NodeConf 2014 was fantastic! I love the format, and the location. It was my first NodeConf, and I enjoyed every bit of it. Except the Internet connection. While the WiFi itself was fine, with hundreds of us trying to download packages from the npm registry at the same time, the tiny Internet connection at Walker Creek Ranch left something to be desired. Some folks set up their own registry mirrors
Yahoo stores more than 250 Billion objects and half an exabyte of perpetually durable user content such as photos, videos, email, and blog posts. Object storage at Yahoo is growing at 20-25% annually. The growth is primarily driven by mobile, images, video, and user growth. Yahoo is betting on software defined storage to scale storage cost effectively along with the durability and latency guarante
Pistachio: co-locate the data and compute for fastest cloud compute https://github.com/yahoo/Pistachio is a distributed key value store system. Data can be replicated with n replicas with strong consistency guarantees. Up to (n-1) failures can be tolerated. It’s being used as the user profile storage for large scale ads serving products within Yahoo. 10+ billions of user profiles are being stored
Background: We blogged about the evolution of Yahoo Mail to React + Flux and Node.js. It is important to focus on building a strong foundation when you are building a new platform and having a robust test infrastructure is a big part of the foundation. Yahoo Mail today relies on automated testing on our Continuous Integration pipeline before we deploy changes to production. We run Cucumber and Wai
The NodeJS Platform Team has released several express/connect middleware packages which provide various useful features for NodeJS based Applications. Here is a brief summary for each of them. dnscache - npm - gitIf your app is using node dns api require('dns') a lot and you want to cache your dns calls, this is the module. It comes with a built-in in-memory cache with various configuration params
Kafka is used by many teams across Yahoo. The Media Analytics team uses Kafka in our real-time analytics pipeline. Our Kafka cluster handles a peak bandwidth of more than 20Gbps (of compressed data). In order to make it simple for our Developers and Service Engineers to maintain our Kafka clusters, we built a web-based tool that we call Kafka Manager. This interface makes it easier to identify top
From the minds that brought you gifshot! Today we’re proud to open source cronshot, a node module that allows you to schedule, take, alter, and store web page screenshots. Cronshot provides an intuitive API for scheduling time-based and/or individual screenshot tasks. This makes it extremely easy to create a customized and automated screenshot solution. Here’s a simple example that takes a screens
[Performance Comparison] NOTES: These are single-process, single-thread timings. LevelDB does not support multi-process usage, and many features must be lock-protected externally. MDBM iteration (sequential read) is un-ordered. Minimal tuning was performed on all of the candidates. How does MDBM achieve this performance? There are two important components. “Memory Mapping” - It leverages the kerne
The Yahoo User Interface library (YUI) has been in use at Yahoo since 2005, and was first announced to the public on February 13, 2006. Although it has evolved tremendously since that time, YUI has always served the same overarching purpose of providing a comprehensive toolkit to make it easier for developers to create rich web applications. As such, YUI is an important part of Yahoo’s history: mi
The YUI team at Yahoo is serious about automated testing. YUI is a foundational part of Yahoo websites, so it’s very important that we keep quality high. Our test automation system has ran over 31 million tests in the last 6 months across over a dozen challenging browser environments, with an average of over 188,000 tests ran every day. We build programs with Node.js that help build and test YUI,
Do you have a NodeJS application serving production traffic? Ever wonder how Yahoo might handle this? If yes, at some point or other you must have thought it would be nice to have a clean and simple solution for high availability. Read below for a detailed overview of how you can achieve this just like we did here at Yahoo. What modules are needed?monitr https://npmjs.org/package/monitrprocess-wat
https://github.com/yahoo/samoa Machine learning and data mining are well established techniques in the world of IT and especially among web companies and startups. Spam detection, personalization and recommendations are just a few of the applications made possible by mining the huge quantity of data available nowadays. However, “big data” is not only about Volume, but also about Velocity (and Vari
Yahoo recently submitted work to Storm that allows the messaging layer to be pluggable and provides an implementation based on Netty. This is an important step for many reasons. It enables Storm to run without dependencies on native library, and thus simplifies Storm deployment onto any OS and to the cloud. It opens up a path to add authentication and authorization to the connections between work
このページを最初にブックマークしてみませんか?
『Yahoo Engineering』の新着エントリーを見る
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く