サクサク読めて、アプリ限定の機能も多数!
トップへ戻る
災害への備え
jeremy.zawodny.com
Last week I delivered a talk titled "MySQL and Search at Craigslist" as part of the 2009 MySQL Conference and Expo. I talked about some of the good and bad of our MySQL work and also talked a lot about our recent Sphinx deployment. The slides are embedded below and here, thanks to SlideShare. (Anyone know why Google Docs doesn't yet handle OpenOffice presentations?) I gave a copy to O'Reilly but d
About a week ago, Nat posted Open Source NG Databases on O'Reilly Radar. That caught my interest because I'm playing with some "alternative" databases for some of our data at Craigslist. Don't get me wrong, MySQL is great. But MySQL isn't well suited to every use case out there either. (I'll talk more about this at the MySQL Conference.) Meanwhile, I left a comment on that posting about CouchDB an
I occasionally wish to know the IP address of my home Cable Modem or DSL connection but don't really care if it's available in DNS or not. It occurred to me that if I could programmatically detect the IP change, I'd be able to notify myself via Twitter. At first, I wanted a simple web service that'd tell me my IP address--something like WhatIsMyIP.com but an API suitable for simple scripting. Not
Interesting things are afoot in the MySQL world. You see, it used to be that the MySQL world consisted of about 20-40 employees of MySQL AB (this funny distributed Swedish company that built and supported the open source MySQL database server), a tiny handful of MySQL mailing lists, and large databases were counted in gigabytes not terabytes. A Pentium III was still a decent server. Replication wa
I've been hacking on some Perl code that extracts data that comes from web users around the world and been stored into MySQL (with no real encoding information, of course). My goal it to generate well-formed, valid XML that can be read by another tool. Now I'll be the first to admit that I never really took the time to like, understand, or pay much attention to all the changes in Perl's character
Dear Lazyweb, I'm interested getting an idea of what open source message queueing systems exist that are fast, stable, and have some good replication (think multi-colo) and fault tolerance built-in. The idea being, of course, that some processes want to send messages into a queue (of work to be done) and other processes will fetch those and do stuff with them. Ideally, I'm looking for a system tha
I wasn't really looking for a new job a few months ago when I received an email from Eric Scheide (see Team Bios), the CTO at craigslist. He mentioned that they were looking for someone with MySQL experience and asked if I knew anyone. This sort of thing happens all the time. But this time it was different. Over the course of about three seconds, something clicked in my little brain and I realized
It seems that word has started to leak out, so I might as well remove any speculation or ambiguity. In the next few weeks, I'll walk the halls at Yahoo! as an employee one last time and turn in my purple badge. After 8.5 years of service and a better experience than I could have possibly imaged back in 1999, the time for me to move on has arrived. It's always hard to make a decision like this. It
NAME SYNOPSIS AVAILABILITY REQUIREMENTS Optional Color Support Optional Hi-Res Timing Platforms DESCRIPTION The Basics The Display Arguments Config File Shortcut Keys BUGS AUTHOR DISCLAIMER RECRUITING SEE ALSO COPYRIGHT CREDITS LICENSE NAME mytop - display MySQL server performance info like `top' SYNOPSIS mytop [options] AVAILABILITY The latest version of mytop is available from http://jeremy.zawo
Yahoo! FireEagle: Personal Location Service Platform for Developers Today FireEagle launched as an invitation-only beta for developers to start testing. I think of it as a personal location service platform, but the more formal description comes from the announcement on the YDN blog: Fire Eagle is an open location services platform offering web, mobile, and desktop developers a simple way to build
Hadoop Reactions & Announcement of Hadoop Summit at Yahoo! I have to say, I'm impressed at the coverage that news about our production Hadoop deployment in Yahoo! Search got yesterday (and today). Here's a quick list of the stories. Yahoo! Launches World's Largest Hadoop Production Application by Eric Baldeschwieler Yahoo! Search running Apache Hadoop on Large Scale by me Open source grid computin
It's been about a day since I first started reading and talking about Microsoft's $44 billion buyout offer for Yahoo (my current employer). And I have to say, it's been quite fascinating so far. In all the reading I've done and discussions I've had, numerous scenarios have emerged. I don't claim (beyond a gut feel) to know how likely any of them are, but I figured I'd list them here for the sake o
The other day after I wrote There is no Web Operating System (or WebOS), I noticed that a few people had bookmarked it in del.icio.us. This is nothing new. From time to time I see people using del.icio.us to save a reference to something I write, maybe jotting down a note or saving a brief excerpt along the way. But I checked back a day later to find that a number of people had saved it (31 at the
Though I changed my relationship status from "In a Relationship" to "Engaged" a few weeks ago in my Facebook profile, it's time that I just came out in a more public forum. So here it is: I'm engaged to be married to a truly amazing woman later this year. While we started dating late last year (mid-October to be exact), I've been pretty quiet about it online. That's partly because I didn't want to
For far too long now RSS has been used in ways that don't really tap its true potential. Being able to syndicate my favorite headlines or blog posts is great. In fact, it helped to kick off a revolution in personal on-line publishing that is still growing and evolving. But I want so much more. It's not for lack of vision. Back in 2005, Adam Bosworth painted a vision that eventually manifested itse
[Disclaimer: Though I work at Yahoo and know several Microsoft folks, I have absolutely no insider knowledge related to this post.] Every now and then someone floats that idea that what Microsoft most needs to "win" on the Web is to buy someone else, typically AOL or Yahoo. Henry Blodget's Microsoft's Long, Slow Slide Into Web Irrelevance, Greg Linden's Is Microsoft's Web war lost?, and John Batte
I'm not sure if this is stupidity, laziness, or a mix of both, but check this out. Back when IE7 launched, Yahoo! created a customized version and began to market it to our existing IE users. The "splash page" looked like this: Today it seems that Google has similar intentions. So similar, that they decided to basically copy our page and slightly Googlify it. If you look, the design, layout, and m
In an effort to replace my home backup server with Amazon's S3, I've been collecting a list of Amazon S3 compatible backup tools to look at. Here's what I've discovered, followed by my requirements. The List I've evaluated exactly zero of these so far. That's next. s3sync.rb is written in Ruby as a sort of rsync clone to replace the perl script s3sync which is now abandonware. Given that I already
Not too long ago, Amazon released their Simple Storage Service (or "S3" for short). It provides a hosted storage platform which developers can build all sorts of applications on top of. Smugmug, a popular photo sharing web site, is using it to store and host pictures. I've been considering using S3 as the backend to an on-line backup, since I'd been beating that for a while (see: Swimming Pools an
Last night I mentioned that we'd have a few more announcements on the Yahoo! Developer Network today. I just posted the latest: Browser Based Authentication or BBAuth as we like to call it. Our Browser Based Authentication (BBAuth) is a generic mechanism that will allow users to grant 3rd party web-based applications access their Yahoo! data. There's already a similar mechanism in place on Flickr
From the API news department... del.icio.us API over https My linkblog recently broke for a bit. It's powered by del.icio.us and a bit of curl and Perl. Luckily Toby pinged me to say "hey dumbass, fix your script..." Why? There's a new API in place. The new API is pretty much the same, except that it's now accessible via https rather than http and it versioned as well. So my old "fetch all bookmar
A few weeks ago, Matt McAlister wrote Thoughts about working at Yahoo! after one year in which he summarized his favorite and not so favorite things about working here. I'd like to enumerate his 13 points and add my take, as someone who has worked in different parts of Yahoo for a bit longer. Why? Because that's what blogs are for. That and pictures of kittens. The Good Open Minds. Agreed that peo
I've been programming (when I do program) mainly in Perl for the last 10 years or so. But I've been itching to learn a new language for a while now, and the two near the top of the list are Ruby and Python. I figure that Ruby would be easy to learn because of its similarity to Perl (I'm told). But I also figure that Python would be easy to learn because of its simplicity. And when it comes to webb
Google's GData, MySQL, and the Future of on-line Databases In reading Richard MacManus' Why Google is extending RSS, I couldn't help feeling that he was missing the point a bit. It's as if he was focusing on the small things ("Why RSS?") rather than looking at the bigger picture of where all this is going. It's not about building an easier onramp to Google Base. Well, it is. But, again, that's the
mybench - simple benchmarking tool for MySQL About mybench is a simple benchmarking framework for MySQL, written in Perl. I consists of a module (MyBench.pm) and an example script (bench_example) that you should customize to suit your needs. mybench is more completely described in Chapter 3 (Benchmarking) of High Performance MySQL. Links Download - a tar.gz file News August 29th, 2004 Version 1.0
Before heading off to SES New York (I still need to pack), I took a minute to try out the new Ask.com (formerly Ask Jeeves): And noticed some striking similarities to Google: Common colors for sponsored links (though the ones on Ask.com don't "work" if you click in the bluespace that has no text under it), navigation at the top and bottom, color bar, and so on. Heh. Posted by jzawodn at February 2
It's been fun to watch the evolution of Gmail's spam filtering. In the early days, it was laughably bad. Even the most basic spam, the stuff that SpamAssassin would score in the 20+ range, would make it through. But today things are quite a bit different. Based on my experience, the spam detection and filtering in Gmail is as good as Yahoo's SpamGuard. Though I don't regularly use Yahoo! Mail, we
It was nearly 10 years ago (mid 1996) that I first put my own web server on the Internet. Back in college, I managed to convince one of the staff to give my personal computer a static IP address so that I could run a web server. At the time there were no other student computers on the campus network, let alone with static addresses. It was a year of firsts for me and for the University. At the tim
Wow, it's been a busy week. I was totally swamped for several days dealing with the remember.yahoo.com MySQL servers and related stuff. And then I used a day or two to recover (sleep, shower, etc). Anyway, I made some interesting discoveries along the way. The most surprising one had to do with thread caching on Linux when you have a busy MySQL server--busy in a particular way, mind you. You see,
次のページ
このページを最初にブックマークしてみませんか?
『Jeremy D. Zawodny - Home Page』の新着エントリーを見る
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く