Anyone using DBD::SQLite and $dbh->{unicode} attribute set?It has a long standing bug where it assumes passed strings internal encoding is UTF-8 when inserting values into the database.http://svn.ali.as/cpan/trunk/DBD-SQLite/t/rt_25371_asymmetric_unicode.t is a failing test by Juerd and http://gist.github.com/90590 is my patch to fix that. This patch still passes all tests, including 12_unicode.t

I just started writing my slides midnight before the conference (which is very usual) and trimmed the number of modules I talk about down to 10. I think the talk went really well, especially my evil script to authenticate the wireless access using WWW::Mechanize :)http://www.slideshare.net/miyagawa/20-modules-i-havent-yet-talked-about/

YAPC::Asia has become huge. This year we've got 550 registrations and I think this is one of the biggest YAPCs ever.However, our organization team has been getting smaller year by year, maybe because we knew we can do this. I live in San Francisco, USA and remotely organize the conference for this 2 years, just like any other project managers do for a project. That means, the real tough work has b

YAPC::Asia 2008 organizers would like to thank Eric Cholet, the author of ACT for the great conference organizing software that powers most of YAPCs and Perl Workshops.To show the appreciation in the hacker's way, I'm flying to Paris, France next weekend (April 25-28) funded by YAPC::Asia possible profit, to work on Act feature enhancement.We plan to work on these things because we want them for Y

(Editorial: Don't frontpage this post, editors. I write it down here to summarize my thought, wanting to get feedbacks from my trusted readers and NOT flame wars or another giant thread of utf-8 flag woes)I can finally say I fully grok Unicode, UTF-8 flag and all that stuff in Perl just lately. Here are some analysis of how perl programmers understand Unicode and UTF-8 flag stuff.(This post might

Question: Is it possible to annotate/tag each CPAN module update so that we can figure out if the update contains "security fix", "minor bug fix" or "major API change" etc.?Context: At work we have a repository of third party CPAN modules that we use on Vox or TypePad. Once a module is added to the list, we manually follow the changes of each module to figure out if we need to upgrade (ala fix for

Web::Scraper with filters, and thought about Text filters A developer release of Web::Scraper is pushed to CPAN, with "filters" support. Let me explain how this filters stuff is useful for a bit.Since an early version, Web::Scraper has been having a callback mechanism which is pretty neat, so you can extract "data" out of HTML, not limited to the string.For instance, if you have an HTML

On this monday (in Japan time) we had Shibuya.pm Tech Talks #8 and we live-streamed and recorded most talks on ustream.tv under shibuya.pm tag. This ustream.tv listing works great but we want to make the Flash video files available for download, possibly as a videocast (RSS 2.0) feed so you can subscribe to using offline video player like Miro or iTunes.So we were chatting on #plagger-ja IRC chann

While I'm in Japan for two weeks, Shibuya Perl Mongers folks kindly setup another technical meeting on 10/1 night.See the details of the meeting but we're gonna have lots of interesting talks, including my re-doing YAPC::EU's well accepted Web::Scraper talk and gugod's talk about JavaScript::Writer, since he's visiting Japan from Taiwan at the same time as I'm here.Shibuya.pm tech talk event gets

Web::Scraper 0.14 is released along with a couple of neat features.First of all, I incorpolated HTML::Tagset's linkElements hash into '@attr' accessor of elements, so if you do this: $s = scraper { process "a", "links[]" => '@href' }; $s->scrape(URI->new("http://www.example.com/")); because a@href is known to be link elements, they're automatically converted to absoltue URI using http://www.exampl

This is inspired by an email from Renée Bäcker asking how to get content inside javascript tag. Because Web::Scraper's 'TEXT' mapping calls as_text method of HTML::Element, it doesn't get the content inside script and style tag. Here's the code that works. It's kinda clumsy, and it'd be nice if there's much cleaner way to do this: #!/usr/bin/perl # extract Javascript code into 'code' use strict; u

I'm trying to put some neat cookbook things using Web::Scraper on this journal. They'll eventually be incoropolated into the module document like Web::Scraper::Cookbook, but I'll post here for now since it's easy to update and give a permalink to.The easiest way to keep up with these hacks would be to subscribe to the RSS feed of this journal, or look at my del.icio.us links tagged 'webscraper' (w

Web::Scraper is released, the Perl port of Scrapi.rb Today I've been thinking about what to talk in YAPC::EU (and OSCON if they're short of Perl talks, I'm not sure), and came up with a few hours of hacking with web-content scraping module using Domain Specific Languages.With help from guys on IRC channel and obra who gave a nice talk about DSL in Perl at YAPC::Asia, I whipped up a really small We

Investigating the UTF-8 on/off performance issues for work. Template::Stash::ForceUTF8 does utf8_on calls to all stash variables, which could be crucial to perfomance to the large-scale site like ours.Looking through TT source code, I came up with the simple hack to add 'use encoding "utf-8"' to the generated code by TT. This solves the utf-8 bytes and string concatination (auto-upgrades from lati

Encode::First is now going to CPAN, or can be downloaded from my svn repo: http://svn.bulknews.net/repos/public/Encode-First/trunk/Thanks to Juerd and Aristotle for valuable feedbacks.Meanwhile I found another bug in Encode::JP::JIS7, which encodes all un-encodable characters into PERLQQ format, when we specify "iso-2022-jp" as an encoding. This is a serious bug and reported to Dan and on perl-uni

I want a name for my new module, that automatically detects the best, conservative encodings to be used in Email messages, from the strings.It'll be useful to encode email message in iso-2022-jp if all content are in Japanese, iso-2022-kr for Korean etc. Gmail does it by default: http://mail.google.com/support/bin/answer.py?ctx=gmail&hl=en&answer=22841I'm thinking of Encode::Email::Best and Encode

Data::ObjectDriver, yet another ORM we are using in Six Apart, now uses Class::Trigger and our develoeprs team in Vox and Movable Type have reported the bug in the module where triggers added to the superclass *after* triggers are added to the child class are ignored in the child classes.I fixed the module by applying the patch from Brad Choate and uploaded the new version 0.10_01 on CPAN. Meanwhi