Rubyは標準ライブラリにRuby lexer/parserがあるのがいい - Islands in the byte stream (legacy)これは特筆すべき特徴だと思う。ヒアドキュメントもちゃんと処理できる。 require "ripper" require "pp" src = <<'END' def foo p [<<-"A", <<-"B"] Hello, %{"Ruby"} world! A one, two three B end END pp Ripper.lex(src) 結果: [[[1, 0], :on_kw, "def"], [[1, 3], :on_sp, " "], [[1, 4], :on_ident, "foo"], [[1, 7], :on_nl, "\n"], [[2, 0], :on_sp, " "], [[2, 2], :on_ident, "p"], [[2, 3], :on_sp, " "], [[2, 4], :on_lbracket, "["], [[2, 5], :on_hered
