Hacker News on BigQuery: Now with daily updates — So what are the top domains?
Author’s note: I left Google in 2020, hence these posts haven’t been updated to the latest features. But I’m still having fun with Hacker News’ data — this time with Snowflake. Thanks to the BigQuery Public Datasets Program, we now update Hacker News in BigQuery daily. Nothing better than having fresh data to analyze every day. To celebrate the occasion, I want to look at the top domains that Hack
The top GitHub projects per country
Step 1: The most popular GitHub project per country — naive countThe first pass results are somehow monotone, and not surprising: FreeCodeCamp was the most starred GitHub project by far in 2016: The most starred project per country on GitHub during 2016 — naive count.Step 2: What about the 2nd most popular project for each country? The 2nd most starred project per country on GitHub during 2016 — n
400,000 GitHub repositories, 1 billion files, 14 terabytes of code: Spaces or Tabs?
The rules:Data source: GitHub files stored in BigQuery.Stars matter: We’ll only consider the top 400,000 repositories — by number of stars they got on GitHub during the period Jan-May 2016.No small files: Files need to have at least 10 lines that start with a space or a tab.No duplicates: Duplicate files only have one vote, regardless of how many repos they live in.One vote per file: Some files us
Analyzing GitHub issues and comments with BigQuery
Some people have asked “can we analyze GitHub issues on BigQuery?”. Good news: While that data is not part of the new open source GitHub code on BigQuery dataset, you can find this in the classic GitHub Archive dataset. Let’s quickly find the 10 repos with the most comments in their issues: SELECT repo.name, COUNT(*) c FROM [githubarchive:month.201606] WHERE type IN ( 'IssueCommentEvent') GROUP BY
All the open source code in GitHub now shared within BigQuery: Analyze all the code!
All the open source code in GitHub is now available in BigQuery. Go ahead, analyze it all. In this post you’ll find the related resources I know of so far: Update: I know I said all — but it’s not all. I’m updating the answers to these and other questions at github.com/fhoffa/analyzing_github. The pipeline mirrors code from: Projects that have a clear open source license.Forks and/or un-notable pr
Showing off the new (free) Google Data Studio, with reddit April’s gilded comments for…
The Google Analytics team just announced Data Studio: their free, new, Data Visualization Product. Read their post for more details, but since I just got a new load of reddit comments from /u/Stuck_in_the_Matrix loaded in BigQuery, I’m eager to show you how to connect both. The first surprise with Data Studio: It’s really easy to connect it to BigQuery: Add a data source, choose BigQuery.To work w
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
