XARs: An efficient system for self-contained executables – Facebook Code
Distributing large pieces of software to thousands of machines with a wide variety of configurations can pose a significant operational challenge, requiring a process to identify and copy precisely the right combination of dependent libraries and data files for each device. To make this faster, more robust, and more efficient, we have developed and deployed XARs, or eXecutable ARchives, a system f
AWS Data Wranglerを使って、簡単にETL処理を実現する | Amazon Web Services
Amazon Web Services ブログ AWS Data Wranglerを使って、簡単にETL処理を実現する 2019年9月、Github上にAWS Data Wrangler(以下、Data Wrangler)が公開されました。Data Wranglerは、各種AWSサービスからデータを取得して、コーディングをサポートしてくれるPythonのモジュールです。 現在、Pythonを用いて、Amazon Athena(以下、Athena)やAmazon Redshift(以下、Redshift)からデータを取得して、ETL処理を行う際、PyAthenaやboto3、Pandasなどを利用して行うことが多いかと思います。その際、本来実施したいETLのコーディングまでに、接続設定を書いたり、各種コーディングが必要でした。Data Wraglerを利用することで、AthenaやAmazo
A Feature Selection Tool for Machine Learning in Python
Feature selection, the process of finding and selecting the most useful features in a dataset, is a crucial step of the machine learning pipeline. Unnecessary features decrease training speed, decrease model interpretability, and, most importantly, decrease generalization performance on the test set. Frustrated by the ad-hoc feature selection methods I found myself applying over and over again for
PlanOut | A framework for online field experiments
Focus on parameters PlanOut provides randomized parameter values to Internet services. Instead of using constants for user interface elements or switches controlling the rollout of a new feature or ranking model, just use PlanOut to determine the value of these parameters. Now you have an experiment. Simple or complex It is easy to implement simple A/B tests in PlanOut. But it's also not much hard
Graphite
Graphite does three things: Kick ass. Chew bubblegum. Make it easy to store and graph metrics. (And it’s all out of bubblegum.) Learn more about Graphite About the Project Graphite is an enterprise-ready monitoring tool that runs equally well on cheap hardware or Cloud infrastructure. Teams use Graphite to track the performance of their websites, applications, business services, and networked serv
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
KGTK documentation
GitHub - mesmacosta/datacatalog-util: A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help leverage Data Catalog features.
Pythonでの開発を効率的に進めるためのツール設定
[Pycon Kyushu 2019] Pythonでの開発を効率的に進めるためのツール設定![[Pycon Kyushu 2019] Pythonでの開発を効率的に進めるためのツール設定](https://cdn-ak-scissors.b.st-hatena.com/image/square/150dcd9526d363713bb2961f988d5de70515cbc7/height=288;version=1;width=512/https%3A%2F%2Ffiles.speakerdeck.com%2Fpresentations%2F781a2cfacc7e4cdf8da4ec7cb8452e43%2Fslide_0.jpg%3F12600091)
GitHub - python-versioneer/python-versioneer: version-string management for VCS-controlled trees
Create a unified tech stack for jedi, rope, RedBaron, yapf, pylint, pep8, and similar tools and libraries · Issue #630 · davidhalter/jedi
GitHub - garnaat/kappa: What precedes Lambda
GitHub - peritus/bumpversion: Version-bump your software with a single command
Pythex: a Python regular expression editor