spotify/luigi · GitHub -- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

The purpose of Luigi is to address all the plumbing typically associated with long-running batch processes. You want to chain many tasks, automate them, and failures will happen. These tasks can be anything, but are typically long running things like Hadoop jobs, dumping data to/from databases, running machine learning algorithms, or anything else. There are other software packages that focus on l

[misshiki]

“Luigi は、バッチ ジョブの複雑なパイプラインの構築に役立つ Python (3.6、...3.12 でテスト済み) パッケージです。依存関係の解決、ワークフロー管理、視覚化、障害の処理、コマンド ラインの統合などを処理します。”

[totttte]

spotifyが開発したPythonフレームワーク

[elu_18]

@sotetsuk @shima__shima @ballforest そんなときにルイージ https://t.co/qMel15N9Es

[suzukiMY]

データフロー制御フレームワーク

[soh3914]

Luigi

[rikima3132]

spotify/luigi · GitHub -- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

[moccos_info]

“Luigi is a Python module that helps you build complex pipelines of batch jobs. ”

[mumumu-tan]

Luigi is a Python package that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.

[rokujyouhitoma]

[Luigi[spotify]

[wyukawa]

Spotifyが開発したpythonのバッチフレームワーク。結構大がかりな感じっぽいな。

[nari_ex]

ワークフローの可視化までやってくれるのか...すげぇ...

[koemu]

バッチ用

[lanius]

"Luigi is a Python module that helps you build complex pipelines of batch jobs".

[taro-maru]

“Luigi is a Python package that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.”

[heavenshell]

"Luigi is a Python package that helps you build complex pipelines of batch jobs. "

[shiumachi]

Spotifyの開発したバッチパイプライン処理を作成するためのPythonモジュール、その名もルイージ。ページ内にロゴがあるがどう見てもアレ。Hadoopにも対応していて、ワークフロー管理や可視化などもできるらしい