GitHub - tobymao/sqlglot: Python SQL Parser and Transpiler
SQLGlot is a no-dependency SQL parser, transpiler, optimizer, and engine. It can be used to format SQL or translate between 21 different dialects like DuckDB, Presto / Trino, Spark / Databricks, Snowflake, and BigQuery. It aims to read a wide variety of SQL inputs and output syntactically and semantically correct SQL in the targeted dialects. It is a very comprehensive generic SQL parser with a ro
LMQL is a programming language for LLM interaction. | LMQL
LMQL is a programming language for LLMs. Robust and modular LLM prompting using types, templates, constraints and an optimizing runtime. @lmql.query def meaning_of_life(): '''lmql # top-level strings are prompts "Q: What is the answer to life, the \ universe and everything?" # generation via (constrained) variables "A: [ANSWER]" where \ len(ANSWER) < 120 and STOPS_AT(ANSWER, ".") # results are dir
Introducing Sqlcommenter: An open source ORM auto-instrumentation library | Google Cloud Blog
Introducing Sqlcommenter: An open source ORM auto-instrumentation library Object-relational mapping (ORM) helps developers to write queries using an object-oriented paradigm, which integrates naturally with application code in their preferred programming language. Many full-stack developers rely on ORM tools to write database code in their applications, but since the SQL statements are generated b
This one weird trick will simplify your ETL workflow | Stitch Fix Technology – Multithreaded
The first and most important step towards developing a powerful machine learning model is acquiring good data. It doesn’t matter if you’re using a simple logistic regression or the fanciest state-of-the-art neural network to make predictions: If you don’t have rich input, your model will be garbage in, garbage out. This exposes an unfortunate truth that every hopeful, young data scientist has to c
BigQuery上の自動テスト開発のススメ
特にBigQueryのようなカラムナ型ストレージを採用するシステムでは、RDBMSに用意されているユニーク制約や外部参照制約といったレコードに制約を課すことができません。このためテーブルの結合というSQLの簡単な操作でも思わぬ形で整合性を崩す恐れがあります。 また大規模データ処理ではRDBMSでは扱わないような大量のイベントデータを時系列で大量に取り扱う必要があります。このようなイベントデータは、発生源であるアプリケーションのデータウェアハウジングの外部のシステムからの影響を受けやすくなります。加えて、プロダクト開発において、アプリケーションが変化しないということは起こりえないため、データの特性自体も中長期で見た場合に不安定です。
PugSQL :: SQL is Extremely Good, Actually
PugSQL is a simple Python interface for using parameterized SQL, in files, with any SQLAlchemy-supported database. import pugsql # Create a module of database functions from a set of sql files on disk. queries = pugsql.module('resources/sql') # Point the module at your database. queries.connect('sqlite:///foo.db') # Invoke parameterized queries, receive dicts! user = queries.find_user(user_id=42)
Ibis: Python Data Analysis Productivity Framework
An open source dataframe library that works with any data system Use the same API for nearly 20 backends Fast local dataframes with embedded DuckDB (default), Polars, or DataFusion Iterate locally and deploy remotely by changing a single line of code Compose SQL and Python dataframe code, bridging the gap between data engineering and data science Ibis: the portable Python dataframe library Ibis of
python-sqlparse — python-sqlparse 0.5.2.dev0 documentation
python-sqlparse¶ sqlparse is a non-validating SQL parser for Python. It provides support for parsing, splitting and formatting SQL statements. The module is compatible with Python 3.8+ and released under the terms of the New BSD license. Visit the project page at https://github.com/andialbrecht/sqlparse for further information about this project. Quick Start¶ >>> import sqlparse >>> # Split a stri
Re:dash - Make Your Company Data Driven
Redash helps you make sense of your dataConnect and query your data sources, build dashboards to visualize data and share them with your company. “Redash is as essential as email to my company. We love data but accessing the data is a pain without Redash. Any company I go to, I get them hooked on Redash. It’s an easy sell :)” by Ben Dehghan, Co-Founder of Data Miner Read what our users say → Write
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
News, Analysis & Comment | Financial Services & Banking Sectors
GitHub - sripathikrishnan/jinjasql: Template Language for SQL with Automatic Bind Parameter Extraction
PyPika - Python Query Builder — PyPika 0.35.16 documentation
python-sqlparse - Google Code