Q
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Superset | 55,369 |  | 21 | a day ago | 6 | April 18, 2023 | 1,652 | apache-2.0 | TypeScript | |
| Apache Superset is a Data Visualization and Data Exploration Platform | ||||||||||
| Tidb | 35,254 | 68 | 148 | a day ago | 1,289 | April 07, 2022 | 4,453 | apache-2.0 | Go | |
| TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://tidbcloud.com/free-trial | ||||||||||
| Dbeaver | 35,090 | a day ago | 1,854 | apache-2.0 | Java | |||||
| Free universal database tool and SQL client | ||||||||||
| Metabase | 34,985 | a day ago | 1 | June 08, 2022 | 3,428 | other | Clojure | |||
| The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum: | ||||||||||
| Sqlmap | 28,925 | 6 days ago | 1 | February 27, 2018 | 58 | other | Python | |||
| Automatic SQL injection and database takeover tool | ||||||||||
| Cockroach | 28,161 | 50 | 26 | a day ago | 249 | August 06, 2021 | 5,586 | other | Go | |
| CockroachDB - the open source, cloud-native distributed SQL database. | ||||||||||
| Directus | 23,844 |  | 228 | a day ago | 95 | November 16, 2023 | 359 | other | TypeScript | |
| The Modern Data Stack 🐰 — Directus is an instant REST+GraphQL API and intuitive no-code data collaboration app for any SQL database. | ||||||||||
| Surrealdb | 23,489 |  | 22 | a day ago | 14 | September 13, 2023 | 423 | other | Rust | |
| A scalable, distributed, collaborative, document-graph database, for the realtime web | ||||||||||
| Tdengine | 22,272 |  | 2 | a day ago | 12 | April 14, 2022 | 1,236 | agpl-3.0 | C | |
| TDengine is an open source, high-performance, cloud native time-series database optimized for Internet of Things (IoT), Connected Cars, Industrial IoT and DevOps. | ||||||||||
| Postgrest | 21,371 | 4 | a day ago | 37 | July 12, 2022 | 209 | mit | Haskell | ||
| REST API for any Postgres database | ||||||||||
q - Text as Data
q's purpose is to bring SQL expressive power to the Linux command line and to provide easy access to text as actual data.
q allows the following:
- Performing SQL-like statements directly on tabular text data, auto-caching the data in order to accelerate additional querying on the same file.
- Performing SQL statements directly on multi-file sqlite3 databases, without having to merge them or load them into memory
The following table shows the impact of using caching:
| Rows | Columns | File Size | Query time without caching | Query time with caching | Speed Improvement |
|---|---|---|---|---|---|
| 5,000,000 | 100 | 4.8GB | 4 minutes, 47 seconds | 1.92 seconds | x149 |
| 1,000,000 | 100 | 983MB | 50.9 seconds | 0.461 seconds | x110 |
| 1,000,000 | 50 | 477MB | 27.1 seconds | 0.272 seconds | x99 |
| 100,000 | 100 | 99MB | 5.2 seconds | 0.141 seconds | x36 |
| 100,000 | 50 | 48MB | 2.7 seconds | 0.105 seconds | x25 |
Notice that for the current version, caching is not enabled by default, since the caches take disk space. Use -C readwrite or -C read to enable it for a query, or add caching_mode to .qrc to set a new default.
q's web site is https://harelba.github.io/q/ or https://q.textasdata.wiki It contains everything you need to download and use q immediately.
Usage Examples
q treats ordinary files as database tables, and supports all SQL constructs, such as WHERE, GROUP BY, JOINs, etc. It supports automatic column name and type detection, and provides full support for multiple character encodings.
Here are some example commands to get the idea:
$ q "SELECT COUNT(*) FROM ./clicks_file.csv WHERE c3 > 32.3"
$ ps -ef | q -H "SELECT UID, COUNT(*) cnt FROM - GROUP BY UID ORDER BY cnt DESC LIMIT 3"
$ q "select count(*) from some_db.sqlite3:::albums a left join another_db.sqlite3:::tracks t on (a.album_id = t.album_id)"
Detailed examples are in here
Installation.
New Major Version 3.1.6 is out with a lot of significant additions.
Instructions for all OSs are here.
The previous version 2.0.19 Can still be downloaded from here
Contact
Any feedback/suggestions/complaints regarding this tool would be much appreciated. Contributions are most welcome as well, of course.
Linkedin: Harel Ben Attia
Twitter @harelba
Email [email protected]
q on twitter: #qtextasdata
Patreon: harelba - All the money received is donated to the Center for the Prevention and Treatment of Domestic Violence in my hometown - Ramla, Israel.