Commit Graph

58 Commits

Author SHA1 Message Date
Puskar Basu
c6b8c835ab Update query JSON output to be consistent across pipelings - also handle duplicate column names. Closes #4317 2024-09-02 12:14:53 +01:00
kaidaguerre
07782a2b13 Adds support for verbose timing information. Closes #4237. Closes #4244
- JSON output format has changed to move the rows to under a `rows` property, with timing information under the `metadata` property
- Update timing display to show rows returned and rows fetched, as well as adding verbose mode which lists all scans
- Use enums for output mode and timing mode - timing is now either `on`, `off` or `verbose`
- Bugfix: ensure error is returned from ExecuteSystemClientCall. Closes #4246
2024-04-17 10:12:17 +01:00
loselarry
dcf3d89b01 chore: fix function names in comment (#4240)
Signed-off-by: loselarry <bikangning@yeah.net>
2024-04-10 10:16:18 +01:00
kai
94a61f1aea Create a plugin instance for implicit plugins even if not installed. #3451 2023-09-26 14:23:23 +01:00
kaidaguerre
79606c5bcd Rename internal introspection tables. Fix warning notifications from RefreshConnections. Improve error handlingh for config inconsistencies in conneciton and plugin config. Closes #3886 2023-09-22 16:02:41 +01:00
kaidaguerre
f232b14f06 Add support for multiple instances of the same plugin version to execute. Closes #3863 2023-09-18 15:39:17 +01:00
kaidaguerre
7feb305fde Provide mechanism for plugin manager to send warnings back to CLI. Closes #3603 (#3835) 2023-09-13 15:34:15 +01:00
Binaek Sarkar
09898c7ca1 Fixes issue where Fetch and Hydrate data are not shown with timing enabled. Closes #3808 (#3815) 2023-09-08 17:37:29 +01:00
kaidaguerre
01f2f1e525 Update PluginManager plugins property after a ConnectionConfigChanged event. Fixes failure to start plugin after connection config added while service is running. Closes #3812 (#3813) 2023-09-07 18:48:07 +01:00
Binaek Sarkar
a3a714d6cd Fixes issue where temporary tables are dropped in interactive prompt when pool connections are recycled. Closes #3359. Closes #3781 2023-09-06 16:46:40 +01:00
Binaek Sarkar
edfe58f815 Revert "Fixes issue where temporary tables are lost in the middle of a long running interactive session. Closes #3543" (#3789)
This reverts commit 047d8b5556.
2023-09-01 14:33:05 +01:00
Binaek Sarkar
047d8b5556 Fixes issue where temporary tables are lost in the middle of a long running interactive session. Closes #3543 2023-08-29 12:18:20 +01:00
Binaek Sarkar
132b3a7c32 Fixes issue where metaquery hangs in interactive prompt. Closes #3775 2023-08-28 17:21:30 +01:00
Binaek Sarkar
08b447a261 Differentiate between user and system queries using application name. Closes #3600 2023-08-25 16:50:27 +01:00
Binaek Sarkar
854819f8f1 Validates workspace profile cache settings. Closes #3646 2023-07-14 13:22:08 +01:00
kaidaguerre
b06348757a Fix linting warnings
---------

Co-authored-by: Binaek Sarkar <binaek@turbot.com>
Co-authored-by: Puskar Basu <puskar@turbot.com>
2023-07-06 16:08:23 +01:00
Binaek Sarkar
9754ed0c1a Creates 'version.json' in each plugin directory. Recompose the global plugin versions.json if it is missing or corrupt. Closes #3492 2023-06-30 08:56:59 +01:00
Binaek Sarkar
a1caf53eeb Adds 'steampipe_server_settings' table populated with server settings data during service startup. Closes #3462 2023-06-21 13:23:14 +01:00
Puskar Basu
aaf0813c17 Fix issue where result counter spinner was not showing up in interactive when timing was enabled. Closes #3481 2023-05-30 15:16:44 +01:00
Binaek Sarkar
e5e8105657 Fixes issue where caching is still enabled for plugins compiled with SDKv4. Closes #3427 2023-05-18 15:02:49 +01:00
kai
3b1e99182a Replace all '...' with ellipsis … in terminal output. Closes #3441 2023-05-18 10:41:27 +01:00
kai
3d1423b235 Fix typo in constants.ForeighTableSettings. Update updateScanMetadataMaxId to use new table name. #3416 2023-05-18 08:57:31 +01:00
Binaek Sarkar
6d73804f3a Fixes issue where 'internal' would be added twice in the search_path if one is mentioned in the non default search path. Closes #3397 2023-05-17 15:19:45 +01:00
Binaek Sarkar
9653db55da Drops legacy 'internal' and 'steampipe_command' schema. Closes #3403 2023-05-17 13:31:37 +01:00
kaidaguerre
f4b5d64d71 Fix interactive timing output not including scan metadata (hydrate calls/ rows). Closes #3420 2023-05-17 11:29:04 +01:00
kaidaguerre
5fdf6920cf Add support for connecting to a steampipe server which does not have connection state table (i.e. it is a pre v0.20.0 version). Closes #3414 2023-05-16 17:15:13 +01:00
kaidaguerre
4635640f4e Remove 'steampipe_command' schema and move settings and scan_metadata foreign tables to 'steampipe_internal' schema. Closes #3416 2023-05-16 17:12:44 +01:00
kaidaguerre
b0b2c62338 Add support for 'import_schema' property in connection config, controlling whether to create a postgres schema for a steampipe connection. Closes #3407
Rename 'connection_state' table to 'steampipe_connection_state'. #3403
Rename 'internal' table to 'steampipe_internal
Remove 'Connection' property from ConnectionState
2023-05-15 13:07:36 +01:00
kaidaguerre
40804a3201 Execute RefreshConnections asyncronously and optimise for high connection count. Add connection_state table.
- Execute RefreshConnections asyncronously
- Add connection_state table to indicate the loading state of connections
- Optimise RefreshConnections by cloning connection schemas
- Add locking to ensure only a single instance of RefreshConnections runs
- Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
- Optimise autocomplete for high connection count
- Autocomplete and inspect data available before all conections are refreshed
- Update file watcher to respond to CHMOD, so thaat it pickes up deletion of file contents

 Closes #3394
 Closes #3267
2023-05-10 09:05:08 +01:00
Binaek Sarkar
299697ae2f Updates in cache configuration to allow disabling of all caching on server. Closes #3258
STEAMPIPE_CACHE environment variable resolves to service cache enabled as well as client cache enabled

service cache enabled is used by the plugin manager to enable/disable caching on the plugins during startup (runtime toggle is not allowed) - with a max_ttl

client cache enabled is used to enable/disable the cache on the database connection (fdw)
A TTL can also be set on the client side capped to max_ttl on the server
2023-03-31 15:12:25 +01:00
Binaek Sarkar
be36276fd8 Add deprecation warnings for connection.options "connection" and global terminal options. CLoses #3246 2023-03-23 14:43:06 +00:00
kaidaguerre
df9c3a253a Optimize RefreshConnections by cloning schemas where possible. Optimize plugineManager.Get when retrieving multiple connections from same plugin. Closes #3236 2023-03-16 14:43:56 +00:00
kaidaguerre
86246ed927 Only call RefreshConnections on service startup or after a file watching event. Closes #3229 2023-03-15 16:33:23 +00:00
Binaek Sarkar
ee8b6647c4 Rationalising 'status hooks'. Do not show spinner when setting status, instead require an explicit Show. #2432 2023-03-14 11:48:14 +00:00
Patrick Decat
fff3689ca8 Set minimum connection to 0, as thousands of connections are created if it is unset 2023-03-13 14:25:39 +00:00
kaidaguerre
92396d77c0 Remove connection pool min size. Remove need to create empty mod introspection tables if introspection is not enabled. Remove connection pool min size. Closes #3207
* Remove all references to prepared statements
* remove sessionInitWaitGroup
2023-03-09 16:55:08 +00:00
kaidaguerre
2171ce66ba Fix Postgres error "cached plan must not change result type" when dynamic plugin schema changes. Update interactive .inspect and autocomplete based on changes to connection config or dynamic schema updates. Closes #3184. Closes #3185 2023-03-03 18:45:40 +00:00
kaidaguerre
dd76a500e5 When acquiring a session, if the db schemas have changed, reload SteampipeConfig and re-set required search path. Closes #3137 2023-02-22 14:50:53 +00:00
kaidaguerre
4e13e4e6d1 When a plugin fails to load, remove connections for that plugin from the connection state file. Closes #3124 2023-02-17 18:01:49 +00:00
Binaek Sarkar
d0ede13d4b Make database start timeout configurable. Closes #3038 2023-02-14 17:33:57 +00:00
kaidaguerre
0a391e9636 Update dashboard states to "initialized", "blocked", "running", "complete", "error", "canceled". Closes #2939 2023-01-04 14:08:56 +00:00
kaidaguerre
dbd1d10fcc Add support for plugin sdk v5, with plugin message stream - support update of dynamic plugin schema based on file events. Closes #2767 2022-11-30 10:50:46 +00:00
Binaek Sarkar
056fa56241 Fixes issue where interactive prompt was not showing timing data for 'json', 'csv' and 'line' outputs. Closes #2699 2022-11-29 10:57:37 +00:00
Binaek Sarkar
18a1c51597 Upgrades 'pgx' to v5. Closes #2776 2022-11-23 17:34:21 +00:00
kaidaguerre
fe6365b1ef Remove usage of prepared statements - instead excute sql directly. Wrap with executions in LeafRuns to support runtime dependency resolution. Closes #2789. #2772 2022-11-23 14:11:56 +00:00
kai
f47d55b2bb Fix steampipe query --timing not outputting timing information if sharing or exporting a snapshot. Closes #2677 2022-11-07 14:05:39 +00:00
kai
7d28c99e27 Fix steampipe dashboard not showing progress when running a single dashboard. Closes #2685 2022-11-07 10:37:34 +00:00
kaidaguerre
42c2323eb2 Add query_timeout to workspace profile. Closes #2593
Improve timeout error message.
Remove refreshDbClient call after timeout.
Set default check query timeout to 240sec and query to 0 (no timeout)
2022-10-26 14:53:50 +01:00
François de Metz
b3838186e1 Add a configurable query timeout. Closes #666 2022-10-26 10:09:17 +01:00
kaidaguerre
0e27f38202 Update workspace profile parsing to load options blocks. Include these options values in viper with correct precedence. Closes #2579 2022-10-24 13:58:50 +01:00