Commit Graph

39 Commits

Author SHA1 Message Date
kaidaguerre
40804a3201 Execute RefreshConnections asyncronously and optimise for high connection count. Add connection_state table.
- Execute RefreshConnections asyncronously
- Add connection_state table to indicate the loading state of connections
- Optimise RefreshConnections by cloning connection schemas
- Add locking to ensure only a single instance of RefreshConnections runs
- Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
- Optimise autocomplete for high connection count
- Autocomplete and inspect data available before all conections are refreshed
- Update file watcher to respond to CHMOD, so thaat it pickes up deletion of file contents

 Closes #3394
 Closes #3267
2023-05-10 09:05:08 +01:00
Puskar Basu
18a2f65b41 Refactor display configuration options code. 2023-04-17 11:06:07 +01:00
Binaek Sarkar
299697ae2f Updates in cache configuration to allow disabling of all caching on server. Closes #3258
STEAMPIPE_CACHE environment variable resolves to service cache enabled as well as client cache enabled

service cache enabled is used by the plugin manager to enable/disable caching on the plugins during startup (runtime toggle is not allowed) - with a max_ttl

client cache enabled is used to enable/disable the cache on the database connection (fdw)
A TTL can also be set on the client side capped to max_ttl on the server
2023-03-31 15:12:25 +01:00
kaidaguerre
df9c3a253a Optimize RefreshConnections by cloning schemas where possible. Optimize plugineManager.Get when retrieving multiple connections from same plugin. Closes #3236 2023-03-16 14:43:56 +00:00
Binaek Sarkar
ee8b6647c4 Rationalising 'status hooks'. Do not show spinner when setting status, instead require an explicit Show. #2432 2023-03-14 11:48:14 +00:00
kaidaguerre
92396d77c0 Remove connection pool min size. Remove need to create empty mod introspection tables if introspection is not enabled. Remove connection pool min size. Closes #3207
* Remove all references to prepared statements
* remove sessionInitWaitGroup
2023-03-09 16:55:08 +00:00
kaidaguerre
075fafec09 Use single Steampipe Postgres notification channel (#3191) 2023-03-07 17:34:41 +00:00
kaidaguerre
2171ce66ba Fix Postgres error "cached plan must not change result type" when dynamic plugin schema changes. Update interactive .inspect and autocomplete based on changes to connection config or dynamic schema updates. Closes #3184. Closes #3185 2023-03-03 18:45:40 +00:00
Binaek Sarkar
c896d88e88 Make workspace loading async. Closes #3123 2023-02-20 17:18:33 +00:00
kaidaguerre
b67d39ecde Fix duplicated text input on interactive prompt during initialisation. Closes #3075 2023-02-16 12:35:43 +00:00
Binaek Sarkar
e88d75a692 Fixes issue where '.inspect' was not working for table names with a '.'. Closes #2455 2023-02-13 15:11:37 +00:00
Mike Burgess
9669829827 Merge branch 'v0.18.x' 2023-02-03 13:04:02 +00:00
Puskar Basu
6ee0183a63 Fix query batch mode returning zero exit code when rows return errors. Closes #3044 2023-02-03 11:36:21 +00:00
kaidaguerre
34bea3d1ef Add support for aggregator connections with dynamic tables. Closes #2886 2023-01-27 19:47:43 +00:00
Puskar Basu
e4c50a9477 Ensure correct exit code is returned when a mod plugin requirements are not met. Closes #2986 2023-01-18 14:43:44 +00:00
kaidaguerre
15984137ae Add deprecation warnings for deprecated hcl properties. Closes #2973 2023-01-11 16:34:58 +00:00
Binaek Sarkar
7a16ec8c57 Updates usages of 'go-kit; for changes in Filewatcher and String/Hash helpers. Closes #2779 2022-11-30 10:12:03 +00:00
Binaek Sarkar
056fa56241 Fixes issue where interactive prompt was not showing timing data for 'json', 'csv' and 'line' outputs. Closes #2699 2022-11-29 10:57:37 +00:00
Binaek Sarkar
18a1c51597 Upgrades 'pgx' to v5. Closes #2776 2022-11-23 17:34:21 +00:00
kaidaguerre
fe6365b1ef Remove usage of prepared statements - instead excute sql directly. Wrap with executions in LeafRuns to support runtime dependency resolution. Closes #2789. #2772 2022-11-23 14:11:56 +00:00
kai
6739674989 Remove ScanType from Snapshot panel data. 2022-11-08 14:24:28 +00:00
kai
cbd6b18ef6 Steampipe query fails with nil pointer exception if query execution fails and result is being exported as snapshot. Closes #2692 2022-11-07 15:25:59 +00:00
Binaek Sarkar
e5a14bce00 Adds 'list' sub command for 'query', 'check' and 'dashboard'. Closes #2653 2022-11-03 15:58:56 +00:00
kaidaguerre
0452bb0b81 Validate checkout output and export formats before execution. Closes #2619. Add support for using sps as snapshot output/export format. Closes #2623 2022-10-28 14:57:44 +01:00
Meet Rajesh Gor
b0dfee67bb Add auto-completion toggle meta command and terminal option. Closes #2560. Closes #1692 2022-10-27 17:48:45 +01:00
kaidaguerre
38b472338e Remove "connecting to service" spinner message during query init. Closes #2599 2022-10-26 18:22:34 +01:00
Binaek Sarkar
a373b9ca91 Fixes issue where prompt fails to show up when service installation runs in interactive mode. Closes #2529 2022-10-21 12:13:52 +01:00
kaidaguerre
397c951fe2 Refactor control export to use ExportManager. Closes #2515 2022-10-12 16:25:31 +01:00
kaidaguerre
1dc28f4681 Add --source-snapshot option to dashboard command. Closes #2503. (#2491) 2022-10-11 23:36:27 +01:00
kaidaguerre
ef845286c1 Add support for sharing snapshots. Add snapshot output and export format for query and check. Add ability to run named dashboards. #2473 2022-10-05 15:30:57 +01:00
kaidaguerre
404dd35e21 Update database code to use pgx interface so we can leverage the connection pool hook functions to pre-warm connections. Closes #2422 (#2438)
* Provide feedback for failed prepared statements
* Move error functions to error_helpers
* Make maintenance client retriable
2022-10-05 12:38:57 +01:00
Puskar Basu
8a5d1a97a4 Show timing info even if query returns an error. Closes #2331 2022-09-05 11:32:56 +01:00
Puskar Basu
ecf5faf3e4 Improve help messages when a plugin is installed but the connection is not configured. Closes #2319 2022-08-22 16:50:58 +01:00
Nathan Wallace
b89685ac2e Only add a blank line between query results, not after the final result closes #2333 2022-08-18 06:54:16 -04:00
kai
e4d1b72754 Fix Steampipe terminating if valid query is entered before initialisation completes. #2300 2022-08-08 15:57:02 +01:00
kaidaguerre
d15ac33b26 Fix pasting a query during cli initialization causing it to be duplicated on the screen. #1980 2022-08-04 22:17:14 +01:00
kaidaguerre
0a9b1a1715 Fix interactive multi-line mode. Ensure initialisation errors are correctly reported. Closes #2260 2022-08-02 17:30:54 +01:00
kaidaguerre
305fb9107b Add support for plugins to handle multiple connections. Closes #2262 2022-07-22 14:53:54 +01:00
kaidaguerre
5193c70395 Restructure steampipe repo to use pkg folder. Closes #2204 2022-06-27 11:36:03 +01:00