67 Commits

Author SHA1 Message Date
Nathan Wallace
7996d3c878 Fix #4712: Make Result.Close() idempotent (#4741) 2025-11-11 18:53:18 +08:00
Puskar Basu
e19d35c457 chore: update module to v2 and bump Go version to 1.24 (#4597) 2025-07-07 16:03:56 +05:30
Puskar Basu
da2f3ecc03 Upgrade to pipe-fittings v2, go-kit v1 (#4485) 2025-03-06 16:34:18 +05:30
kai
112647bae0 tidy 2024-10-15 11:44:13 +01:00
kai
9c89b4447a timing streaming 2024-09-27 18:14:28 +05:30
kai
1804741bbd tidy 2024-09-27 18:14:28 +05:30
kai
5fd5ae0740 timing broken 2024-09-27 18:14:28 +05:30
kai
e5b1927a63 tidy imports 2024-09-27 18:14:28 +05:30
kai
cb681c67cc compiles but needs testing 2024-09-27 18:14:28 +05:30
kai
cd07bf20f1 working on it 2024-09-27 18:13:12 +05:30
kai
faead86d26 move stuff to pipe-fittings 2024-09-27 18:13:12 +05:30
kaidaguerre
07782a2b13 Adds support for verbose timing information. Closes #4237. Closes #4244
- JSON output format has changed to move the rows to under a `rows` property, with timing information under the `metadata` property
- Update timing display to show rows returned and rows fetched, as well as adding verbose mode which lists all scans
- Use enums for output mode and timing mode - timing is now either `on`, `off` or `verbose`
- Bugfix: ensure error is returned from ExecuteSystemClientCall. Closes #4246
2024-04-17 10:12:17 +01:00
kaidaguerre
e6e9714e4c Update all ErrorAndWarnings function returns to pass by value, removing possibility of nil ErrorAndWarnings. Closes #3974 (#4212) 2024-03-21 11:46:10 +00:00
kaidaguerre
737efa381b Move hcl_helpers and type_conversion package to go-kit. Closes #3962 2023-10-16 06:01:45 +01:00
kaidaguerre
4fa11a424e Add function to clear connection cache. Closes #3937
* Add function to clear connection cache. 
* Update FDW to v1.9.0 - Add ability to clear connection cache by inserting into settings table.
* Update plugin sdk to v5.6.1
* fix listen unit tests
2023-09-29 19:48:17 +01:00
Puskar Basu
2438a122a6 Fixes issue where initialising rate limiter definitions was taking too long due to force recreation of tables. Closes #3902 2023-09-26 14:48:59 +01:00
kaidaguerre
79606c5bcd Rename internal introspection tables. Fix warning notifications from RefreshConnections. Improve error handlingh for config inconsistencies in conneciton and plugin config. Closes #3886 2023-09-22 16:02:41 +01:00
kaidaguerre
7feb305fde Provide mechanism for plugin manager to send warnings back to CLI. Closes #3603 (#3835) 2023-09-13 15:34:15 +01:00
Binaek Sarkar
a3a714d6cd Fixes issue where temporary tables are dropped in interactive prompt when pool connections are recycled. Closes #3359. Closes #3781 2023-09-06 16:46:40 +01:00
Binaek Sarkar
2f889e462e Merge branch 'v0.20.x' 2023-09-01 23:05:16 +05:30
Binaek Sarkar
b0fa6b6cbf Rotate SSL certificates before server starts, if necessary. Closes #3599 2023-09-01 22:57:58 +05:30
Binaek Sarkar
edfe58f815 Revert "Fixes issue where temporary tables are lost in the middle of a long running interactive session. Closes #3543" (#3789)
This reverts commit 047d8b5556.
2023-09-01 14:33:05 +01:00
Binaek Sarkar
047d8b5556 Fixes issue where temporary tables are lost in the middle of a long running interactive session. Closes #3543 2023-08-29 12:18:20 +01:00
Binaek Sarkar
08b447a261 Differentiate between user and system queries using application name. Closes #3600 2023-08-25 16:50:27 +01:00
Puskar Basu
84ffb71412 Steampipe commands should bypass plugin requirement check if installed plugin is local. Closes #3643 2023-07-27 12:58:52 +01:00
Binaek Sarkar
854819f8f1 Validates workspace profile cache settings. Closes #3646 2023-07-14 13:22:08 +01:00
Binaek Sarkar
37e4b94148 Move ErrorAndWarnings to error_helpers. Closes #3653 2023-07-12 13:58:57 +01:00
kai
1d9f22df7e Merge branch 'v0.20.x' 2023-07-03 15:31:22 +01:00
kaidaguerre
80466b0f51 fix meta_cache function to use correct setting key: cache_ttl (#3640) 2023-07-03 13:42:55 +01:00
Binaek Sarkar
a1caf53eeb Adds 'steampipe_server_settings' table populated with server settings data during service startup. Closes #3462 2023-06-21 13:23:14 +01:00
kaidaguerre
dd1c36b514 Re-add support for legacy command schema. Closes #3457 2023-05-19 15:45:38 +01:00
Binaek Sarkar
0fa28fcaf3 Introduces SQL functions to easily manipulate caching functionality. Closes #3442 2023-05-18 14:59:44 +01:00
kai
3d1423b235 Fix typo in constants.ForeighTableSettings. Update updateScanMetadataMaxId to use new table name. #3416 2023-05-18 08:57:31 +01:00
Binaek Sarkar
6d73804f3a Fixes issue where 'internal' would be added twice in the search_path if one is mentioned in the non default search path. Closes #3397 2023-05-17 15:19:45 +01:00
Binaek Sarkar
9653db55da Drops legacy 'internal' and 'steampipe_command' schema. Closes #3403 2023-05-17 13:31:37 +01:00
kaidaguerre
f4b5d64d71 Fix interactive timing output not including scan metadata (hydrate calls/ rows). Closes #3420 2023-05-17 11:29:04 +01:00
kaidaguerre
4635640f4e Remove 'steampipe_command' schema and move settings and scan_metadata foreign tables to 'steampipe_internal' schema. Closes #3416 2023-05-16 17:12:44 +01:00
kaidaguerre
40804a3201 Execute RefreshConnections asyncronously and optimise for high connection count. Add connection_state table.
- Execute RefreshConnections asyncronously
- Add connection_state table to indicate the loading state of connections
- Optimise RefreshConnections by cloning connection schemas
- Add locking to ensure only a single instance of RefreshConnections runs
- Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
- Optimise autocomplete for high connection count
- Autocomplete and inspect data available before all conections are refreshed
- Update file watcher to respond to CHMOD, so thaat it pickes up deletion of file contents

 Closes #3394
 Closes #3267
2023-05-10 09:05:08 +01:00
Puskar Basu
746fcc80a6 Fixes issue where workspace introspection option was boolean instead of control/info/none. Closes #3389 2023-05-09 13:40:36 +01:00
Binaek Sarkar
299697ae2f Updates in cache configuration to allow disabling of all caching on server. Closes #3258
STEAMPIPE_CACHE environment variable resolves to service cache enabled as well as client cache enabled

service cache enabled is used by the plugin manager to enable/disable caching on the plugins during startup (runtime toggle is not allowed) - with a max_ttl

client cache enabled is used to enable/disable the cache on the database connection (fdw)
A TTL can also be set on the client side capped to max_ttl on the server
2023-03-31 15:12:25 +01:00
kaidaguerre
df9c3a253a Optimize RefreshConnections by cloning schemas where possible. Optimize plugineManager.Get when retrieving multiple connections from same plugin. Closes #3236 2023-03-16 14:43:56 +00:00
kaidaguerre
86246ed927 Only call RefreshConnections on service startup or after a file watching event. Closes #3229 2023-03-15 16:33:23 +00:00
Puskar Basu
8cb5935a36 Add query column in introspection tables to populate FullName if a QueryProvider references a named query. Closes #3161 2023-03-13 15:32:51 +00:00
kaidaguerre
92396d77c0 Remove connection pool min size. Remove need to create empty mod introspection tables if introspection is not enabled. Remove connection pool min size. Closes #3207
* Remove all references to prepared statements
* remove sessionInitWaitGroup
2023-03-09 16:55:08 +00:00
kaidaguerre
2171ce66ba Fix Postgres error "cached plan must not change result type" when dynamic plugin schema changes. Update interactive .inspect and autocomplete based on changes to connection config or dynamic schema updates. Closes #3184. Closes #3185 2023-03-03 18:45:40 +00:00
kaidaguerre
dd76a500e5 When acquiring a session, if the db schemas have changed, reload SteampipeConfig and re-set required search path. Closes #3137 2023-02-22 14:50:53 +00:00
kaidaguerre
4e13e4e6d1 When a plugin fails to load, remove connections for that plugin from the connection state file. Closes #3124 2023-02-17 18:01:49 +00:00
Binaek Sarkar
d7673ecf08 Adds a mechanism for status updates during initialisation. Closes #3108 2023-02-16 17:09:34 +00:00
Binaek Sarkar
d0ede13d4b Make database start timeout configurable. Closes #3038 2023-02-14 17:33:57 +00:00
Binaek Sarkar
e88d75a692 Fixes issue where '.inspect' was not working for table names with a '.'. Closes #2455 2023-02-13 15:11:37 +00:00