Commit Graph

38 Commits

Author SHA1 Message Date
kai
0336832e55 RefreshConnections will create a new connection if it is not in the search path. Closes #4353
Add logging to RefreshConnections
2024-08-19 15:56:50 +01:00
kaidaguerre
e6e9714e4c Update all ErrorAndWarnings function returns to pass by value, removing possibility of nil ErrorAndWarnings. Closes #3974 (#4212) 2024-03-21 11:46:10 +00:00
Binaek Sarkar
0387595c36 Update calls to go-kit.ListFiles with the new go-kit.ListFilesWithContext. Closes #3884 2024-01-08 11:45:29 +00:00
kaidaguerre
017d99683d Sset connection state to error if plugin load fails. Closes #4043 2023-12-22 15:40:25 +00:00
kaidaguerre
46ef6ec90a Add steampipe_plugin_column introspection table to internal schema. Closes #4003
(cherry picked from commit 12079986d5)
2023-11-29 12:55:21 +00:00
kaidaguerre
79b66fb9fa Move hcl_helpers and type_conversion package to go-kit. Closes #3962
(cherry picked from commit 737efa381b)
2023-11-29 12:55:13 +00:00
kaidaguerre
61718dfa76 Remove unnecessary transactions from ConnectionStateUpdater. Closes #3929 2023-09-28 18:03:19 +01:00
kaidaguerre
817cfbfca1 Deprecate steampipe connection state and replace with steampipe connection - update both tables in parallel. Closes #3908 2023-09-26 17:53:33 +01:00
kaidaguerre
235cbc2037 Connection watching fixes.
Fix ConnectionConfigMap.Diff  inconsistent usage of Plugin and PluginInstance. Closes #3895
Fix GetConnectionStateErrorSql returning invalid query with additional parameter. Closes #3896
Update FDW to v1.8.0-rc.11 - fix failure to load connection config when importing schema
2023-09-25 12:35:00 +01:00
kaidaguerre
6f051ea463 Do not add connections in error to plugin manager connection map. Closes #3893 2023-09-22 18:12:29 +01:00
kaidaguerre
79606c5bcd Rename internal introspection tables. Fix warning notifications from RefreshConnections. Improve error handlingh for config inconsistencies in conneciton and plugin config. Closes #3886 2023-09-22 16:02:41 +01:00
kaidaguerre
f232b14f06 Add support for multiple instances of the same plugin version to execute. Closes #3863 2023-09-18 15:39:17 +01:00
Binaek Sarkar
d32276a849 Removing comments referring to unplanned and completed issues. Closes #1301 2023-09-15 12:21:58 +01:00
kaidaguerre
7feb305fde Provide mechanism for plugin manager to send warnings back to CLI. Closes #3603 (#3835) 2023-09-13 15:34:15 +01:00
kaidaguerre
95fed2ed2a Key the rate limiter and plugin config maps by plugin image ref, not short name. Closes #3820 2023-09-11 15:56:35 +01:00
Binaek Sarkar
862fcf1b71 Fix stall in plugin manager shutdown. Closes #3817 2023-09-08 17:48:20 +01:00
kaidaguerre
f041597497 Add support for plugin connection config and options blocks. Add options and env var configuration of max memory. Closes #3807 2023-09-06 15:59:13 +01:00
kaidaguerre
2a86d08445 Add support to retrieve plugin rate limiter definitions and use to populate steampipe_rate_limiter table. Closes #3805 (#3803) 2023-09-06 13:28:22 +01:00
Binaek Sarkar
08b447a261 Differentiate between user and system queries using application name. Closes #3600 2023-08-25 16:50:27 +01:00
Puskar Basu
6aaf9bc5be Update 'sperr' import references. Closes #3748 2023-08-17 13:52:04 +05:30
kai
e5ac3eff06 Merge remote-tracking branch 'origin/main' 2023-08-11 15:30:15 +01:00
kaidaguerre
202cb68692 Add HCL support for defining rate limiters, with filewatching as per connection config. Closes #3746 2023-08-11 14:24:44 +01:00
kai
02654f8d4d Merge branch 'v0.20.x'
# Conflicts:
#	pkg/pluginmanager_service/plugin_manager.go
#	tests/acceptance/test_files/dynamic_schema.bats
2023-08-11 14:18:53 +01:00
Binaek Sarkar
d622017bba Fixes issue where db connections are not closed after sending postgres notification. Closes #3744 2023-08-11 15:53:54 +05:30
kaidaguerre
b06348757a Fix linting warnings
---------

Co-authored-by: Binaek Sarkar <binaek@turbot.com>
Co-authored-by: Puskar Basu <puskar@turbot.com>
2023-07-06 16:08:23 +01:00
kaidaguerre
43dd6c7a61 Refactor Plugin manager:remove support for plugins which do not support multiple connections, simplify startup.
If plugin process crashes, benchmark or dashboard runs can leave running plugin processes after shutdown. Fixes #3598
2023-06-21 16:18:49 +01:00
kaidaguerre
217b708e4d Delete dynamic schemas before updating to avoid a timing issue showing incorrect schema. Closes #3510 2023-06-01 17:07:32 +01:00
kaidaguerre
1816d8d381 Delete dynamic schemas before updating to avoid a timing issue showing incorrect schema. Closes #3510 2023-06-01 16:57:20 +01:00
kaidaguerre
136ab15b80 Ensure 'Ready' connections are set to 'Pending' state on startup. Fixes #3483 2023-05-31 14:10:25 +01:00
kaidaguerre
692f3e7c30 Ensure 'Ready' connections are set to 'Pending' state on startup. Fixes #3483 2023-05-31 14:09:20 +01:00
kaidaguerre
3823caf7c0 Update refresh connections to execute updates serially by default. Closes #3498 2023-05-30 16:14:42 +01:00
kaidaguerre
15cff6e3df Update refresh connections to execute updates serially by default. Closes #3498 2023-05-30 15:43:09 +01:00
kai
48a08fed43 Cleanup temp plugin file for plugin manager. Closes #3292 2023-05-19 16:06:48 +01:00
kaidaguerre
dd1c36b514 Re-add support for legacy command schema. Closes #3457 2023-05-19 15:45:38 +01:00
kaidaguerre
7703975883 Refactor/fix connection and plugin validation during refreshConnections - ensure failed connections are set to 'error' in connection state. Closes #3432 2023-05-17 14:43:27 +01:00
kaidaguerre
dcd0ced93a Update refresh connections to write comments for exemplar schemas first, followed by remaining schemas. Closes #3413 2023-05-16 14:13:02 +01:00
kaidaguerre
b0b2c62338 Add support for 'import_schema' property in connection config, controlling whether to create a postgres schema for a steampipe connection. Closes #3407
Rename 'connection_state' table to 'steampipe_connection_state'. #3403
Rename 'internal' table to 'steampipe_internal
Remove 'Connection' property from ConnectionState
2023-05-15 13:07:36 +01:00
kaidaguerre
40804a3201 Execute RefreshConnections asyncronously and optimise for high connection count. Add connection_state table.
- Execute RefreshConnections asyncronously
- Add connection_state table to indicate the loading state of connections
- Optimise RefreshConnections by cloning connection schemas
- Add locking to ensure only a single instance of RefreshConnections runs
- Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
- Optimise autocomplete for high connection count
- Autocomplete and inspect data available before all conections are refreshed
- Update file watcher to respond to CHMOD, so thaat it pickes up deletion of file contents

 Closes #3394
 Closes #3267
2023-05-10 09:05:08 +01:00