30 Commits

Author SHA1 Message Date
Puskar Basu
e19d35c457 chore: update module to v2 and bump Go version to 1.24 (#4597) 2025-07-07 16:03:56 +05:30
Puskar Basu
da2f3ecc03 Upgrade to pipe-fittings v2, go-kit v1 (#4485) 2025-03-06 16:34:18 +05:30
kai
dde7c23ed5 rename Connection to SteampipeConnection
remove unneeded code
use CloudMetadata from pipe-fittings
2024-09-27 18:14:28 +05:30
kai
5fd5ae0740 timing broken 2024-09-27 18:14:28 +05:30
kai
e5b1927a63 tidy imports 2024-09-27 18:14:28 +05:30
kai
cb681c67cc compiles but needs testing 2024-09-27 18:14:28 +05:30
kai
ef21f1452e steampipe compiles 2024-09-27 18:14:28 +05:30
kai
cd07bf20f1 working on it 2024-09-27 18:13:12 +05:30
Patrick Decat
7cb8edd1b2 fix: do not abort when unrelated connections are not yet loaded (#4233)
* fix: do not abort when unrelated connections are not yet loaded

* fix: convert config read error to warning
2024-06-06 13:22:18 +01:00
kaidaguerre
017d99683d Sset connection state to error if plugin load fails. Closes #4043 2023-12-22 15:40:25 +00:00
kaidaguerre
2306767fd2 Improve the warning output when plugins with incompatible SDK versions fail to load. Closes #3911 2023-09-27 17:59:32 +01:00
kaidaguerre
79606c5bcd Rename internal introspection tables. Fix warning notifications from RefreshConnections. Improve error handlingh for config inconsistencies in conneciton and plugin config. Closes #3886 2023-09-22 16:02:41 +01:00
kaidaguerre
f232b14f06 Add support for multiple instances of the same plugin version to execute. Closes #3863 2023-09-18 15:39:17 +01:00
kaidaguerre
7feb305fde Provide mechanism for plugin manager to send warnings back to CLI. Closes #3603 (#3835) 2023-09-13 15:34:15 +01:00
kaidaguerre
95fed2ed2a Key the rate limiter and plugin config maps by plugin image ref, not short name. Closes #3820 2023-09-11 15:56:35 +01:00
Binaek Sarkar
862fcf1b71 Fix stall in plugin manager shutdown. Closes #3817 2023-09-08 17:48:20 +01:00
kaidaguerre
01f2f1e525 Update PluginManager plugins property after a ConnectionConfigChanged event. Fixes failure to start plugin after connection config added while service is running. Closes #3812 (#3813) 2023-09-07 18:48:07 +01:00
kaidaguerre
f041597497 Add support for plugin connection config and options blocks. Add options and env var configuration of max memory. Closes #3807 2023-09-06 15:59:13 +01:00
kaidaguerre
2a86d08445 Add support to retrieve plugin rate limiter definitions and use to populate steampipe_rate_limiter table. Closes #3805 (#3803) 2023-09-06 13:28:22 +01:00
kaidaguerre
fb815e8062 Fix aggregator connections being dropped intermittently when refreshing connections. Closes #3664 2023-07-11 15:21:25 +01:00
kaidaguerre
b0b2c62338 Add support for 'import_schema' property in connection config, controlling whether to create a postgres schema for a steampipe connection. Closes #3407
Rename 'connection_state' table to 'steampipe_connection_state'. #3403
Rename 'internal' table to 'steampipe_internal
Remove 'Connection' property from ConnectionState
2023-05-15 13:07:36 +01:00
kaidaguerre
40804a3201 Execute RefreshConnections asyncronously and optimise for high connection count. Add connection_state table.
- Execute RefreshConnections asyncronously
- Add connection_state table to indicate the loading state of connections
- Optimise RefreshConnections by cloning connection schemas
- Add locking to ensure only a single instance of RefreshConnections runs
- Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
- Optimise autocomplete for high connection count
- Autocomplete and inspect data available before all conections are refreshed
- Update file watcher to respond to CHMOD, so thaat it pickes up deletion of file contents

 Closes #3394
 Closes #3267
2023-05-10 09:05:08 +01:00
kaidaguerre
4e13e4e6d1 When a plugin fails to load, remove connections for that plugin from the connection state file. Closes #3124 2023-02-17 18:01:49 +00:00
kaidaguerre
fba7162cdd Fix aggregator specs not being respected for static schema connections. Closes #3093
Add type to ConnectionPluginData 
Always fetch schema for aggregator connections
Update ConnectionData.Equals
Update Connection.Equals
Add TableAggregationSpecs.Equals
2023-02-07 16:30:30 +00:00
kaidaguerre
34bea3d1ef Add support for aggregator connections with dynamic tables. Closes #2886 2023-01-27 19:47:43 +00:00
kaidaguerre
dbd1d10fcc Add support for plugin sdk v5, with plugin message stream - support update of dynamic plugin schema based on file events. Closes #2767 2022-11-30 10:50:46 +00:00
kaidaguerre
404dd35e21 Update database code to use pgx interface so we can leverage the connection pool hook functions to pre-warm connections. Closes #2422 (#2438)
* Provide feedback for failed prepared statements
* Move error functions to error_helpers
* Make maintenance client retriable
2022-10-05 12:38:57 +01:00
kaidaguerre
76025788e3 Connection config watching failing to add connection schema when connections are added. Closes #2295 2022-08-04 20:39:18 +01:00
kaidaguerre
305fb9107b Add support for plugins to handle multiple connections. Closes #2262 2022-07-22 14:53:54 +01:00
kaidaguerre
5193c70395 Restructure steampipe repo to use pkg folder. Closes #2204 2022-06-27 11:36:03 +01:00