Commit Graph

52 Commits

Author SHA1 Message Date
kaidaguerre
95fed2ed2a Key the rate limiter and plugin config maps by plugin image ref, not short name. Closes #3820 2023-09-11 15:56:35 +01:00
Puskar Basu
fa5240064f Fix issue where ensureDefaultConfigFile was always overwriting default.spc. Closes #3814 2023-09-11 14:36:39 +01:00
kaidaguerre
f041597497 Add support for plugin connection config and options blocks. Add options and env var configuration of max memory. Closes #3807 2023-09-06 15:59:13 +01:00
Binaek Sarkar
08b447a261 Differentiate between user and system queries using application name. Closes #3600 2023-08-25 16:50:27 +01:00
Binaek Sarkar
3b2cdd1e68 Upgrades go version to 1.21. Closes #3763 2023-08-25 13:54:28 +01:00
kaidaguerre
202cb68692 Add HCL support for defining rate limiters, with filewatching as per connection config. Closes #3746 2023-08-11 14:24:44 +01:00
Binaek Sarkar
a1caf53eeb Adds 'steampipe_server_settings' table populated with server settings data during service startup. Closes #3462 2023-06-21 13:23:14 +01:00
Patrick Decat
51f43f108b Allow selection of hosts for steampipe service. Closes #3505 2023-06-01 17:14:56 +01:00
kaidaguerre
dd1c36b514 Re-add support for legacy command schema. Closes #3457 2023-05-19 15:45:38 +01:00
kai
25429fcb77 v0.20.1. Update FDW version to v1.7.1 to work around bad Linux Arm build of FDW v1.70. Closes #3455 2023-05-19 12:18:58 +01:00
Puskar Basu
60c9cfb7cc v0.20.1-alpha.0 2023-05-19 14:41:54 +05:30
kai
e117adfc0e update FDW to v1.7.0 2023-05-18 15:40:35 +01:00
Binaek Sarkar
0fa28fcaf3 Introduces SQL functions to easily manipulate caching functionality. Closes #3442 2023-05-18 14:59:44 +01:00
kai
3a05c039ba Update FDW to v1.7.0-rc.7 2023-05-18 10:36:05 +01:00
kai
3d1423b235 Fix typo in constants.ForeighTableSettings. Update updateScanMetadataMaxId to use new table name. #3416 2023-05-18 08:57:31 +01:00
kaidaguerre
7703975883 Refactor/fix connection and plugin validation during refreshConnections - ensure failed connections are set to 'error' in connection state. Closes #3432 2023-05-17 14:43:27 +01:00
Binaek Sarkar
9653db55da Drops legacy 'internal' and 'steampipe_command' schema. Closes #3403 2023-05-17 13:31:37 +01:00
kaidaguerre
f4b5d64d71 Fix interactive timing output not including scan metadata (hydrate calls/ rows). Closes #3420 2023-05-17 11:29:04 +01:00
kaidaguerre
4635640f4e Remove 'steampipe_command' schema and move settings and scan_metadata foreign tables to 'steampipe_internal' schema. Closes #3416 2023-05-16 17:12:44 +01:00
kaidaguerre
b0b2c62338 Add support for 'import_schema' property in connection config, controlling whether to create a postgres schema for a steampipe connection. Closes #3407
Rename 'connection_state' table to 'steampipe_connection_state'. #3403
Rename 'internal' table to 'steampipe_internal
Remove 'Connection' property from ConnectionState
2023-05-15 13:07:36 +01:00
kaidaguerre
40804a3201 Execute RefreshConnections asyncronously and optimise for high connection count. Add connection_state table.
- Execute RefreshConnections asyncronously
- Add connection_state table to indicate the loading state of connections
- Optimise RefreshConnections by cloning connection schemas
- Add locking to ensure only a single instance of RefreshConnections runs
- Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
- Optimise autocomplete for high connection count
- Autocomplete and inspect data available before all conections are refreshed
- Update file watcher to respond to CHMOD, so thaat it pickes up deletion of file contents

 Closes #3394
 Closes #3267
2023-05-10 09:05:08 +01:00
kai
176c58676c Merge branch 'v0.19.x'
# Conflicts:
#	pkg/constants/db.go
2023-04-27 15:30:06 +01:00
kai
d095e2479c Update FDW to v1.6.3: Fix array bounds error when querying with an aggregator with no children. Show useful error instead. 2023-04-27 15:26:17 +01:00
Binaek Sarkar
299697ae2f Updates in cache configuration to allow disabling of all caching on server. Closes #3258
STEAMPIPE_CACHE environment variable resolves to service cache enabled as well as client cache enabled

service cache enabled is used by the plugin manager to enable/disable caching on the plugins during startup (runtime toggle is not allowed) - with a max_ttl

client cache enabled is used to enable/disable the cache on the database connection (fdw)
A TTL can also be set on the client side capped to max_ttl on the server
2023-03-31 15:12:25 +01:00
kai
e065a916d5 Update FDW to 1.6.2: Fix nil reference panic when a scan fails to start - do not add an iterator to Hub.runningIterators until scan is started successfully. 2023-03-08 12:29:32 +00:00
Puskar Basu
b0a0c8b0fc Update FDW to v1.6.1 2023-03-02 16:59:21 +05:30
kai
3c11018ad9 Update FDW to v1.6.0: Limit should not be pushed down if there are unconverted restrictions. 2023-03-01 14:58:58 +00:00
kai
95b6c34372 Update FDW to 1.6.0-rc.6 2023-02-28 15:22:31 +00:00
kai
cf1d64c285 Update FDW to 1.6.0-rc.5 2023-02-08 10:59:59 +00:00
Puskar Basu
a02531af07 v0.19.0-alpha.1 2023-01-30 20:21:42 +05:30
kaidaguerre
34bea3d1ef Add support for aggregator connections with dynamic tables. Closes #2886 2023-01-27 19:47:43 +00:00
kai
dcc2691d15 Update FDW to v1.5.0 - update to work with sdk version 5 and dynamic updating of dynamic schemas. 2022-11-30 17:51:08 +00:00
Binaek Sarkar
62878d336b Adds a '--max-parallel' flag to 'steampipe dashboard' and set default to 10. Closes #2754 2022-11-25 09:58:28 +00:00
kai
4a00af32cf Update FDW to 1.4.4 - Update GetPathKeys to treat key columns with AnyOf require property with the same precedence as Required. 2022-10-31 15:13:07 +00:00
kai
8bfe543745 Update FDW to 1.4.4-rc.1 - support parsing workspace profiles from config dir 2022-10-26 17:06:49 +01:00
kaidaguerre
42c2323eb2 Add query_timeout to workspace profile. Closes #2593
Improve timeout error message.
Remove refreshDbClient call after timeout.
Set default check query timeout to 240sec and query to 0 (no timeout)
2022-10-26 14:53:50 +01:00
François de Metz
b3838186e1 Add a configurable query timeout. Closes #666 2022-10-26 10:09:17 +01:00
kai
1161f858cd Update FDW to 1.4.2 - Fix Plugin.GetSchema failed - no connection name passed and multiple connections loaded error. Closes #2464 2022-09-26 14:08:00 +01:00
kai
82a98ae92c Update FDW to v1.4.1 - Fix double qual values failing to convert. 2022-09-17 11:53:09 +08:00
kai
762c7a9ca4 v0.17.0-alpha.14. Update fdw to 1.4.0-rc.2. 2022-09-05 11:36:37 +01:00
kai
b2bb8cc748 Update FDW version to 1.4.0-rc.1 - do not start scan until the first time IterateForeignScan is called. 2022-09-01 11:24:58 +01:00
kai
991530e6ae Update FDW to v1.3.2 2022-08-23 15:56:47 +01:00
Mike Burgess
48e5192fe5 Add initial directed graph implementation #2249 (#2358) 2022-08-23 15:01:59 +01:00
kai
fad780a081 Update version to v0.16.0-rc.10. Revert FDW version to 1.3.1 (revert EndExecute changes). 2022-08-10 11:06:21 +01:00
kai
09db996683 v0.16.0-rc.9 2022-08-09 20:28:27 +01:00
kai
5139576772 v0.16.0-rc.8 2022-08-09 12:23:11 +01:00
kai
6188f9858b Update version to v0.16.0-rc.7. Update FDW version to 1.3.0 2022-08-05 10:47:02 +01:00
kai
ebbb96b077 Update version to 1.3.0-rc.3 2022-07-27 19:39:38 +01:00
kaidaguerre
305fb9107b Add support for plugins to handle multiple connections. Closes #2262 2022-07-22 14:53:54 +01:00
kai
f5f1c222d3 Update CHANGELOG.md for v0.15.4. Update FDQ version to 1.2.2 - fix FDW build issue which causes load failure on Arm Docker images. 2022-07-21 14:49:46 +01:00