Commit Graph

63 Commits

Author SHA1 Message Date
kaidaguerre
08f49d843f For query command, load mod variables syncronously but the rest of mod async. Closes #4109 2024-02-02 15:03:31 +00:00
kaidaguerre
103d53f8e8 Fix setting dependency vars in var file. Fix UI freeze when prompting for workspace variables. Closes #4105 2024-02-01 13:53:21 +00:00
kaidaguerre
ed76a879da Executing benchmark as dashboard failing with segmentation fault. Closes #3905 2023-09-26 15:51:19 +01:00
Puskar Basu
dc90bc0afe Update BuildFullResourceName to validate for non empty arguments. Closes #3601 2023-08-07 13:39:58 +01:00
kaidaguerre
b06348757a Fix linting warnings
---------

Co-authored-by: Binaek Sarkar <binaek@turbot.com>
Co-authored-by: Puskar Basu <puskar@turbot.com>
2023-07-06 16:08:23 +01:00
kaidaguerre
40804a3201 Execute RefreshConnections asyncronously and optimise for high connection count. Add connection_state table.
- Execute RefreshConnections asyncronously
- Add connection_state table to indicate the loading state of connections
- Optimise RefreshConnections by cloning connection schemas
- Add locking to ensure only a single instance of RefreshConnections runs
- Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
- Optimise autocomplete for high connection count
- Autocomplete and inspect data available before all conections are refreshed
- Update file watcher to respond to CHMOD, so thaat it pickes up deletion of file contents

 Closes #3394
 Closes #3267
2023-05-10 09:05:08 +01:00
kaidaguerre
137e438bdc Resource references in depdency mods must be fully qualified. Locals in dependency mods cannot be referenced. Support transitive dependencies referencing variables from different versions of same mod. Closes #3335. Closes #3336. Closes #3337 2023-04-14 12:37:32 +01:00
Binaek Sarkar
ee8b6647c4 Rationalising 'status hooks'. Do not show spinner when setting status, instead require an explicit Show. #2432 2023-03-14 11:48:14 +00:00
kaidaguerre
92396d77c0 Remove connection pool min size. Remove need to create empty mod introspection tables if introspection is not enabled. Remove connection pool min size. Closes #3207
* Remove all references to prepared statements
* remove sessionInitWaitGroup
2023-03-09 16:55:08 +00:00
kaidaguerre
7c2ae6da93 when executing a query as a dashboard, name the dashboard custom.dashboard.sql_<query_hash>. Closes #3150 2023-02-28 18:19:13 +00:00
Binaek Sarkar
06af870908 Fix running a single dashboard from the command line failing if the dashboard needs inputs and the dashboard name is not fully qualified. Closes #3168. Closes #3154 2023-02-28 15:27:09 +00:00
kaidaguerre
75aab0c2eb When adding vars from dependency mods to a snapshot using spvars name format: <mod-name>.<var-name>. #2730 2023-02-01 13:18:55 +00:00
kaidaguerre
a5703fb377 Fix when running a dashboard from a dependent mod, default var vals not being included in the snapshot. Closes #2730 2023-01-31 17:29:41 +00:00
kaidaguerre
6ee391faba Workspace file watching events sometime cause dashboard to stall and stop responding to events. Cancelling dashboards (e.g. by pressing 'back' on the browser) sometimes leave the server in a state where it will not respond to socket events. #3007.#. #3008 2023-01-17 11:52:53 +00:00
kaidaguerre
0e4f0460ed Revert "Add blocking_children to LeafNodeUpdated event" (#2988)
* Revert "Add `blocking_children` to LeafNodeUpdated event"

This reverts commit 302181dd
2023-01-12 14:42:17 +00:00
Mike Burgess
1ba8c7d7a1 Dashboard panels should not show if dependent inputs are not populated. Closes #2894. (#2982) 2023-01-11 17:54:21 +00:00
kaidaguerre
d254301f9e When editing dashboard files, after adding/fixing errors in the HCL the dashboard server will sometimes stall. Closes #2952
Fixed tactically by increasing the channel buffer size and also adding a timeout/cancellation support to the dashboard event sending code
2023-01-06 17:49:43 +00:00
kaidaguerre
718c4f1944 Update steampipe_reference introspection table to include references from with blocks. Closes #2934
* Move AddReference and GetReferences to ResourceWithMetadataImpl
* Remove resourceMapProvider from setBaseProperties signature
* Remove MergeBaseDependencies
* Remove 'base; property from with
* Only populate refs if introspection is enabled
2023-01-06 17:18:24 +00:00
kaidaguerre
2d2a137705 Split WithProvider from RuntimeDependencyProvider. Only dashboard and NodeEdgeProviders can have with blocks. Closes #2946 2023-01-05 18:02:44 +00:00
kaidaguerre
0a391e9636 Update dashboard states to "initialized", "blocked", "running", "complete", "error", "canceled". Closes #2939 2023-01-04 14:08:56 +00:00
kaidaguerre
689ed6d06b Add support for dependencies between withs. Closes #2914 2022-12-23 13:36:40 +00:00
kai
dbc209147d Fix incorrect initial value of CheckRun RunStatus, which was preventing benchmarks from running as dashboard.
Rationalise MappableResource
2022-12-23 13:36:19 +00:00
kai
cd80fa28e4 Remove redundant code. Add issues to TODOs. 2022-12-23 13:15:46 +00:00
kaidaguerre
dfcff84f2d Add support for param runtime dependencies. Closes #2910 2022-12-22 13:44:40 +00:00
Mike Burgess
f1888f3d69 Show dashboard panel log in panel detail. Closes #2895. (#2902) 2022-12-21 12:46:42 +00:00
kaidaguerre
3bf90acaf6 Add support for independent execution and resolution of base resource runtime dependencies. Closes #2893 2022-12-19 16:55:26 +00:00
Mike Burgess
cf7f5f878b Dashboard panels should support more granular statuses. Closes #2889. (#2891) 2022-12-19 16:35:48 +00:00
kaidaguerre
d915ce69f4 Refactor base resolution to use nested structs. Remove modified gohcl parsing code. Closes #2884 2022-12-16 13:47:51 +00:00
kai
1cbf7bdd77 Populate 'withs' property of leaf nodes at construction, not execution to ensure they appear in ExecutionStarted event. Add the actual error to LeafNodeError event when raising it. Closes #2877 2022-12-15 11:09:19 +00:00
kaidaguerre
fa18c8f0e2 Add support for node reuse. Update graph, flow and hierarchy to declare nodes and edges inline, rather than as a list of references. Closes #2871
Only top level resources can have with and param blocks. Closes #2872
Refactor resource and dashboard run hierarchies to use base impl structs. Closes #2873
2022-12-14 17:18:57 +00:00
kaidaguerre
c35f5ae045 Update with execution to be fully asyncronous, i.e. nodes/edges are run immediately and wait for any dependencies to be available. Closes #2824 2022-12-02 11:40:56 +00:00
kaidaguerre
6cbf541e73 Ensure when LeafRuns for nodes/edges are unique to avoid name clash when they are re-used. If a node/edge fails, copy data from successful nodes /edges to the parent run. Fixes #2810 2022-11-30 18:03:41 +00:00
kaidaguerre
94356ae371 Fix with that have no results. #2772 2022-11-25 16:47:49 +00:00
kaidaguerre
882b678478 When parsing query args, ensure jsonb args are passed to query as string not map. Support argument definitions which make an array out of a runtime dependency. #2772, Closes #2802 2022-11-25 12:01:16 +00:00
kaidaguerre
b1c1c4ea3c When passing a slice as a query arg, ensure it is strongly typed so Postgres can convert it. Fix multiple with blocks. #2789. #2772 2022-11-24 14:33:48 +00:00
kaidaguerre
207c1da5a5 Ensure runtime dependencies are initialised for with blocks. ##2772 2022-11-23 17:41:35 +00:00
kaidaguerre
fe6365b1ef Remove usage of prepared statements - instead excute sql directly. Wrap with executions in LeafRuns to support runtime dependency resolution. Closes #2789. #2772 2022-11-23 14:11:56 +00:00
kai
a5b8fe0fe1 Fix getWithValue. #2772 2022-11-21 18:06:36 +00:00
kaidaguerre
4f90440d26 Add support for with blocks. Closes #2772 2022-11-21 16:25:51 +00:00
kai
f47d55b2bb Fix steampipe query --timing not outputting timing information if sharing or exporting a snapshot. Closes #2677 2022-11-07 14:05:39 +00:00
kai
f628f8ac76 Fix snapshots generated by check for control run not being valid. Closes #2687 2022-11-07 10:37:34 +00:00
kai
6f7e48607a Fix config resolution so install-dir and mod-location are correctly resolved when set in workspace profiles/env vars. Closes #2681
Improve resource not found errors
Put install dir back into workspace profiles
Update export arg help
2022-11-07 10:37:34 +00:00
kai
7e4ecf3724 Update argument descriptions for --output --export, --snapshot-location
Remove 'check' from dashboard arg descriptions
Do not show "Output format defaulted to 'none'" message if sharing a snapshot
remove query timeout from database options
Fix snapshot creation crash when required inputs are not provided
2022-11-07 10:37:34 +00:00
kaidaguerre
3d084c5bc8 Add snapshot-title arg. Ensure snapshots and exports are named consistently. Closes #2666 2022-11-03 11:09:07 +00:00
kaidaguerre
1539023a48 Set default output format for dashboard to none. Closes #2658 2022-11-02 14:04:41 +00:00
kaidaguerre
7050ab06bf Fix input validation failure - update DashboardExecutionTree.RuntimeDependencies to key by unqualified name not short name. Closes #2637 2022-11-01 10:55:43 +00:00
kaidaguerre
938593ebfc Fix --where and --tags args for steampipe check. Closes #2613 (#2624) 2022-10-28 15:52:45 +01:00
kai
7506b1dc45 Fix interface conversion error when executing a dashboard with a Text block as a leaf node. Closes #2612 2022-10-27 17:34:24 +01:00
kaidaguerre
c3177f5956 Add Variables and Inputs to dashboard ExecutionStarted event. Ensure missing inputs are reported as errors for non-interactive executions. Closes #2606 2022-10-27 12:33:23 +01:00
kaidaguerre
17b74fa7e7 Validate inputs when running single dashboard. Do not upload snapshot if dashboard was cancelled. Closes #2551 2022-10-26 11:29:17 +01:00