Commit Graph

57 Commits

Author SHA1 Message Date
kaidaguerre
137e438bdc Resource references in depdency mods must be fully qualified. Locals in dependency mods cannot be referenced. Support transitive dependencies referencing variables from different versions of same mod. Closes #3335. Closes #3336. Closes #3337 2023-04-14 12:37:32 +01:00
Binaek Sarkar
ee8b6647c4 Rationalising 'status hooks'. Do not show spinner when setting status, instead require an explicit Show. #2432 2023-03-14 11:48:14 +00:00
kaidaguerre
92396d77c0 Remove connection pool min size. Remove need to create empty mod introspection tables if introspection is not enabled. Remove connection pool min size. Closes #3207
* Remove all references to prepared statements
* remove sessionInitWaitGroup
2023-03-09 16:55:08 +00:00
kaidaguerre
7c2ae6da93 when executing a query as a dashboard, name the dashboard custom.dashboard.sql_<query_hash>. Closes #3150 2023-02-28 18:19:13 +00:00
Binaek Sarkar
06af870908 Fix running a single dashboard from the command line failing if the dashboard needs inputs and the dashboard name is not fully qualified. Closes #3168. Closes #3154 2023-02-28 15:27:09 +00:00
kaidaguerre
75aab0c2eb When adding vars from dependency mods to a snapshot using spvars name format: <mod-name>.<var-name>. #2730 2023-02-01 13:18:55 +00:00
kaidaguerre
a5703fb377 Fix when running a dashboard from a dependent mod, default var vals not being included in the snapshot. Closes #2730 2023-01-31 17:29:41 +00:00
kaidaguerre
6ee391faba Workspace file watching events sometime cause dashboard to stall and stop responding to events. Cancelling dashboards (e.g. by pressing 'back' on the browser) sometimes leave the server in a state where it will not respond to socket events. #3007.#. #3008 2023-01-17 11:52:53 +00:00
kaidaguerre
0e4f0460ed Revert "Add blocking_children to LeafNodeUpdated event" (#2988)
* Revert "Add `blocking_children` to LeafNodeUpdated event"

This reverts commit 302181dd
2023-01-12 14:42:17 +00:00
Mike Burgess
1ba8c7d7a1 Dashboard panels should not show if dependent inputs are not populated. Closes #2894. (#2982) 2023-01-11 17:54:21 +00:00
kaidaguerre
d254301f9e When editing dashboard files, after adding/fixing errors in the HCL the dashboard server will sometimes stall. Closes #2952
Fixed tactically by increasing the channel buffer size and also adding a timeout/cancellation support to the dashboard event sending code
2023-01-06 17:49:43 +00:00
kaidaguerre
718c4f1944 Update steampipe_reference introspection table to include references from with blocks. Closes #2934
* Move AddReference and GetReferences to ResourceWithMetadataImpl
* Remove resourceMapProvider from setBaseProperties signature
* Remove MergeBaseDependencies
* Remove 'base; property from with
* Only populate refs if introspection is enabled
2023-01-06 17:18:24 +00:00
kaidaguerre
2d2a137705 Split WithProvider from RuntimeDependencyProvider. Only dashboard and NodeEdgeProviders can have with blocks. Closes #2946 2023-01-05 18:02:44 +00:00
kaidaguerre
0a391e9636 Update dashboard states to "initialized", "blocked", "running", "complete", "error", "canceled". Closes #2939 2023-01-04 14:08:56 +00:00
kaidaguerre
689ed6d06b Add support for dependencies between withs. Closes #2914 2022-12-23 13:36:40 +00:00
kai
dbc209147d Fix incorrect initial value of CheckRun RunStatus, which was preventing benchmarks from running as dashboard.
Rationalise MappableResource
2022-12-23 13:36:19 +00:00
kai
cd80fa28e4 Remove redundant code. Add issues to TODOs. 2022-12-23 13:15:46 +00:00
kaidaguerre
dfcff84f2d Add support for param runtime dependencies. Closes #2910 2022-12-22 13:44:40 +00:00
Mike Burgess
f1888f3d69 Show dashboard panel log in panel detail. Closes #2895. (#2902) 2022-12-21 12:46:42 +00:00
kaidaguerre
3bf90acaf6 Add support for independent execution and resolution of base resource runtime dependencies. Closes #2893 2022-12-19 16:55:26 +00:00
Mike Burgess
cf7f5f878b Dashboard panels should support more granular statuses. Closes #2889. (#2891) 2022-12-19 16:35:48 +00:00
kaidaguerre
d915ce69f4 Refactor base resolution to use nested structs. Remove modified gohcl parsing code. Closes #2884 2022-12-16 13:47:51 +00:00
kai
1cbf7bdd77 Populate 'withs' property of leaf nodes at construction, not execution to ensure they appear in ExecutionStarted event. Add the actual error to LeafNodeError event when raising it. Closes #2877 2022-12-15 11:09:19 +00:00
kaidaguerre
fa18c8f0e2 Add support for node reuse. Update graph, flow and hierarchy to declare nodes and edges inline, rather than as a list of references. Closes #2871
Only top level resources can have with and param blocks. Closes #2872
Refactor resource and dashboard run hierarchies to use base impl structs. Closes #2873
2022-12-14 17:18:57 +00:00
kaidaguerre
c35f5ae045 Update with execution to be fully asyncronous, i.e. nodes/edges are run immediately and wait for any dependencies to be available. Closes #2824 2022-12-02 11:40:56 +00:00
kaidaguerre
6cbf541e73 Ensure when LeafRuns for nodes/edges are unique to avoid name clash when they are re-used. If a node/edge fails, copy data from successful nodes /edges to the parent run. Fixes #2810 2022-11-30 18:03:41 +00:00
kaidaguerre
94356ae371 Fix with that have no results. #2772 2022-11-25 16:47:49 +00:00
kaidaguerre
882b678478 When parsing query args, ensure jsonb args are passed to query as string not map. Support argument definitions which make an array out of a runtime dependency. #2772, Closes #2802 2022-11-25 12:01:16 +00:00
kaidaguerre
b1c1c4ea3c When passing a slice as a query arg, ensure it is strongly typed so Postgres can convert it. Fix multiple with blocks. #2789. #2772 2022-11-24 14:33:48 +00:00
kaidaguerre
207c1da5a5 Ensure runtime dependencies are initialised for with blocks. ##2772 2022-11-23 17:41:35 +00:00
kaidaguerre
fe6365b1ef Remove usage of prepared statements - instead excute sql directly. Wrap with executions in LeafRuns to support runtime dependency resolution. Closes #2789. #2772 2022-11-23 14:11:56 +00:00
kai
a5b8fe0fe1 Fix getWithValue. #2772 2022-11-21 18:06:36 +00:00
kaidaguerre
4f90440d26 Add support for with blocks. Closes #2772 2022-11-21 16:25:51 +00:00
kai
f47d55b2bb Fix steampipe query --timing not outputting timing information if sharing or exporting a snapshot. Closes #2677 2022-11-07 14:05:39 +00:00
kai
f628f8ac76 Fix snapshots generated by check for control run not being valid. Closes #2687 2022-11-07 10:37:34 +00:00
kai
6f7e48607a Fix config resolution so install-dir and mod-location are correctly resolved when set in workspace profiles/env vars. Closes #2681
Improve resource not found errors
Put install dir back into workspace profiles
Update export arg help
2022-11-07 10:37:34 +00:00
kai
7e4ecf3724 Update argument descriptions for --output --export, --snapshot-location
Remove 'check' from dashboard arg descriptions
Do not show "Output format defaulted to 'none'" message if sharing a snapshot
remove query timeout from database options
Fix snapshot creation crash when required inputs are not provided
2022-11-07 10:37:34 +00:00
kaidaguerre
3d084c5bc8 Add snapshot-title arg. Ensure snapshots and exports are named consistently. Closes #2666 2022-11-03 11:09:07 +00:00
kaidaguerre
1539023a48 Set default output format for dashboard to none. Closes #2658 2022-11-02 14:04:41 +00:00
kaidaguerre
7050ab06bf Fix input validation failure - update DashboardExecutionTree.RuntimeDependencies to key by unqualified name not short name. Closes #2637 2022-11-01 10:55:43 +00:00
kaidaguerre
938593ebfc Fix --where and --tags args for steampipe check. Closes #2613 (#2624) 2022-10-28 15:52:45 +01:00
kai
7506b1dc45 Fix interface conversion error when executing a dashboard with a Text block as a leaf node. Closes #2612 2022-10-27 17:34:24 +01:00
kaidaguerre
c3177f5956 Add Variables and Inputs to dashboard ExecutionStarted event. Ensure missing inputs are reported as errors for non-interactive executions. Closes #2606 2022-10-27 12:33:23 +01:00
kaidaguerre
17b74fa7e7 Validate inputs when running single dashboard. Do not upload snapshot if dashboard was cancelled. Closes #2551 2022-10-26 11:29:17 +01:00
kaidaguerre
2309abb7fd Support executing any query-provider resources using the steampipe query command. Optimize autocomplete. Closes #2558 2022-10-24 10:45:28 +01:00
kaidaguerre
b5f9319b9c Add support for WorkspaceProfile inheriting from another using base=. Closes #2574
Move AddReference and GetReferences to ResourceWithMetadata
Rename `RunContext` to `ModParseContext`
2022-10-21 19:16:17 +01:00
kaidaguerre
1e3db26e8f Add support for workspace profiles - parse from config and select using --workspace arg. Closes #2510
Add support for implicit workspace. Closes #2514
If snapshot-location is a local file path, copy snapshot instead of uploading. Closes #2550
Do not show snapshot upload status if --progress=false. Closes #2517
Replace --workspace with --snapshot-location. Closes #2512
2022-10-19 13:02:24 +01:00
kaidaguerre
028d46c8ff Revert connection watching min-interval. Remove filewatcher from utils and and use go-kit filewatcher instead. 2022-10-17 22:07:21 +01:00
kaidaguerre
1dc28f4681 Add --source-snapshot option to dashboard command. Closes #2503. (#2491) 2022-10-11 23:36:27 +01:00
kaidaguerre
dc70d00644 Add dashboard support for explicitly declared nodes, edges and categories. Closes #2488 2022-10-05 17:16:06 +01:00