Concurrency limit is based on a counter that increment and decrement the limit each time a flow is started and terminated.
This count should always be accurate.
But if some unexpected event occurs (bug or user manually do something wrong), the count may not be accurate anymore.
To avoid any potential issue, when we decrement the counter, we chech that concurrency count is bellow the limit before unqueing an execution.
Fixes#12031
Closes #13301
* feat(filters): add new operation to filters
* feat(filters): add flowId to flow search
* fix(test): fix unit test
---------
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
If a test mis-behave, for ex starting an execution but not terminating it, as the default termination grace period is 5mn it can take very long time to wait for post-test terminaison.
Switching to a termination grace period of 5s may help.
I also detect that the ExecutionControllerRunner test when launching the test suite, would not properly kill the `sleep-long` flow so waiting for it to complete, or the termination grace period. When a test that use this flow is launched separatly it works properly. As a safety net I reduce the sleep from 5mn to 30s.
When computing the next tasks to run, all task runs are created in the CREATED state.
Then when computed tasks to send to the worker, CREATED task runs are listed and converted into worker task.
The issue is that on the next execution message, if tasks sent to the worker are still in CREATED (for ex because the Worker didn't start them yet), they would still be evaluted as to send to the worker.
Setting them to a new SUBMITTED state would prevent them to be taken into account again until they are really terminated.
This should avoid the deduplicateWorkerTask state but this is kept for now with a warning and would be removed later if it proves to work in all cases.
A counter allow to lock by flow which solves the race when two executions are created at the same time and the executoion_runnings table is empty.
Evaluating concurrency limit on the main executionQueue method also avoid an unexpected behavior where the CREATED execution is processed twice as its status didn't change immediatly when QUEUED.
Closes https://github.com/kestra-io/kestra-ee/issues/4877
By evaluating multiple condition in a separate queue, we serialize their evaluation which avoir races when we compute the outputs for flow triggers.
This is because evaluation is a multi step process: first you get the existing condtion, then you evaluate, then you store the result. As this is not guarded by a lock you must not do it concurrently.
The race can still occurs if muiltiple executors run but this is less probable. A re-implementation would be needed probably in 2.0 for that.
Fixes https://github.com/kestra-io/kestra-ee/issues/4602
* feat: implement Flows as a DataSource for dashboards
* chore: review changes
* fix: method signature changes from another commit apply in new flow fetchData method
* feat(tests): rework runner utils to not use the queue during testing
* feat(tests): rework runner utils to not use the queue during testing
* test: rework RetryCaseTest to not rely on executionQueue
* fix(tests): don't catch the Queue exception
* fix(tests): don't catch the Queue exception
* fix compile
* fix(test): concurrency error and made runner test parallel ready
* fix(tests): remove test instance
* feat(tests): use Test Runner Utils
* fix(tests): flaky tests
* fix(test): flaky tests
* feat(tests): rework runner utils to not use the queue during testing
* feat(tests): rework runner utils to not use the queue during testing
* test: rework RetryCaseTest to not rely on executionQueue
* fix(tests): don't catch the Queue exception
* fix(tests): don't catch the Queue exception
* fix compile
* fix(test): concurrency error and made runner test parallel ready
* fix(tests): remove test instance
* feat(tests): use Test Runner Utils
* fix(tests): flaky tests
* fix(test): flaky tests
* fix(tests): flaky set test
* fix(tests): remove RunnerUtils
* fix(tests): fix flaky
* feat(test): rework runner tests to remove the queue usage
* feat(test): fix a flaky and remove parallelism from mysql test suit
* fix(tests): flaky tests
* clean(tests): unwanted test
* add debug exec when fail
* feat(tests): add thread to mysql thread pool
* fix(test): flaky and disable a test
---------
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
Co-authored-by: Roman Acevedo <roman.acevedo62@gmail.com>
* test: make AbstractExecutionRepositoryTest parallelizable
* feat(tests): play jdbc h2 tests in parallel
* fix(tests): failing unit tests
* tests: add await until timeout on some tests
* fix(tests): failing unit tests
* fix(tests): failing unit tests
---------
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
Co-authored-by: Nicolas K. <nk_mikmak@hotmail.com>
This table contains executions for flows that have a concurrency that are currently running.
It has been added in 0.24 but in that release there was a bug that may prevent some records to being correctly removed from this table.
To fix that, we truncate it once.
This is due to the fact that we now process the execution queue concurrently so there is a race when counting currently running executions. This can be seen easily using a ForEachItem as it could create tens or hundreds of executions almost instantly leading to almost all those executions started as they would all see 0 executions running...
Using a dedicated execution running queue, as done in EE, would serialize the messages and fix the issue.
However, if using multiple executor instances and concurrency limit = 1, there is a theoretical race as no locks will be done if no execution is running. A max surge of executions could be as high as the number of executor but this race is less probable to happen in real world scenario.
Fixes#10167
- When creating an execution, you can pass a breakpoint of the form `taskId.value` and an execution kind.
- An execution with a breakpoint will be suspended in the `BREAKPOINT` state when arriving at the point where the breakpoint task should be executed
- You can resume an execution from a breakpoint, this would resume the execution and remove the existing breakpoint. At this time a new breakpoint can be passed.
- You can pass a breakpoint when replaying an execution.
Part-of: https://github.com/kestra-io/kestra-ee/issues/1547
We created miltiple worker job queue because the bean was in the prototype scope.
This was needed only for tests as they are closing it.
Switching to singleton and rebuilding the context of the test that needs it fixes the issue.
* fix(core): #9609 delete tutorial flows and triggers before migrating the database
* fix(core): #9609 delete tutorial flows and triggers before migrating the database for EE version
---------
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
* feat(repositories): clean and fix query filters
* fix(core): #4106 Clean and add unit tests to query filters
* clean(core): format string more cleanly
* fix(core): unit test failing on mysql flow repository
* feat(core): #4106 update ui filters
* fix(ui): add date filter on flows back
---------
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
We previously starts 2 queues: one for emit, and a specific one for receive wich handle WorkerJobRunning under the cover.
We can replace by using a single queue that will transparently handle WorkerJobRunning. As queues starts thread pools their cost is not negligeable.
Fixes#9007
* feat:
- Implement width property
- Replace custom dashboard
- Started to integrate the KPI chart
* feat(ui): introduce dashboard chart layout system
* feat(ui): introduce dashboard chart kpi card
* chore(ui): amend layout widths for sm screen size
* chore(ui): prevent editing of default dashboard
* chore(ui): centering the KPI text inside the box
* chore(ui): dashboard edit preview to respect set layouts
* chore(ui): initial work on setting the default flow & namespace dashboards
* fix(ui): make sure there is no naming clashes
* feat: KPI chart backend implementation
* feat: validation annotations
* chore(ui): make chart legend align to right side
* chore(ui): properly show chart labels
* chore(ui): improve state and ID components inside custom tabels
* chore(ui): add proper link to execution in tables
* feat: implemented Triggers as Datasource for custom dashboards
close kestra-io/kestra-ee#3740
* feat: modified the Markdown chart so now it accept different sources
* feat: rename KPI property to numerator & where
close#3739
* chore(ui): improve markdown component
* chore(ui): markdown charts
* chore(ui): markdown charts
* chore(ui): markdown charts remove padding
* chore(ui): markdown charts
* feat: fixes + define custom dashboard equivalent to current default dashboard with some modification
* fix: round double value
* chore(ui): improve flows and ns charts
* chore(ui): make sure that table shows execution links only if namespace and flowId exist
* chore(ui): make sure markdown is properly shown on dashboard edititng
* fix: correctly do preview instead of load on homepage
* fix: correctly preview markdown chart and add description in default flow dashboard
* fix: apply review changes
* fix: modify test following classes modifications on charts
* tests: restore package-lock
* remove chromatic tools and a warning
---------
Co-authored-by: MilosPaunovic <paun992@hotmail.com>
Co-authored-by: Bart Ledoux <bledoux@kestra.io>
* fix(filters): change label filtering to 'and' instead of 'or'
link to #8489
* test(execution): add test to validate and behavior
* test(execution): fix test
* feat(core): #3427 add OSS tenant migration scripts
* clean(core): fixes after review
* clean(core): make only one command for oss and EE migration
* fix(core): user synchronisation command and clean PR
---------
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
* feat(core)!: WIP make tenant id required
* feat(core)!: WIP make tenant id required
* test(core)!: WIP fix storage unit test
* build(deps): bump com.google.guava:guava from 33.4.7-jre to 33.4.8-jre
Bumps [com.google.guava:guava](https://github.com/google/guava) from 33.4.7-jre to 33.4.8-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-version: 33.4.8-jre
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump io.micronaut.platform:micronaut-platform
Bumps [io.micronaut.platform:micronaut-platform](https://github.com/micronaut-projects/micronaut-platform) from 4.8.0 to 4.8.2.
- [Release notes](https://github.com/micronaut-projects/micronaut-platform/releases)
- [Commits](https://github.com/micronaut-projects/micronaut-platform/compare/v4.8.0...v4.8.2)
---
updated-dependencies:
- dependency-name: io.micronaut.platform:micronaut-platform
dependency-version: 4.8.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump flyingSaucerVersion from 9.11.6 to 9.12.0
Bumps `flyingSaucerVersion` from 9.11.6 to 9.12.0.
Updates `org.xhtmlrenderer:flying-saucer-core` from 9.11.6 to 9.12.0
- [Release notes](https://github.com/flyingsaucerproject/flyingsaucer/releases)
- [Changelog](https://github.com/flyingsaucerproject/flyingsaucer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/flyingsaucerproject/flyingsaucer/compare/v9.11.6...v9.12.0)
Updates `org.xhtmlrenderer:flying-saucer-pdf` from 9.11.6 to 9.12.0
- [Release notes](https://github.com/flyingsaucerproject/flyingsaucer/releases)
- [Changelog](https://github.com/flyingsaucerproject/flyingsaucer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/flyingsaucerproject/flyingsaucer/compare/v9.11.6...v9.12.0)
---
updated-dependencies:
- dependency-name: org.xhtmlrenderer:flying-saucer-core
dependency-version: 9.12.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: org.xhtmlrenderer:flying-saucer-pdf
dependency-version: 9.12.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump software.amazon.awssdk:bom from 2.31.21 to 2.31.25
Bumps software.amazon.awssdk:bom from 2.31.21 to 2.31.25.
---
updated-dependencies:
- dependency-name: software.amazon.awssdk:bom
dependency-version: 2.31.25
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump com.github.oshi:oshi-core from 6.8.0 to 6.8.1
Bumps [com.github.oshi:oshi-core](https://github.com/oshi/oshi) from 6.8.0 to 6.8.1.
- [Release notes](https://github.com/oshi/oshi/releases)
- [Changelog](https://github.com/oshi/oshi/blob/master/CHANGELOG.md)
- [Commits](https://github.com/oshi/oshi/compare/oshi-parent-6.8.0...oshi-parent-6.8.1)
---
updated-dependencies:
- dependency-name: com.github.oshi:oshi-core
dependency-version: 6.8.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump org.opensearch.client:opensearch-java
Bumps [org.opensearch.client:opensearch-java](https://github.com/opensearch-project/opensearch-java) from 2.22.0 to 2.23.0.
- [Release notes](https://github.com/opensearch-project/opensearch-java/releases)
- [Changelog](https://github.com/opensearch-project/opensearch-java/blob/v2.23.0/CHANGELOG.md)
- [Commits](https://github.com/opensearch-project/opensearch-java/compare/v2.22.0...v2.23.0)
---
updated-dependencies:
- dependency-name: org.opensearch.client:opensearch-java
dependency-version: 2.23.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump co.elastic.logging:logback-ecs-encoder
Bumps [co.elastic.logging:logback-ecs-encoder](https://github.com/elastic/ecs-logging-java) from 1.6.0 to 1.7.0.
- [Release notes](https://github.com/elastic/ecs-logging-java/releases)
- [Commits](https://github.com/elastic/ecs-logging-java/compare/v1.6.0...v1.7.0)
---
updated-dependencies:
- dependency-name: co.elastic.logging:logback-ecs-encoder
dependency-version: 1.7.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* tests(system): isolate SchedulerScheduleTest tests with tenantId
* Feat/storage outputs (#8361)
* feat(executions): Store outputs inside the internal storage (1/2)
* feat(executions): Store outputs inside the internal storage (2/2)
* feat(test): allow passing tenantId to tests
---------
Co-authored-by: Ludovic DEHON <tchiot.ludo@gmail.com>
* chore(deps): regular dependency update (#8484)
Performing a weekly round of dependency updates in the NPM ecosystem to keep everything up to date.
* fix(ui): full view height for single task logs (#8042)
Co-authored-by: Miloš Paunović <paun992@hotmail.com>
* feat: synchronize task edition with editor (#8433)
* fix(controls): adjust bottom position of contorls in multiPanelsEditor (#8465)
* fix(executions): unqueing execution must remove the execution queued
When an execution is queued in the JDBC backend, a record is inserted inside the execution_queued table, we must remove this record when we unqeue an execution.
Fixes#8448
* chore(core): localize to languages other than english (#8485)
Extended localization support by adding translations for multiple languages using English as the base. This enhances accessibility and usability for non-English-speaking users while keeping English as the source reference.
Co-authored-by: GitHub Action <actions@github.com>
* tests(webserver): fix flaky test which could query previous tests tasks
* tests(system): debug flaky error of shouldPauseExecutionByQueryRunningFlows
* tests(system): debug flaky error of shouldPauseExecutionByQueryRunningFlows
* tests(system): try with different task id
* tests(system): bump sleep-short sleep time to 10s
* fix(execution)*: decode and hide nested inputs of type SECRET
Fixes#7964
* refactor(core): pass the dynamic concurrency schema to no code editor (#8488)
There was an issue with passing hard-coded concurrency schema to be rendered in No Code editor, which is now amended and we're passing down the previously fetched one
* chore(deps): update gradle version
* doc(basic.md): add link to configuration for kestra property variables (#8490)
* fix(flows): properly check average duration for dashboard graphs (#8457)
There was a problem on flows view with the main chart not showing proper data until user clicks on duration toggle.
Closes https://github.com/kestra-io/kestra/issues/8435.
Closes https://github.com/kestra-io/kestra-ee/issues/3499.
* docs(core-pause): update pauseDuration properties, titles, descriptions (#8495)
* fix(system): restrict the JdbcConcurrencyLimitService to the JDBC runner
* fix(core): fix indexer metric description (#8500)
* Add examples with expression and trimmed values (#6154)
* chore(ui): improvement to drilldown for Default and Custom Charts. (#7885)
* chore(ui): improvement to drilldown for Default and Custom Charts.
* minor tweak
* test: fix the Barchart stories to test drilldown
---------
Co-authored-by: Bart Ledoux <bledoux@kestra.io>
* fix(ui): restart trigger position for backfill column (#8246)
Co-authored-by: Miloš Paunović <paun992@hotmail.com>
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
Co-authored-by: Bart Ledoux <bledoux@kestra.io>
* feat(plugin): add a way to provide additional type of plugins
Provide a way for plugins to define a new type of plugins.
To do that, a plugin must provide both an abstract base class that extends AdditionalPlugin and a set of concret classes.
Both the abstract base class and the concrete classes mut be inside the same plugin. This is a limitation that we may work on later by providing, for example, an SPI to add base classes to the application classloader.
* fix(ui): save existing flow after making changes (#8378)
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
* fix(core): failing DocumentationGeneratorTest.returnDoc()
* chore(core): refactor component to composition API structure and with some styling (#8504)
* feat(flows): add validation for use of inputs and outputs with '-' in the name (#8379)
* test(core): fix breaking change in local flow repository (#8517)
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
* feat(system)!: remove the SQLServer runner
Part-of: https://github.com/kestra-io/kestra-ee/issues/3504
* chore(build): add Postgres stat extension
* feat(plugins): add Langchain4J plugins
* chore(system): add warn log when emit logQueue failed (#8432)
* feat(plugins): add Go Script plugin
* fix(jdbc): add service_id index on service_instance table
* chore(flows): improve the blueprints view within the flow editing panels (#7983)
Changes here consist of removing the tags from blueprint view on Multi Panel flow editor, along with couple of other UI improvements.
Closes https://github.com/kestra-io/kestra/issues/7881.
Co-authored-by: Miloš Paunović <paun992@hotmail.com>
* fix(flows): properly load blueprints in multi panel view (#8524)
While using the new Multi Panel view blueprints were not loading properly due to wrong paramtere being sent to action. now that's sorted.
Closes https://github.com/kestra-io/kestra/issues/8523.
* feat(flows): improve the display of array inputs when running an execution (#7953)
This PR is introducing a change of how the `array` inputs are displayed inside the flow run dialog, to be more user-friendly.
Closes https://github.com/kestra-io/kestra/issues/6947.
---------
Co-authored-by: Miloš Paunović <paun992@hotmail.com>
* fix(system): change default config values for liveness
Change kestra.server.liveness.interval from 5s to 10s
to be less agressive on liveness check. Align
other default liveness configs with kafka implementation.
* fix(ui): amend Absolute date filter's looks (#8501)
* chore(core): localize to languages other than english (#8528)
Extended localization support by adding translations for multiple languages using English as the base. This enhances accessibility and usability for non-English-speaking users while keeping English as the source reference.
Co-authored-by: GitHub Action <actions@github.com>
* docs(flow-trigger): add note about no Pebble in conditions
* fix(ui): remove parts of filter using backspace (#8105)
Co-authored-by: Miloš Paunović <paun992@hotmail.com>
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
* fix(ui): open link in markdown in other tab. (#8258)
* fix(ui): open link in markdown in other tab.
* chore(core): restrict attribute to external links.
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
---------
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
* fix(system): load OpenTelemetry lib in the app classloader
Without that, as we have it here, plugins may have class loading issue if they use OpenTelemetry internally (like in the Elasticsearch client).
* feat(ui): Add search in internal docs (#8458)
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
* fix(triggers): inject default later inside the Scheduler
Today, as they are injected eagerly, they are done even if no trigger exists.
This is counter-performant, and in case the flow is an error will log each seconds.
Doing it a little later will be better.
* build(deps): bump software.amazon.awssdk:bom from 2.31.25 to 2.31.30
Bumps software.amazon.awssdk:bom from 2.31.25 to 2.31.30.
---
updated-dependencies:
- dependency-name: software.amazon.awssdk:bom
dependency-version: 2.31.30
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump org.wiremock:wiremock-jetty12 from 3.12.1 to 3.13.0
Bumps [org.wiremock:wiremock-jetty12](https://github.com/wiremock/wiremock) from 3.12.1 to 3.13.0.
- [Release notes](https://github.com/wiremock/wiremock/releases)
- [Commits](https://github.com/wiremock/wiremock/compare/3.12.1...3.13.0)
---
updated-dependencies:
- dependency-name: org.wiremock:wiremock-jetty12
dependency-version: 3.13.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* build(deps): bump jacksonVersion from 2.18.3 to 2.19.0
Bumps `jacksonVersion` from 2.18.3 to 2.19.0.
Updates `com.fasterxml.jackson:jackson-bom` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-bom/compare/jackson-bom-2.18.3...jackson-bom-2.19.0)
Updates `com.fasterxml.jackson.core:jackson-core` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-core/compare/jackson-core-2.18.3...jackson-core-2.19.0)
Updates `com.fasterxml.jackson.core:jackson-databind` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson/commits)
Updates `com.fasterxml.jackson.core:jackson-annotations` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson/commits)
Updates `com.fasterxml.jackson.module:jackson-module-parameter-names` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-modules-java8/compare/jackson-modules-java8-2.18.3...jackson-modules-java8-2.19.0)
Updates `com.fasterxml.jackson.dataformat:jackson-dataformat-yaml` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-dataformats-text/compare/jackson-dataformats-text-2.18.3...jackson-dataformats-text-2.19.0)
Updates `com.fasterxml.jackson.dataformat:jackson-dataformat-smile` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-dataformats-binary/compare/jackson-dataformats-binary-2.18.3...jackson-dataformats-binary-2.19.0)
Updates `com.fasterxml.jackson.dataformat:jackson-dataformat-cbor` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-dataformats-binary/compare/jackson-dataformats-binary-2.18.3...jackson-dataformats-binary-2.19.0)
Updates `com.fasterxml.jackson.dataformat:jackson-dataformat-ion` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-dataformat-ion/commits)
Updates `com.fasterxml.jackson.dataformat:jackson-dataformat-xml` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-dataformat-xml/compare/jackson-dataformat-xml-2.18.3...jackson-dataformat-xml-2.19.0)
Updates `com.fasterxml.jackson.datatype:jackson-datatype-guava` from 2.18.3 to 2.19.0
- [Commits](https://github.com/FasterXML/jackson-datatypes-collections/compare/jackson-datatypes-collections-2.18.3...jackson-datatypes-collections-2.19.0)
Updates `com.fasterxml.jackson.datatype:jackson-datatype-jsr310` from 2.18.3 to 2.19.0
Updates `com.fasterxml.jackson.datatype:jackson-datatype-jdk8` from 2.18.3 to 2.19.0
---
updated-dependencies:
- dependency-name: com.fasterxml.jackson:jackson-bom
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.core:jackson-core
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.core:jackson-databind
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.core:jackson-annotations
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.module:jackson-module-parameter-names
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-yaml
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-smile
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-cbor
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-ion
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-xml
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.datatype:jackson-datatype-guava
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.datatype:jackson-datatype-jsr310
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.datatype:jackson-datatype-jdk8
dependency-version: 2.19.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* chore(execution): update display names for executions. (#8527)
* fix(core): change incorrectly used search parameter (#8534)
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
* fix(ui): set isCreating to false when opening flow edit mode (#8549)
* fix(core): safely access section and identifier query params (#8542)
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
* fix(ui): update storybook editor tests with provided keys (#8550)
Co-authored-by: Piyush Bhaskar <102078527+Piyush-r-bhaskar@users.noreply.github.com>
* chore(core): localize to languages other than english (#8554)
Extended localization support by adding translations for multiple languages using English as the base. This enhances accessibility and usability for non-English-speaking users while keeping English as the source reference.
Co-authored-by: GitHub Action <actions@github.com>
* fix(triggers): amend broken filtering on triggers tab (#8553)
There was a problem with both namespace and state filters on Triggers page which is now properly sorted.
Closes https://github.com/kestra-io/kestra/issues/8529.
* chore: attempt to fix flaky tests (#8537)
SingleFlowCommandsTest:
The flow Delete -> Create -> Update sequence is weird - delete got HTTP 404.
Reworked to Create -> Update -> Delete sequence.
PurgeLogsTest:
The log repository contained the prepared single entry but also might
contain additional entries from previously logged messages.
* fix(namespaces): namespaceFiles with same name are wrongly overwritten (#8562)
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
* feat(core): forward execution labels in Flow Trigger
* chore(triggers)*: properly handle switches for triggers disabled from within flow source (#8106)
It was not clear as to which trigger can not be enabled and why. Now, that is much more clear with the proper tooltips and disabling of switch toggling.
Closes https://github.com/kestra-io/kestra/issues/8011.
Closes https://github.com/kestra-io/kestra/issues/5736.
* fix(executions): fix execution failure due to UnsupportedOperationException (#8563)
Fix: #8563
* chore(core): localize to languages other than english (#8568)
Extended localization support by adding translations for multiple languages using English as the base. This enhances accessibility and usability for non-English-speaking users while keeping English as the source reference.
Co-authored-by: GitHub Action <actions@github.com>
* feat(system): add TestSuite model,taskFixture impl
* fix: redirect to edit when saving new flow (#8560)
Co-authored-by: Piyush Bhaskar <102078527+Piyush-r-bhaskar@users.noreply.github.com>
* feat(system)*: decrease defaut JDBC queue poll size
Decreasing it from 100 to 50 didn't show any performance hit but should lower the memory consumption now that we process the queue concurrently in the executor.
## BEFORE - pollSize=100
- 10 tx/s: 150ms
- 25 tx/s: 200ms
- 50 tx/s: 300ms
- 75 tx/s: 5.2s
- 100 tx/s: 15s
## AFTER - pollSize=50
- 10 tx/s: 150ms
- 25 tx/s: 200ms
- 50 tx/s: 300ms
- 75 tx/s: 4.8s
- 100 tx/s: 14s
* feat(flows): Allow to define an onPause task on the Pause task
The onPause task will be executed immediatly when the execution is paused.
Part-of: #3601
* feat(core)!: WIP make tenant id required
* feat(core)!: WIP make tenant id required
* Feat/storage outputs (#8361)
* feat(executions): Store outputs inside the internal storage (1/2)
* feat(executions): Store outputs inside the internal storage (2/2)
* feat(test): allow passing tenantId to tests
---------
Co-authored-by: Ludovic DEHON <tchiot.ludo@gmail.com>
* tests(webserver): fix flaky test which could query previous tests tasks
* feat(executions): Add workerId to each worker task attemps
Closes#7799
* Feat/storage outputs (#8361)
* feat(executions): Store outputs inside the internal storage (1/2)
* feat(executions): Store outputs inside the internal storage (2/2)
* feat(test): allow passing tenantId to tests
---------
Co-authored-by: Ludovic DEHON <tchiot.ludo@gmail.com>
* wip(core): fix unit tests
* test(core): fix unit tests
* test(core): fix unit tests
* test(core): fix unit tests
* feat(core): make tenant id required everywhere
* feat(core): make tenant required in create user command
* feat(core): clean the PR
* feat(core): add tenant id to dashboard controller
* fix(core): tests after merging
* clean(core): fixes after review
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: nKwiatkowski <nkwiatkowski@kestra.io>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Roman Acevedo <roman.acevedo62@gmail.com>
Co-authored-by: Loïc Mathieu <loikeseke@gmail.com>
Co-authored-by: Ludovic DEHON <tchiot.ludo@gmail.com>
Co-authored-by: Miloš Paunović <paun992@hotmail.com>
Co-authored-by: Piyush Bhaskar <102078527+Piyush-r-bhaskar@users.noreply.github.com>
Co-authored-by: Barthélémy Ledoux <ledouxb@me.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: GitHub Action <actions@github.com>
Co-authored-by: AJ Emerich <aemerich@kestra.io>
Co-authored-by: ben8t <46634684+Ben8t@users.noreply.github.com>
Co-authored-by: Bart Ledoux <bledoux@kestra.io>
Co-authored-by: Satvik Kushwaha <59243339+satvik2131@users.noreply.github.com>
Co-authored-by: Karuna Tata <karuna.tata@devrev.ai>
Co-authored-by: Hashim Khalifa <105060840+hashimzs@users.noreply.github.com>
Co-authored-by: lwyang <1670906161@qq.com>
Co-authored-by: 杨利伟 <yangliwei@xiaomi.com>
Co-authored-by: Florian Hussonnois <fhussonnois@kestra.io>
Co-authored-by: yuri <1969yuri1969@gmail.com>
Co-authored-by: AJ Emerich <aj-emerich@proton.me>
Co-authored-by: rajatsingh23 <48049052+rajatsingh23@users.noreply.github.com>
Purge service instance in EMPTY state after a certain duration, 30 days by default, to avoid never ending groth on the service_instances table.
Fixes#8514
Add new FlowId, FlowInterface and GenericFlow classes to support
deserialization of flow with un-typed plugins (i.e., tasks, triggers)
in order to inject defaults prior to strongly-typed deserialization.
