Edward Gao
aacf63d66a
Bulk load cdk: improve component tests' upsert test coverage ( #69338 )
2025-11-20 00:43:33 +00:00
Edward Gao
3991e28549
Destination Clickhouse: increase test timeout ( #69717 )
2025-11-19 15:17:28 -08:00
Edward Gao
457810290c
bulk CDK: fix test timeouts ( #66676 )
2025-09-24 10:53:08 -07:00
Edward Gao
eeda8c59ab
[discuss] Kotlin connectors: enable -Xdebug when building locally ( #62091 )
2025-06-26 23:59:13 +00:00
Matt Bayley
13d77e6e3f
Required plugin for gradle deps diff workflow ( #60299 )
2025-05-15 12:41:57 -07:00
Edward Gao
cd1f957764
Java connectors: echo junit test stdout to console ( #53677 )
2025-02-13 23:14:50 +00:00
Edward Gao
6aacfa250d
disable werr locally ( #53666 )
2025-02-12 20:02:14 -08:00
Marius Posta
8f43ca6954
gradle: fix annoying ksp error, bump CDK dependencies ( #44473 )
2024-08-20 13:53:54 -07:00
Marius Posta
359833011c
gradle,.github: add bulk cdk publish workflow ( #43361 )
2024-08-07 10:22:30 -07:00
Stephane Geneix
c884f195d8
destination-snowflake: convert all tests to kotlin ( #38632 )
2024-05-28 11:47:04 -07:00
Stephane Geneix
c326286b5a
debuggability improvements to the CDK ( #37746 )
...
A few changes to improve debuggability:
1) We now print the stack trace that created an orphan thread, in addition to the current stack trace.
2) we add the ability for a connector to tell the integration runner to not care about certain threads (by adding a thread filter)
3) We change the log of connector containers to include the name of the test that created it (usually each test will create and close a container)
4) We also log when the timeout timer gets triggered, to try to understand why some tests are still taking way more time than their timeout should allow
Another change that was initially in there but has been removed and might be worth thinking about:
Today, only Write checks for live threads on shutdown. We might want to do that for other operations as well
2024-05-03 06:50:22 -07:00
Stephane Geneix
75ac5a98b4
remove all dependencies to lombok ( #37627 )
...
We only use lombok for super trivial stuff and it tends to not play well with Micronauts. Lets' get rid of it!
2024-04-26 12:01:29 -07:00
Marius Posta
bd401817dd
gradle: re-enable spotbugs everywhere, print output to console ( #36605 )
2024-04-03 17:20:34 -07:00
Marius Posta
2495575795
java-cdk: re-export airbyte-api dependency ( #36759 )
2024-04-03 10:43:05 -07:00
Stephane Geneix
911d150764
bump kotlin to 1.9.23 ( #36735 )
...
There's a bug fix in 1.19.23 that caused compilation to pass, and potentially tests to fail : https://youtrack.jetbrains.com/issue/KT-64640 .
we're bumping kotlin to the latest version (which fixes that bug)and updating our code that was exploiting it
they also fixed https://youtrack.jetbrains.com/issue/KT-66044 , which caused the List.getFirst() to be removed from the API, so we had to change that too
2024-04-01 13:02:05 -07:00
Stephane Geneix
6c498ba48d
download artifacts sources ( #36323 )
2024-03-21 10:12:34 -07:00
Marius Posta
109a2faa37
gradle: build cache tweaks ( #36055 )
2024-03-15 11:42:02 -07:00
Marius Posta
ef473c5338
gradle: add kotlin support in all projects, warnings as errors ( #36018 )
2024-03-13 10:56:17 -05:00
Stephane Geneix
c7e0d74f91
fix junit versionning mess ( #35977 )
2024-03-11 21:56:37 -07:00
Stephane Geneix
b67d16d730
java-CDK fixes to the Junit interceptor ( #35827 )
2024-03-05 17:12:26 -08:00
Stephane Geneix
afb231f100
add proper logging to junit runs ( #35394 )
...
Basically, Junit is not logging any thing about its progress outside of the console. This is aimed at fixing that by outputing progress logs along with the standard logs. So there's going to be a line before each step of a test run, and a line after with the elapsed time. Also, exception are now part of the logs instead of being only part of the junit report.
In the process of doing that, I decided to clean up and simplify the log4j2.xml file.
I also noted a few issues with ANSI coloring, so there's a fix for that.
Finally, I'm removing empty lines from container logs (MSSQL is full of them).
The junit printing is done through an intereceptor. That interceptor uses introspection. I wanted to use a factory method, but java's ServiceLoader only allows classes that extends the service interface, hence the need to override every method in the interceptor class, and to plop a proxy on top of that.
2024-02-20 13:25:23 -08:00
Marius Posta
f93c0df331
gradle: overall simplification ( #35307 )
2024-02-16 12:46:32 +00:00
Marius Posta
b9ab3d1a90
migrate everything from java 17 to java 21 ( #35103 )
2024-02-09 19:26:19 -06:00
Marius Posta
796b2e8dad
java CDK: clean up dependencies, refactor modules ( #34745 )
2024-02-08 19:46:51 -06:00
Marius Posta
fccc1d08ec
airbyte-ci: embed junit xml reports into user-facing html report ( #34923 )
2024-02-07 11:45:30 -08:00
Marius Posta
30a5127168
enable groovy formatting in airbyte-ci format config, remove spotless from gradle build ( #33013 )
...
Co-authored-by: postamar <postamar@users.noreply.github.com >
2023-12-01 09:27:16 -08:00
Marius Posta
300ce8533f
airbyte-ci: format improvements ( #32999 )
...
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com >
2023-12-01 16:53:40 +00:00
Marius Posta
d97a399a24
source-mysql, source-mssql: parallelize test execution ( #32772 )
...
Co-authored-by: postamar <postamar@users.noreply.github.com >
2023-11-27 12:49:06 -06:00
Ella Rohm-Ensing
ac3eb28de2
airbyte-ci: add format commands ( #31831 )
...
Co-authored-by: Ben Church <ben@airbyte.io >
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com >
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
Co-authored-by: Augustin <augustin@airbyte.io >
Co-authored-by: Marius Posta <marius@airbyte.io >
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com >
2023-11-14 02:17:48 -06:00
Stephane Geneix
c642d81b84
Stephane/enable javac errors 1 ( #32467 )
2023-11-13 18:07:58 -06:00
Marius Posta
04ae91ff96
java CDK: spin off s3 destinations ( #32050 )
...
Co-authored-by: postamar <postamar@users.noreply.github.com >
2023-11-03 20:31:58 +00:00
Marius Posta
ef6dbd0cb9
gradle: test task configuration changes ( #32108 )
...
Co-authored-by: postamar <postamar@users.noreply.github.com >
2023-11-03 12:54:09 -05:00
Marius Posta
7cd8020ac8
java CDK: hoist top-level gradle projects into CDK ( #31960 )
...
Co-authored-by: postamar <postamar@users.noreply.github.com >
2023-10-30 12:03:06 -07:00
Marius Posta
9835f6b246
airbyte-ci: better gradle caching ( #31535 )
...
Co-authored-by: postamar <postamar@users.noreply.github.com >
2023-10-23 08:26:23 -07:00
Marius Posta
1394a19ab1
gradle: repo cleanup ( #31460 )
2023-10-18 13:43:41 -05:00
Edward Gao
f1baf2a2f2
Destinations snowflake+bigquery: Improve performance by filtering raw table on extracted_at ( #31191 )
...
Co-authored-by: edgao <edgao@users.noreply.github.com >
2023-10-17 17:48:18 +00:00
Marius Posta
29b411868f
gradle: set user timezone to UTC in all tests ( #31305 )
2023-10-12 07:01:06 -07:00
Marius Posta
ae2ca40113
gradle: search for python3.11 binary for AL2023 support ( #31227 )
2023-10-10 13:15:02 -07:00
Marius Posta
53735b6d37
gradle: remove SUB_BUILD env var and references ( #31027 )
2023-10-04 14:58:22 -07:00
Marius Posta
f8edc18039
airbyte-ci,gradle: replace airbyte-docker with airbyte-ci ( #30743 )
2023-10-04 08:38:17 -07:00
Marius Posta
7ae97175a6
gradle: fix repo wide behaviour ( #30607 )
2023-09-28 05:01:13 -07:00
Aaron ("AJ") Steers
da32fc86bf
🚀 Launch Java CDK v0.1.0 (PR #30383 )
...
- Launch Java CDK `v0.1.0`. 🚀
- Remove `airbyte-docker` gradle plugin from java connectors.
- Add `airbyte-java-connector` gradle plugin.
- Remove `airbyte-commons` from global build.gradle.
- Add `/publish-java-cdk` slash command.
- Initial launch of `/airbyte-ci` slash command to test connectors.
2023-09-27 15:46:02 -07:00
Ben Church
5c56ac1d84
Airbyte-ci: Remove gradle task connectorAcceptanceTest ( #30326 )
2023-09-19 15:16:37 -05:00
Marius Posta
51c67d7eaa
gradle: remove airbyteDocker.outputs dependencies ( #30314 )
2023-09-11 17:16:27 -07:00
Marius Posta
ef2849e35e
gradle: fix airbyteDocker task inputs ( #30187 )
2023-09-07 03:46:31 -07:00
Marius Posta
be1e1adabd
gradle: cleanup ( #30060 )
2023-09-05 14:05:40 -05:00
Marius Posta
3e680675a4
github workflows: repo-wide auto-format ( #29798 )
...
Co-authored-by: postamar <postamar@users.noreply.github.com >
2023-08-25 10:20:41 -07:00
Marius Posta
f5c7c1c0b8
chore: get ./gradlew format to pass for the whole repo (same java style) ( #29786 )
2023-08-24 05:09:42 -05:00
Aaron ("AJ") Steers
d094b152c9
Java CDK 'no-op': v0.0.1 ( #28687 )
...
Co-authored-by: aaronsteers <aaronsteers@users.noreply.github.com >
Co-authored-by: Conor <cpdeethree@users.noreply.github.com >
Co-authored-by: cpdeethree <conor@airbyte.io >
Co-authored-by: Augustin <augustin@airbyte.io >
Co-authored-by: Joe Bell <joseph.bell@airbyte.io >
2023-08-21 14:01:32 -05:00
Ben Church
1d856ab943
Feat: Metadata Service remove old catalog system ( #26013 )
...
* Remove Definition File References from Python files (#25590 )
* Remove check_images_exist.sh
* Update definitions.py
* Update build_report.py
* Update tools/bin/ci_integration_workflow_launcher.py
* Update tools/bin/ci_check_dependency.py
* tools/bin/scan_all_spec_airbyte_secret.py
* Remove qa engine references
* Revert "Remove check_images_exist.sh"
This reverts commit 7675162789#25593 )
* Remove Definition File References from Java files (LocalDefinitionProvider), shell scripts and docs (#25592 )
* Remove CombinedConnectorCatalogGenerator.java
* Update local definition provider
* Update local def test
* Add spec mask downloader
* Make downloader work
* Delete generators and add tests
* REMOVE THE YAML FILES
* Roughly update docs
* Update shell scripts
* Remove unused
* Add connector metadata file doc
* Apply suggestions from code review
Co-authored-by: Augustin <augustin@airbyte.io >
* Additional PR comments
* Run format tasks
---------
Co-authored-by: Augustin <augustin@airbyte.io >
* Remove unused import
* bundle registry
* Ignore future updates
* Update registry
* new registry
* Readd maskeddatainterceptor
* Automated Change
* Remove icon validation
* Automated Change
* Automated Change
* Source Amazon Ads: get rid of `fail_on_extra_columns: false` in SAT (#25913 )
* Source Amazon Ads: small schema fixes
* Source Amazon Ads: update changelog
* Source Amazon Ads: update unittest
* Source Amazon Ads: unittest additional property is boolean
* Source Amazon Ads: bump version
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
* connectors-ci: make spec-cache / metadata bucket and creds not required for pre-release (#26119 )
* Automated Change
---------
Co-authored-by: Augustin <augustin@airbyte.io >
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com >
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 11:40:11 -07:00
