Commit Graph

12 Commits

Author SHA1 Message Date
wang wei
5797bc3dfc fix(TDI-45063): support bigquery metadata (#8934) 2023-08-02 09:53:17 +08:00
jzhao
bee20f5c38 feat(TDI-49349):Private Link support for Google Storage & BigQuery (#8497)
* feat(TDI-49349):Google Storage Private API URL tGSXxxx extension

* feat(TDI-49349):Google BigQuery Private API URL tBigQuery extension
part1

* feat(TDI-49349):TEMPLATE_PARAM redirection in tBigQueryOutput_java.xml

* feat(TDI-49349):AUTH_MODE on tBigQuery AUTH_TYPE on tGStorage

* feat(TDI-49349):adjustements and alignements

* feat(TDI-49349):tBigQuerySQLRow preparation

* feat(TDI-49349):Update googleStorageConnection.javajet correction class
path

* feat(TDI-49349):Update tBigQueryInput_begin.javajet

* tBigQueryBulkExec setHost

* tBigQuerySQLRow setHost

* feat(TDI-49349):SERVICE_ACCOUNT to SERVICEACCOUNT

* feat(TDI-49349):removing GoogleStorage private endpoint for
tBigQueryInput and tBigQuerySQLRow,

* chore(TDI-49349):add contributor to the list

* feat(TDI-49349): hide new parameter when use exist connection
and fix a code generate issue

* feat(TDI-49349): change params and display values

* feat(TDI-49349): revert change params name

---------

Co-authored-by: cflamain <cflamain@talend.com>
2023-04-28 14:34:59 +08:00
Olha V
6318139dd4 fix(TDI-48035): Add null marker to tBigQueryOutput (#7662) (#7687) 2022-06-24 12:27:25 +03:00
wang wei
d04e966718 fix(TDI-46476): Remove deprecated components in 8.0 (#6730) 2021-10-26 16:58:10 +08:00
chmyga
830eb8f37e fix(TDI-46777): tBigQueryOutput 24 hour format (#6689) (#6734) 2021-10-13 18:09:01 +03:00
mbasiuk-talend
4d1cfd4fe2 feat(TDI-45914): bigquery stored procedures (#6363) (#6436)
* feat(TDI-45914): implement feature for Input component

* feat(TDI-45914): implement feature for SQLRow component

* feat(TDI-45914): implement feature for BulkExec component

* feat(TDI-45914): remove die on error, put error message

* feat(TDI-45914): update bulkexec with gson, reuse version

* feat(TDI-45914): fix SQLRow as standalone component statistic return

* feat(TDI-45914): improve logging code pieces

* feat(TDI-45914): remove extra whitespaces

* feat(TDI-45914): fix gson object missing cid

* feat(TDI-45914): fix gson object missing cid for BulkExec

* feat(TDI-45914): add return values for tBigqueryOutput

* feat(TDI-45914): fix BulkExec and Output statistics, remove virtual cid part
2021-07-26 18:38:35 +03:00
mbasiuk-talend
9057986f17 feat(TDI-44915) access token feature (#5473) (#5570)
* feat(TDI-44915): integrate Balazs POC

* feat(TDI-44915): implement other BigQuery component with access token

* feat(TDI-44915): update BigQuery bulkexec with new common jet

* feat(TDI-44915): update tGSBucketCreate

* feat(TDI-44915): update tGSBucketDelete

* feat(TDI-44915): update tGSBucketExist

* feat(TDI-44915): update tGSBucketList

* feat(TDI-44915): update connection and close part

* feat(TDI-44915): update tGSCopy

* feat(TDI-44915): update tGSDelete

* feat(TDI-44915): update tGSGet

* feat(TDI-44915): update tGSList

* feat(TDI-44915): update tGSPut

* feat(TDI-44915): use proxy to communicate with GS

* feat(TDI-44915): update code due to PR comments

* feat(TDI-44915): update Input code generation

* feat(TDI-44915): fix tGSPut xml definition

* feat(TDI-44915): update BigQuery Output and generic connection

* feat(TDI-44915): fix _end javajet parts

* feat(TDI-44915): fix bigqueryoutput config mappings

* feat(TDI-44915): fix tGSBuckerCreate dependencies

* feat(TDI-44915): fix PR comments
2020-11-27 10:18:08 +02:00
Roman
0a7f378af8 feat(TDI-44466): add service account support for BulkExec and Output (#4909) (#4947) 2020-07-16 08:57:04 +03:00
chmyga
3ff14ecbb5 Dchmyga/tdi 42591 bigquery dynamic schema (#4196)
* feat(TDI-42591): bigquery dynamic column support

* Add helpers for bigquery input components

* feat(TDI-42591): bigquery dynamic column support

* Add dynamic column support to bigquery input component

* feat(TDI-42591): bigquery dynamic column support

* Add dynamic column support for bigquery output component

* feat(TDI-42591): bigquery dynamic column support

* Fix PR comments

* feat(TDI-42591): bigquery dynamic column support

* Fix fixed component name issue

* feat(TDI-42591): bigquery dynamic column support

* Add support of geography type

* Add support of numeric type

* Fix bytes type support

* feat(TDI-42591): bigquery dynamic column support

* Fix OAuth null objects issue

* Fix byte array service account issue

* feat(TDI-42591): bigquery dynamic column support

* fix compilation error

* feat(TDI-42591): bigquery dynamic column support

* Exclude record type from table creation for OAuth
2020-01-15 16:57:07 +02:00
sponomarova
651dca75e1 fix(TBD-8708): Create table option if it doesn't exist for service account (#3501)
* fix(TBD-8708): tBigqueryOutput - Create table option if it doesn't exist for service account

* fix(TBD-8708): tBigqueryOutput - Create table option if it doesn't exist for service account
2019-05-23 10:55:12 +03:00
Yu
47e1caa316 feat(TBD-5960) Add service account support for Google Bigquery (#2643)
Add service account authentication for bigquery components on DI.
2018-09-03 18:18:48 +02:00
Pierre Teyssier
63144a3daa TDI-36624 : Moving tAzureStorage* and tBigQuery* from BD to DI 2016-06-20 20:00:26 +08:00