1
0
mirror of synced 2026-01-01 00:02:54 -05:00
Commit Graph

20 Commits

Author SHA1 Message Date
Marcos Marx
a89fd05187 Source Sendgrid: add unsub groups stream (#26314)
* add unsubscribe groups stream

* add doc

* fix tests

* fix tests

* fix

* fix update version

* Automated Change

* Delete oss_registry.json

* add expected records

* add eof

* small fix

---------

Co-authored-by: Haithem Souala <haithem.souala@woopit.fr>
2023-05-23 10:03:06 -03:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Artem Inzhyyants
e3bb377a6a Source Sendgrid: fix contacts missing records; Remove Messages stream (#21939)
* Source Sendgrid: remove Messages stream

* Source Sendgrid: fix contacts schema

* Source Sendgrid: remove extra configured catalog

* Source Sendgrid: fix contacts stream; add tests

* Source Sendgrid: update docs

* Source Sendgrid: fix test; disable backward compatibility test

* Source Sendgrid: revert tokenAuthenticator

* Source Sendgrid: update schema

* Source Sendgrid: update primary key

* Source Sendgrid: update expected records

* Source Sendgrid: fix unit test

* Source Sendgrid: update spec for ISO8601 datetime format

* Source Sendgrid: update schemas #19969

* Source Sendgrid: update docs

* Source Sendgrid: update docs

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-31 11:25:23 +01:00
Denys Davydov
60888c2707 Source Sendgrid: change start time param type to datetime string (#16400)
* #4842 Source Sendgrid: change start time param type to datetime string

* #4842 source sendgrid: upd changelog

* #4842 source sendgrid: fix SAT

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-12 13:21:38 +03:00
Brian Lai
184f192bca Revert Sendgrid and Sentry sources to use python CDK instead of low-code (#16112)
* Revert Sendgrid and Sentry sources to use python CDK instead of low-code

* keep yaml configs for future reference

* don't revert additional properties and update changelog w/ PR number

* consistent time formatting in Messages stream and fix the unit test

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-30 17:07:08 -04:00
Brian Lai
61af7a45e4 [source-sentry] [source-sendgrid] [source-greenhouse] add .yaml to list of file imports in setup.py (#15800)
* add .yaml to list of file imports in setup.py

* bump dockerfile version for sentry

* update sentry changelog

* correct sentry, greenhouse, and sendgrid sources to correctly read configs

* add changelog

* update Dockerfile versions

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* fix greenhouse SAT tests and update to next version of cdk w/ schema read fix

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-23 17:46:04 -04:00
Alexandre Girard
8497d78613 Migrate sendgrid to config-based (#15257)
* fix spec

* read records from lists stream

* campaigns

* contacts

* stats_automations

* segments

* single_sends

* templates

* suppressions_global

* suppression groups

* suppression group memebers

* blocks

* bounces

* invalid emails and spam reports

* bump cdk version

* fix paths

* bump cdk version

* only define cursor field in one place

* move to definitions

* move bounces inside the streams array

* move all streams within the streams array

* update sendgrid config

* fix

* derp

* rename field

* fix parse

* Revert "fix parse"

This reverts commit 3c76c5a782.

* fix parse timestamp

* extract datetime parser

* remove print

* use parser

* top level docstring

* rename variable

* Revert "Merge branch 'alex/datetimeFormatTimestamp' into alex/configbasedsendgrid"

This reverts commit 99caa5884e, reversing
changes made to 028bdfbb5e.

* Revert "Revert "Merge branch 'alex/datetimeFormatTimestamp' into alex/configbasedsendgrid""

This reverts commit 8d55afa5aa.

* Revert "Revert "Revert "Merge branch 'alex/datetimeFormatTimestamp' into alex/configbasedsendgrid"""

This reverts commit 9b70a3b67c.

* do not use timestamp()

* Revert "do not use timestamp()"

This reverts commit 016cb69193.

* Handle extracting no records from root

* bump cdk version

* handle empty record

* update unit test

* messages stream needs a different slicer

* handle missing keys

* Update unit test

* record extractor interface

* dpath extractor

* docstring

* use dpath

* Revert "Merge branch 'alex/selectNoRecords' into alex/configbasedsendgrid"

This reverts commit ac92374952, reversing
changes made to e10d6b9f4a.

* bump cdk version

* use dpath

* missing cursor field

* start DRYing the config

* delete more cruff

* DRY

* get start time from config

* delete custom streams

* step=30days

* bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-11 19:34:10 -07:00
Augustin
7ea241f200 source sendgrid: add message stream (#14256) 2022-07-07 14:57:34 +02:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Michel Tricot
1773e41e47 Shorten our headers + adds contributors file (#6478) 2021-09-27 10:45:50 -07:00
Dmytro
2ecc7a6a8d 🎉 Sendgrind add single send stats (#5910)
* Sendgrind source: add single send stream
2021-09-09 20:25:03 +03:00
Vadym
70f5dba415 🎉 Support incremental sync in Sendgrid (#3512)
* Add incremental streams support.
Updated config catalogs.

* Format streams.py

* Add incremental test config.
Update README.md.
Remove unused code.

* Add SendgridStreamIncrementalMixin init type definitions

* Acceptance tests config full_refresh configured_catalog_path fixed.

* Add super() request_params call to SendgridStreamOffsetPagination request_params method

* Fix start time overwrite in incremental streams.
Update config files for abnormal state and catalogs.

* Bump source-sendgrid docker version
2021-05-25 15:49:48 +03:00
Vadym
5ea454acca 🎉 Rewrite sendgrid source using HTTP CDK (#3445)
* Legacy dependencies removed

* Create Sendgrid API module.
Create airbyte_cdk styled source.
Remove deprecated client and source.

* Fix sendgrid source streams, check_connection.
Fix test_source_wrong_credentials.
Add source-acceptance-test config.

* invalid_config.json format fix

* Update setup requirements airbyte-cdk version spec.
Fix Templates stream request_params.

* Update airbyte-integrations/connectors/source-sendgrid/Dockerfile

* Rename api.py to streams.py

* Bump source-sendgrid docker version

* Add sample_files/configured_catalog.json

* Add supported_sync_modes to configured catalogs.
Add no_spam_reports_configured_catalog.json with excluded spam_reports from acceptance test.
Update acceptance-test-config.yml to use no_spam_reports_configured_catalog.json in basic_read.

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-05-20 17:42:57 +03:00
Charles
0df53170c9 Stop formatting python with spotless (#3388) 2021-05-13 17:46:34 -07:00
Davin Chia
f660b0a946 Add template generation for Santa aka CDK. (#3034)
Template generation for new Source using the Santa CDK - provide basic scaffolding for someone implementing a new source.

General approach is to buff up comments in the original SDK, and add TODOs with secondary comments in the generated stub methods, as well as links to existing examples (e.g. Stripe or ExchangeRate api) users can look at.

Checked in and added tests for the generated modules.
2021-04-25 18:02:33 +08:00
Charles
f445fdb5b2 match styling for spotlessApply and format (#3017)
* as a java developer I want to be able to run spotlessApply without changing styles in python code
2021-04-23 09:21:41 -07:00
Yevhenii
14e73046cf Source Sendgrid: Supported more API endpoints (#1955)
Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
Co-authored-by: Sherif Nada <snadalive@gmail.com>
2021-02-14 14:25:40 -08:00
Christophe Duong
e92e9aa8c4 Refactor python sources (#1331)
* Make ConfigContainer internal to SingerSource only
2020-12-16 17:52:17 +01:00
Sherif A. Nada
8cd660d7b4 update sendgrid with new models (#1065) 2020-11-23 15:08:44 -08:00
Yevhenii
e52a1cb3c8 Add new source: Sendgrid (#1002) 2020-11-23 11:07:16 -08:00