jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-23 21:03:15 -05:00
Code Issues Packages Projects Releases Wiki Activity

Cache schema during discoverSchema (#10820)

Browse Source 
* Make SchedulerHandler store schema after fetching it

* Add `disable_cache` parameter to discover_schema API

* Return cached catalog if it already exists

* Address code review comments

* Add tests for caching of catalog in SchedulerHandler

* Format fixes

* Fix Acceptance tests

* New code review fixes

- Use upper case for global variable
- Inline definition and assignment of variable
This commit is contained in:
Malik Diarra
2022-03-17 06:40:58 -07:00
committed by GitHub
parent a05068891f
commit 3d9f9ec5a8
8 changed files with 158 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
docs/reference/api/generated-api-html/index.html
View File

@@ -5443,7 +5443,7 @@ font-style: italic;
<h3 class="field-label">Request body</h3>
<div class="field-items">
<div class="param">SourceIdRequestBody <a href="#SourceIdRequestBody">SourceIdRequestBody</a> (required)</div>
<div class="param">SourceDiscoverSchemaRequestBody <a href="#SourceDiscoverSchemaRequestBody">SourceDiscoverSchemaRequestBody</a> (required)</div>
<div class="param-desc"><span class="param-type">Body Parameter</span> &mdash; </div>
@@ -8379,6 +8379,7 @@ font-style: italic;
<li><a href="#SourceDefinitionSpecificationRead"><code>SourceDefinitionSpecificationRead</code> - </a></li>
<li><a href="#SourceDefinitionUpdate"><code>SourceDefinitionUpdate</code> - </a></li>
<li><a href="#SourceDiscoverSchemaRead"><code>SourceDiscoverSchemaRead</code> - </a></li>
<li><a href="#SourceDiscoverSchemaRequestBody"><code>SourceDiscoverSchemaRequestBody</code> - </a></li>
<li><a href="#SourceIdRequestBody"><code>SourceIdRequestBody</code> - </a></li>
<li><a href="#SourceOauthConsentRequest"><code>SourceOauthConsentRequest</code> - </a></li>
<li><a href="#SourceRead"><code>SourceRead</code> - </a></li>
@@ -9360,6 +9361,14 @@ if oauth parameters were contained inside the top level, rootObject=[] If they w
<div class="param">jobInfo </div><div class="param-desc"><span class="param-type"><a href="#SynchronousJobRead">SynchronousJobRead</a></span> </div>
</div> <!-- field-items -->
</div>
<div class="model">
<h3><a name="SourceDiscoverSchemaRequestBody"><code>SourceDiscoverSchemaRequestBody</code> - </a> <a class="up" href="#__Models">Up</a></h3>
<div class='model-description'></div>
<div class="field-items">
<div class="param">sourceId </div><div class="param-desc"><span class="param-type"><a href="#UUID">UUID</a></span> format: uuid</div>
<div class="param">disable_cache (optional)</div><div class="param-desc"><span class="param-type"><a href="#boolean">Boolean</a></span> </div>
</div> <!-- field-items -->
</div>
<div class="model">
<h3><a name="SourceIdRequestBody"><code>SourceIdRequestBody</code> - </a> <a class="up" href="#__Models">Up</a></h3>
<div class='model-description'></div>