GitBook: [master] one page modified
This commit is contained in:
committed by
gitbook-bot
parent
77310a24d0
commit
8af07ff7d2
@@ -2,8 +2,6 @@
|
||||
|
||||

|
||||
|
||||
## Overview
|
||||
|
||||
The [Slack free tier](https://slack.com/pricing/paid-vs-free) saves only the last 10K messages. For social Slack instances, it may be impractical to upgrade to a paid plan to retain these messages. Similarly, for an open-source project like Airbyte where we interact with our community through a public Slack instance, the cost of paying for a seat for every Slack member is prohibitive.
|
||||
|
||||
However, searching through old messages can be really helpful. Losing that history feels like some advanced form of memory loss. What was that joke about Java 8 Streams? This contributor question sounds familiar—haven't we seen it before? But you just can't remember!
|
||||
@@ -14,7 +12,7 @@ Specifically, we will export messages from your Slack instance into an open-sour
|
||||
|
||||
We want to make this process easy, so while we will link to some external documentation for further exploration, we will provide all the instructions you need here to get this up and running.
|
||||
|
||||
## Set Up MeiliSearch
|
||||
## 1. Set Up MeiliSearch
|
||||
|
||||
First, let's get MeiliSearch running on our workstation. MeiliSearch has extensive docs for [getting started](https://docs.meilisearch.com/reference/features/installation.html#download-and-launch). For this tutorial, however, we will give you all the instructions you need to set up MeiliSearch using Docker.
|
||||
|
||||
@@ -31,9 +29,9 @@ That's it!
|
||||
MeiliSearch stores data in $\(pwd\)/data.ms, so if you prefer to store it somewhere else, just adjust this path.
|
||||
{% endhint %}
|
||||
|
||||
## How To Replicate Your Slack Messages to MeiliSearch
|
||||
## 2. Replicate Your Slack Messages to MeiliSearch
|
||||
|
||||
### Set Up Airbyte
|
||||
### a. Set Up Airbyte
|
||||
|
||||
Make sure you have Docker and Docker Compose installed. If you haven’t set Docker up, follow the [instructions here](https://docs.docker.com/desktop/) to set it up on your machine. Then, run the following commands:
|
||||
|
||||
@@ -47,7 +45,7 @@ If you run into any problems, feel free to check out our more extensive [getting
|
||||
|
||||
Once you see an Airbyte banner, the UI is ready to go at [http://localhost:8000/](http://localhost:8000/). Once you have set your user preferences, you will be brought to a page that asks you to set up a source. In the next step, we'll go over how to do that.
|
||||
|
||||
### Set Up Airbyte’s Slack Source Connector
|
||||
### b. Set Up Airbyte’s Slack Source Connector
|
||||
|
||||
In the Airbyte UI, select Slack from the dropdown. We provide step-by-step instructions for setting up the Slack source in Airbyte [here](https://docs.airbyte.io/integrations/sources/slack#setup-guide). These will walk you through how to complete the form on this page.
|
||||
|
||||
@@ -57,11 +55,11 @@ By the end of these instructions, you should have created a Slack source in the
|
||||
|
||||
The Airbyte app will now prompt you to set up a destination. Next, we will walk through how to set up MeiliSearch.
|
||||
|
||||
### Set Up Airbyte’s MeiliSearch Destination Connector
|
||||
### c. Set Up Airbyte’s MeiliSearch Destination Connector
|
||||
|
||||
Head back to the Airbyte UI. It should still be prompting you to set up a destination. Select "MeiliSearch" from the dropdown. For the `host` field, set: `http://localhost:7700`. The `api_key` can be left blank.
|
||||
|
||||
### Set Up the Replication
|
||||
### d. Set Up the Replication
|
||||
|
||||
On the next page, you will be asked to select which streams of data you'd like to replicate. We recommend unchecking "files" and "remote files" since you won't really be able to search them easily in this search engine.
|
||||
|
||||
@@ -69,7 +67,7 @@ On the next page, you will be asked to select which streams of data you'd like t
|
||||
|
||||
For frequency, we recommend every 24 hours.
|
||||
|
||||
## Search MeiliSearch
|
||||
## 3. Search MeiliSearch
|
||||
|
||||
After the connection has been saved, Airbyte should start replicating the data immediately. When it completes you should see the following:
|
||||
|
||||
@@ -88,7 +86,7 @@ curl 'http://localhost:7700/indexes/messages/search' --data '{ "q": "welcome to"
|
||||
# => {"hits":[{"_ab_pk":"7ff9a858_6959_45e7_ad6b_16f9e0e91098","channel_id":"C01M2UUP87P","client_msg_id":"77022f01-3846-4b9d-a6d3-120a26b2c2ac","type":"message","text":"welcome to airbyte.","user":"U01AS8LGX41","ts":"2021-02-05T17:26:01.000000Z","team":"T01AB4DDR2N","blocks":[{"type":"rich_text"}],"file_ids":[],"thread_ts":"1612545961.000800"}],"offset":0,"limit":20,"nbHits":2,"exhaustiveNbHits":false,"processingTimeMs":21,"query":"test-72"}
|
||||
```
|
||||
|
||||
## Search via a UI
|
||||
## 4. Search via a UI
|
||||
|
||||
Making curl requests to search your Slack History is a little clunky, so we have modified the example UI that MeiliSearch provides in [their docs](https://docs.meilisearch.com/learn/tutorials/getting_started.html#integrate-with-your-project) to search through the Slack results.
|
||||
|
||||
@@ -96,7 +94,7 @@ Download \(or copy and paste\) this [html file](https://github.com/airbytehq/air
|
||||
|
||||

|
||||
|
||||
## "Productionizing" Saving Slack History
|
||||
## 5. "Productionizing" Saving Slack History
|
||||
|
||||
You can find instructions for how to host Airbyte on various cloud platforms [here](../deploying-airbyte/).
|
||||
|
||||
|
||||
Reference in New Issue
Block a user