> ## Documentation Index
> Fetch the complete documentation index at: https://doc.lucidworks.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Datasources

export const LwTemplate = ({title = "Key questions to get you started", icon = "sparkles", cta = "Powered by Agent Studio", linkHref = "https://lucidworks.com/demo/?utm_source=docs&utm_medium=referral&utm_campaign=docs_cta_ai"}) => {
  const [isLoaded, setIsLoaded] = useState(false);
  useEffect(() => {
    const timer = setTimeout(() => {
      setIsLoaded(true);
    }, 500);
    return () => clearTimeout(timer);
  }, []);
  return <div className="lw-template-container">
      <Card title={title} icon={icon}>
        {isLoaded && <span dangerouslySetInnerHTML={{
    __html: `<lw-template id="a029c1a9-28be-427e-b0e1-5d918920246a"></lw-template
            >`
  }} />}
        <Link href={linkHref} className="agent-studio-link text-left text-gray-600 gap-2 dark:text-gray-400 text-sm font-medium flex flex-row items-center hover:text-primary dark:hover:text-primary-light group-hover:text-primary group-hover:dark:text-primary-light">Powered by Lucidworks Agent Studio</Link>
      </Card>
    </div>;
};

[localhost link]: http://localhost:3000/docs/fusion-connectors/concepts/datasources

[mintlify link]: https://doc.lucidworks.com/docs/fusion-connectors/concepts/datasources

[old doc.lw link]: https://doc.lucidworks.com/fusion-connectors/31

A datasource is a complete data ingest configuration that consists of the following components:

* **Connector.** Connectors are out-of-the-box components for pulling your data into Fusion. Lucidworks provides a wide variety of connectors, each specialized for a particular data type. For a list of connectors, see [Fusion Connectors](/docs/fusion-connectors/overview).
* **Parser.** Parsers provide fine-grained configuration for inbound data.

  * For Fusion 5.x, see [Parsers](/docs/5/fusion/reference/config-ref/parser-stages/overview) for more information.
  * For Fusion 4.x, see [Parsers](/docs/4/fusion-server/reference/parser-stages/overview) for more information.
* **Index pipeline.** Index pipelines transform incoming data for indexing by Fusion.

  * For Fusion 5.x, see [Index Pipelines](/docs/5/fusion/getting-data-in/indexing/index-pipelines/overview) for more information.
  * For Fusion 4.x, see [Index Pipelines](/docs/4/fusion-server/concepts/indexing/datasources/index-pipelines) for more information.

Fusion includes all available connectors in **Indexing > Datasources**. Some connectors come pre-installed, but you must install others manually. See the following resources for your version of Fusion:

<AccordionGroup>
  <a name="install-or-update-a-connector-52-and-later" />

  <Accordion title="Install or update a connector - Fusion 5">
    When you create a new datasource that requires an uninstalled connector, Fusion 5 automatically downloads and installs the connector using the [Datasources dropdown](#install-a-connector-using-the-datasources-dropdown). You can also update the connector using the [Blob Store UI](#install-or-update-a-connector-using-the-blob-store-ui) or via the [Connector API](#install-or-update-a-connector-using-the-connector-api).

    <LwTemplate />

    ## Install a connector using the Datasources dropdown

    1. In your Fusion app, navigate to **Indexing** > **Datasources**.
    2. Click **Add**.
    3. In the list of connectors, scroll down to the connectors marked **Not Installed** and select the one you want to install.\
       Fusion automatically downloads it and moves it to the list of installed connectors.

    After you install a connector, you can Configure a New Datasource.

    <Tip>You can view and download all current and previous V2 connector releases at [Download Connectors](/docs/fusion-connectors/downloads/v2-connectors-downloads).</Tip>

    ## Install or update a connector using the Blob Store UI

    1. Download the connector zip file from [Download V2 connectors](/docs/fusion-connectors/downloads/v2-connectors-downloads).
       <Note>   Do not expand the archive; Fusion consumes it as-is.</Note>
    2. In your Fusion app, navigate to **System** > **Blobs**.
    3. Click **Add**.
    4. Select **Connector Plugin**.
           <img src="https://mintcdn.com/lucidworks/5yWZ-KtZuBe4Y_Fg/assets/images/4.0/blobs-add-connector.png?fit=max&auto=format&n=5yWZ-KtZuBe4Y_Fg&q=85&s=c021b250a83011d5f0af0dacd2d9a2fb" alt="Add a connector" width="2448" height="1042" data-path="assets/images/4.0/blobs-add-connector.png" />
       The "New Connector Plugin Upload" panel appears.
    5. Click **Choose File** and select the downloaded zip file from your file system.
           <img src="https://mintcdn.com/lucidworks/5yWZ-KtZuBe4Y_Fg/assets/images/4.0/blobs-connector-upload.png?fit=max&auto=format&n=5yWZ-KtZuBe4Y_Fg&q=85&s=8088bf62ac29e56ec5d67192a9a5b474" alt="Upload a connector" width="2454" height="1029" data-path="assets/images/4.0/blobs-connector-upload.png" />
    6. Click **Upload**.
       The new connector’s blob manifest appears.
           <img src="https://mintcdn.com/lucidworks/5yWZ-KtZuBe4Y_Fg/assets/images/4.0/blobs-edit.png?fit=max&auto=format&n=5yWZ-KtZuBe4Y_Fg&q=85&s=3e9922a16d5c702f2efa9cb8be63cb0e" alt="Uploaded connector" width="2454" height="1030" data-path="assets/images/4.0/blobs-edit.png" />
       From this screen you can also delete or replace the connector.

    <Warning>
      Wait several minutes for the connector to finish uploading to the blob store before installing the connector using the [Datasources dropdown](#install-a-connector-using-the-datasources-dropdown).
    </Warning>

    ## Install or update a connector using the Connector API

    1. Download the connector zip file from [Download V2 connectors](/docs/fusion-connectors/downloads/v2-connectors-downloads).

       <Note>   Do not expand the archive; Fusion consumes it as-is.</Note>
    2. Upload the connector zip file to Fusion’s plugins.
       Specify a `pluginId` as in this example:
       ```
       curl -H 'content-type:application/zip' -u USERNAME:PASSWORD -X PUT 'https://FUSION_HOST:FUSION_PORT/api/connectors/plugins?id=lucidworks.{pluginId}' --data-binary @{plugin_path}.zip
       ```
       Fusion automatically publishes the event to the cluster, and the listeners perform the connector installation process on each node.
           <Tip>
             If the `pluginId` is identical to an existing one, the old connector will be uninstalled and the new connector will be installed in its place. To get the list of existing plugin IDs, run: `curl -u USERNAME:PASSWORD https://FUSION_HOST:FUSION_PORT/api/connectors/plugins`
           </Tip>
    3. Look in `https://FUSION_HOST:FUSION_PORT/apps/connectors/plugins/` to verify the new connector is installed.

    ## Reinstall a connector

    To reinstall a connector for any reason, first delete the connector then use the preceding steps to install it again. This may take a few minutes to complete depending on how quickly the pods are deleted and recreated.
  </Accordion>

  <Accordion title="Install a Connector - Fusion 4.2">
    In Fusion 4.2, connectors are installed by uploading them to the blob store. You can use any of these methods to install a connector:

    * By installing connectors [as "bootstrap plugins"](#install-a-connector-as-a-bootstrap-plugin), that is, by putting them in the `bootstrap-plugins` directory during initial installation or an upgrade
    * By using the [Blob Store UI](#install-or-update-a-connector-using-the-blob-store-ui) after installation or an upgrade
    * By using the [Blob Store API](#install-or-update-a-connector-using-the-blob-store-api) after installation or an upgrade.

    <Note>During upgrades, the migrator handles some aspects of installing connectors. Depending on the target version and the presence or absence of an Internet connection, there might be manual steps. Installing connectors during upgrades is explained where needed in the upgrade procedures.</Note>

    After you install a connector, you can Configure A New Datasource.

    <Tip>You can view and download all current and previous V2 connector releases at [plugins.lucidworks.com](https://plugins.lucidworks.com/).</Tip>

    ## Install a connector as a bootstrap plugin

    Fusion can install connectors as "bootstrap plugins." All this means is that you put the connector `zip` files in a specific directory named `bootstrap-plugins`, and Fusion installs the connectors the first time it starts during initial installation or an upgrade.

    1. Download the connector zip file from [Fusion 4.x Connector Downloads](/docs/fusion-connectors/downloads/fusion-4-x-connector-downloads).\
       Do not expand the archive; Fusion consumes it as-is. Also, do not start Fusion until instructed to do so by the installation or upgrade instructions.
    2. Under the version-numbered Fusion directory, place the connector in the directory `apps/connectors/bootstrap-plugins/` (on Unix) or `\apps\connectors\bootstrap-plugins\` (on Windows).
    3. Start Fusion when instructed to do so in the installation or upgrade procedure.

    ## Install or update a connector using the Blob Store UI

    1. Download the connector zip file from [Fusion 4.x Connector Downloads](/docs/fusion-connectors/downloads/fusion-4-x-connector-downloads).

       <Note>   Do not expand the archive; Fusion consumes it as-is.</Note>
    2. In the Fusion workspace, navigate to **System** > **Blobs**.
    3. Click **Add**.
    4. Select **Connector Plugin**.

           <img src="https://mintcdn.com/lucidworks/5yWZ-KtZuBe4Y_Fg/assets/images/4.0/blobs-add-connector.png?fit=max&auto=format&n=5yWZ-KtZuBe4Y_Fg&q=85&s=c021b250a83011d5f0af0dacd2d9a2fb" alt="Add a connector" width="2448" height="1042" data-path="assets/images/4.0/blobs-add-connector.png" />

       The "New Connector Plugin Upload" panel appears.
    5. Click **Choose File** and select the downloaded zip file from your file system.

           <img src="https://mintcdn.com/lucidworks/5yWZ-KtZuBe4Y_Fg/assets/images/4.0/blobs-connector-upload.png?fit=max&auto=format&n=5yWZ-KtZuBe4Y_Fg&q=85&s=8088bf62ac29e56ec5d67192a9a5b474" alt="Upload a connector" width="2454" height="1029" data-path="assets/images/4.0/blobs-connector-upload.png" />
    6. Click **Upload**.\
       The new connector’s blob manifest appears.

           <img src="https://mintcdn.com/lucidworks/5yWZ-KtZuBe4Y_Fg/assets/images/4.0/blobs-edit.png?fit=max&auto=format&n=5yWZ-KtZuBe4Y_Fg&q=85&s=3e9922a16d5c702f2efa9cb8be63cb0e" alt="Uploaded connector" width="2454" height="1030" data-path="assets/images/4.0/blobs-edit.png" />

       From this screen you can also delete or replace the connector.

    ## Install or update a connector using the Blob Store API

    1. Download the connector zip file from [Fusion 4.x Connector Downloads](/docs/fusion-connectors/downloads/fusion-4-x-connector-downloads).

       <Note>   Do not expand the archive; Fusion consumes it as-is.</Note>
    2. Upload the connector zip file to Fusion’s blob store.\
       Specify an arbitrary blob ID, and a `resourceType` value of `plugin:connector`, as in this example:

       ```
       curl -H 'content-type:application/zip' -X PUT 'localhost:8764/api/blobs/myplugin?resourceType=plugin:connector' --data-binary @myplugin.zip
       ```

       Fusion automatically publishes the event to the cluster, and the listeners perform the connector installation process on each node.

       <Tip>   If the blob ID is identical to an existing one, the old connector will be uninstalled and the new connector will installed in its place. To get the list of existing blob IDs, run: `curl -u USERNAME:PASSWORD localhost:8764/api/blobs`</Tip>
    3. Look in `https://FUSION_HOST:FUSION_PORT/apps/connectors/plugins/` to verify the new connector is installed.

    ## Reinstall a connector

    To reinstall a connector for any reason, first delete the connector then use the preceding steps to install it again. This may take a few minutes to complete depending on how quickly the pods are deleted and recreated.
  </Accordion>

  <a name="configure-a-new-datasource" />

  <Accordion title="Configure a New Datasource">
    1. In your Fusion app, navigate to **Indexing** > **Datasources**.
    2. Click **Add**.
    3. Select your connector.

       The connector configuration panel appears.  The specific configuration options vary depending on the connector.

    If you do not see your connector in the list, you may need to install it.

    1. Configure your connector’s options:
       1. Enter a useful name for your datasource in the **Datasource ID** field.
       2. You can leave the **Pipeline ID** and **Parser** fields as-is to start with the defaults, or select different ones if you have them.
       3. Configure the connector-specific options.

          Select your specific release and connector detail from the [configuration reference topic](/docs/fusion-connectors/connectors/overview).
    2. Click **Save**.
    3. Test your datasource configuration:
       1. Navigate to the [Index Workbench](/docs/5/fusion/intro/ui-tour/index-workbench) at **Indexing** > **Index Workbench**.
       2. Click **Load...**.
       3. Select the datasource ID you specified when you created the datasource.\
          Now you can see your datasource configuration and a simulation of the results you can expect when you run this datasource job to index your data.
       4. Adjust the configurations of your datasource, parsers, and index pipeline until the simulated results are satisfactory.
       5. Click **Save**.
    4. Index your data:
       1. In the Index Workbench, click **Start Job**.
       2. When the job status is **Finished**, navigate to the [Query Workbench](/docs/5/fusion/getting-data-out/query-basics/query-workbench) at **Querying** > **Query Workbench** to view the indexed documents and configure your query pipeline.
  </Accordion>
</AccordionGroup>

<img src="https://mintcdn.com/lucidworks/pcVooZE8fTjtTbXE/assets/images/common/ingest.png?fit=max&auto=format&n=pcVooZE8fTjtTbXE&q=85&s=12d631b58e25854b83391d3fd5df0d42" alt="Datasources" width="2718" height="1288" data-path="assets/images/common/ingest.png" />