Datasource Jobs

A datasource is a configuration that manages the import and indexing of data into the collection.

Datasources are created using the Index Workbench, or at Indexing > Datasources, or using the Connector Datasources API.

A datasource is also a job that can run on demand or on a schedule.

Learn more

Fusion 4 instructions to assign connector jobs to specific nodes

This page applies to Fusion version 4, starting with APIs added in Fusion 4.2.4

Get connector job’s current node assignment

Find assigned node for a connectors data source job.

Method: GET

/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment

Example:

proxyUrl=https://FUSION_HOST:8764
yourDatasourceID=sharepoint563263
curl -X GET -u USERNAME:PASSWORD "${proxyUrl}/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment"

Powershell:

$proxyUrl="https://FUSION_HOST:8764"
$yourDatasourceID="yourdsid"
$username = "admin"
$password = "password"
$base64AuthInfo = [Convert]::ToBase64String([Text.Encoding]::ASCII.GetBytes(("{0}:{1}" -f $username,$password)))

Invoke-RestMethod -Method Get -Headers @{Authorization=("Basic {0}" -f $base64AuthInfo)} "${proxyUrl}/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment"

Assign connector job to a specific node

You can stick a connectors job to a specific connectors-classic node.

Use IP address and not the host name.

Method: PUT

/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment/http%3A%2F%2F${ipOfConnectorsClassicNode}%3A${portOfConnectorsClassic}%2Fconnectors%2Fv1%2Fconnectors-classic

Example:

Bash:

proxyUrl=https://FUSION_HOST:8764
yourDatasourceID=sharepoint563263
ipOfConnectorsClassicNode=192.168.1.78
portOfConnectorsClassic=8984
curl -X PUT -u USERNAME:PASSWORD "${proxyUrl}/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment/http%3A%2F%2F${ipOfConnectorsClassicNode}%3A${portOfConnectorsClassic}%2Fconnectors%2Fv1%2Fconnectors-classic"

Powershell:

$proxyUrl="https://FUSION_HOST:8764"
$yourDatasourceID="yourdsid"
$username = "admin"
$password = "password"
$base64AuthInfo = [Convert]::ToBase64String([Text.Encoding]::ASCII.GetBytes(("{0}:{1}" -f $username,$password)))
$ipOfConnectorsClassicNode="192.168.1.78"
$portOfConnectorsClassic="8984"

Invoke-RestMethod -Method Put -Headers @{Authorization=("Basic {0}" -f $base64AuthInfo)} "${proxyUrl}/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment/http%3A%2F%2F${ipOfConnectorsClassicNode}%3A${portOfConnectorsClassic}%2Fconnectors%2Fv1%2Fconnectors-classic"

Clear connectors job assignment

Clear the job assignment from a connectors data source job.

Method: DELETE

/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment

Bash:

proxyUrl=https://FUSION_HOST:8764
yourDatasourceID=sharepoint563263
curl -X DELETE -u USERNAME:PASSWORD '${proxyUrl}/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment'

Powershell:

$proxyUrl="https://FUSION_HOST:8764"
$yourDatasourceID="yourdsid"
$username = "admin"
$password = "password"
$base64AuthInfo = [Convert]::ToBase64String([Text.Encoding]::ASCII.GetBytes(("{0}:{1}" -f $username,$password)))

Invoke-RestMethod -Method Delete -Headers @{Authorization=("Basic {0}" -f $base64AuthInfo)} "${proxyUrl}/api/apollo/connectors-classic/datasources/${yourDatasourceID}/node_assignment"