> ## Documentation Index
> Fetch the complete documentation index at: https://docs.pureclarity.com/llms.txt
> Use this file to discover all available pages before exploring further.

# When Data Feeds Run

> Understanding the different scheduling options for data feeds in Magento 2.x - nightly, real-time indexing, and manual execution

PureClarity data feeds can be sent from your Magento store in three different ways, each serving different use cases for keeping your data synchronized.

## Nightly Feeds (Scheduled)

**Default Schedule:** 3:00 AM daily\
**Method:** Cron process\
**Feed Types:** Product, Category, and User feeds

By default, complete feeds of all product, category, and user data are sent nightly. This ensures a full data refresh and captures any changes that might have been missed by real-time indexing.

<Note>
  Nightly feeds send complete datasets, providing a comprehensive backup to real-time updates and ensuring data consistency.
</Note>

## Real-Time Updates (Delta Indexing)

**Frequency:** Every minute\
**Method:** Magento indexers\
**Feed Types:** Product and Category feeds\
**Status:** Enabled by default

The PureClarity plugin includes dedicated indexers that track changes to product and category data. When products or categories are modified in Magento, the changes are recorded and sent to PureClarity within minutes.

### How Delta Indexing Works

1. **Change Detection:** When you modify a product or category, Magento records the change
2. **Queue Processing:** A cron job runs every minute to collect changed items
3. **Data Transmission:** Only the updated data is sent to PureClarity
4. **Fast Updates:** Changes appear in PureClarity within 1-2 minutes

<Warning>
  For optimal performance, ensure your Magento indexers are set to **"Update by Schedule"** mode. This is configured in **System > Index Management** in the Magento admin.
</Warning>

### Indexer Configuration

Navigate to **System > Index Management** and verify that PureClarity indexers show the correct status:

<img src="https://mintlify.s3.us-west-1.amazonaws.com/pureclarity/images/magento/pureclarity-indexers.webp" alt="PureClarity indexers showing in Magento indexers grid" />

<Tip>
  Real-time indexing means that product updates, price changes, and inventory modifications are reflected in PureClarity recommendations almost immediately.
</Tip>

## Manual Feed Execution

Sometimes you may need to manually trigger feeds outside of the automatic schedule.

### When to Use Manual Feeds

* **Initial setup:** Send complete data after installation
* **Bulk changes:** After importing large product catalogs
* **Troubleshooting:** Resolve data inconsistencies
* **Testing:** Verify feed functionality

### How to Run Manual Feeds

1. Navigate to the **PureClarity Dashboard** page in Magento admin
2. In the **Data Feeds** panel, click **"Run Feeds Manually"**

<img src="https://mintlify.s3.us-west-1.amazonaws.com/pureclarity/images/magento/run-feeds-manually-button.webp" alt="Feeds box with Run Feeds Manually button" />

3. Select the feed types you want to send:

<img src="https://mintlify.s3.us-west-1.amazonaws.com/pureclarity/images/magento/manual-feed-selection.webp" alt="Run feeds popup with tickboxes for each feed type and Run feeds now button" />

4. Click **"Run feeds now"** to queue the selected feeds

<Info>
  Manual feed requests are processed by the same cron job that runs every minute, so feeds will begin processing within 1-2 minutes of submission.
</Info>

## Feed Priority and Processing

**Processing Order:**

1. Manual feed requests (highest priority)
2. Real-time delta updates
3. Scheduled nightly feeds (lowest priority)

**Resource Management:**

* Only one feed type processes at a time to prevent server overload
* Large feeds are processed in batches
* Failed feeds are automatically retried

<Note>
  This priority system ensures that urgent manual updates and real-time changes take precedence over routine scheduled feeds.
</Note>

## Monitoring Feed Execution

Track your feed status and execution times on the PureClarity dashboard. For detailed information about feed statuses, see [Feed Status Guide](/integrations/magento/magento-2/feed-status).

For troubleshooting feed failures, see [Feed Troubleshooting](/integrations/magento/magento-2/feeds-failing-errors).

## Best Practices

* **Keep indexers on "Update by Schedule"** for optimal real-time performance
* **Use manual feeds sparingly** to avoid overwhelming the system
* **Monitor feed status regularly** to catch issues early
* **Schedule bulk updates during low-traffic periods** when possible