PureClarity data feeds can be sent from your Magento store in three different ways, each serving different use cases for keeping your data synchronized.

Nightly Feeds (Scheduled)

Default Schedule: 3:00 AM daily
Method: Cron process
Feed Types: Product, Category, and User feeds
By default, complete feeds of all product, category, and user data are sent nightly. This ensures a full data refresh and captures any changes that might have been missed by real-time indexing.
Nightly feeds send complete datasets, providing a comprehensive backup to real-time updates and ensuring data consistency.

Real-Time Updates (Delta Indexing)

Frequency: Every minute
Method: Magento indexers
Feed Types: Product and Category feeds
Status: Enabled by default
The PureClarity plugin includes dedicated indexers that track changes to product and category data. When products or categories are modified in Magento, the changes are recorded and sent to PureClarity within minutes.

How Delta Indexing Works

  1. Change Detection: When you modify a product or category, Magento records the change
  2. Queue Processing: A cron job runs every minute to collect changed items
  3. Data Transmission: Only the updated data is sent to PureClarity
  4. Fast Updates: Changes appear in PureClarity within 1-2 minutes
For optimal performance, ensure your Magento indexers are set to “Update by Schedule” mode. This is configured in System > Index Management in the Magento admin.

Indexer Configuration

Navigate to System > Index Management and verify that PureClarity indexers show the correct status: PureClarity indexers showing in Magento indexers grid
Real-time indexing means that product updates, price changes, and inventory modifications are reflected in PureClarity recommendations almost immediately.

Manual Feed Execution

Sometimes you may need to manually trigger feeds outside of the automatic schedule.

When to Use Manual Feeds

  • Initial setup: Send complete data after installation
  • Bulk changes: After importing large product catalogs
  • Troubleshooting: Resolve data inconsistencies
  • Testing: Verify feed functionality

How to Run Manual Feeds

  1. Navigate to the PureClarity Dashboard page in Magento admin
  2. In the Data Feeds panel, click “Run Feeds Manually”
Feeds box with Run Feeds Manually button
  1. Select the feed types you want to send:
Run feeds popup with tickboxes for each feed type and Run feeds now button
  1. Click “Run feeds now” to queue the selected feeds
Manual feed requests are processed by the same cron job that runs every minute, so feeds will begin processing within 1-2 minutes of submission.

Feed Priority and Processing

Processing Order:
  1. Manual feed requests (highest priority)
  2. Real-time delta updates
  3. Scheduled nightly feeds (lowest priority)
Resource Management:
  • Only one feed type processes at a time to prevent server overload
  • Large feeds are processed in batches
  • Failed feeds are automatically retried
This priority system ensures that urgent manual updates and real-time changes take precedence over routine scheduled feeds.

Monitoring Feed Execution

Track your feed status and execution times on the PureClarity dashboard. For detailed information about feed statuses, see Feed Status Guide. For troubleshooting feed failures, see Feed Troubleshooting.

Best Practices

  • Keep indexers on “Update by Schedule” for optimal real-time performance
  • Use manual feeds sparingly to avoid overwhelming the system
  • Monitor feed status regularly to catch issues early
  • Schedule bulk updates during low-traffic periods when possible