Understanding the different scheduling options for data feeds in Magento 2.x - nightly, real-time indexing, and manual execution
PureClarity data feeds can be sent from your Magento store in three different ways, each serving different use cases for keeping your data synchronized.
Default Schedule: 3:00 AM daily Method: Cron process Feed Types: Product, Category, and User feedsBy default, complete feeds of all product, category, and user data are sent nightly. This ensures a full data refresh and captures any changes that might have been missed by real-time indexing.
Nightly feeds send complete datasets, providing a comprehensive backup to real-time updates and ensuring data consistency.
Frequency: Every minute Method: Magento indexers Feed Types: Product and Category feeds Status: Enabled by defaultThe PureClarity plugin includes dedicated indexers that track changes to product and category data. When products or categories are modified in Magento, the changes are recorded and sent to PureClarity within minutes.
Change Detection: When you modify a product or category, Magento records the change
Queue Processing: A cron job runs every minute to collect changed items
Data Transmission: Only the updated data is sent to PureClarity
Fast Updates: Changes appear in PureClarity within 1-2 minutes
For optimal performance, ensure your Magento indexers are set to “Update by Schedule” mode. This is configured in System > Index Management in the Magento admin.
Navigate to System > Index Management and verify that PureClarity indexers show the correct status:
Real-time indexing means that product updates, price changes, and inventory modifications are reflected in PureClarity recommendations almost immediately.
Track your feed status and execution times on the PureClarity dashboard. For detailed information about feed statuses, see Feed Status Guide.For troubleshooting feed failures, see Feed Troubleshooting.