Data Feeds & Indexing Configuration

The Data Feeds & Indexing section controls how and when your store data is synchronized with PureClarity. These settings determine feed schedules, content inclusion, and real-time update behavior.

​

Accessing Configuration

Navigate to Stores > Configuration > PureClarity and expand the “Data Feeds / Indexing” section.

​

Core Feed Settings

​

Product Indexing Enabled

Purpose: Controls real-time product updates (delta indexing)
Options: Yes/No
Default: Yes
Recommended: Yes When enabled, product changes are automatically detected and sent to PureClarity within minutes through Magento’s indexing system. Benefits of enabling:

• Real-time updates - Product changes reflected within 1-2 minutes
• Inventory accuracy - Stock status updates immediately
• Price synchronization - Pricing changes appear in recommendations quickly
• Reduced manual effort - Automatic change detection and transmission

For detailed information about indexing, see When Data Feeds Run.

​

Daily Feed Enabled

Purpose: Controls scheduled full data synchronization
Options: Yes/No
Default: Yes
Recommended: Yes Enables nightly full feed transmission at 3:00 AM, providing complete data refresh and backup to real-time indexing. Why keep enabled:

• Data consistency - Full refresh ensures complete accuracy
• Backup mechanism - Catches any missed real-time updates
• Comprehensive sync - Includes data not covered by indexing
• Error recovery - Resolves any synchronization issues

​

Pricing Configuration

​

Product Feed - Send Customer Group Pricing

Purpose: Include customer group-specific pricing in feeds
Options: Yes/No
Default: No When enabled, customer group pricing rules are included in product feeds, allowing personalized pricing in recommendations. When to enable:

• B2B stores with customer group discounts
• Membership programs with tiered pricing
• Volume pricing based on customer categories
• Regional pricing variations

Impact of enabling:

• Larger feed sizes - Additional pricing data increases transmission time
• Complex processing - More data to manage and update
• Enhanced personalization - Better pricing accuracy for customers
• Improved conversions - Accurate pricing in recommendations

​

Customer-Specific Pricing

For highly customized pricing that goes beyond standard customer groups, you’ll need to use server-side mode. See Customer Specific Prices for implementation details.

​

Brand Feed Configuration

​

Brand Feed Enabled

Purpose: Controls brand data transmission
Options: Yes/No
Default: No Enables brand feed functionality when you’ve configured brand categories. Prerequisites for enabling:

• Brand category structure created
• Brand parent category selected (see below)
• Products assigned to brand categories
• Brand images configured

​

Brand Parent Category

Purpose: Designates which category contains brand subcategories
Options: Category dropdown
Default: Empty Select the parent category that contains your brand structure. All first-level subcategories will be treated as individual brands.

​

Data Filtering Options

​

Excluded Product Attributes

Purpose: Prevent sensitive product attributes from being sent to PureClarity
Options: Multi-select attribute list
Default: Empty Common exclusions:

• Internal codes - SKU prefixes, internal categories
• Supplier information - Vendor details, cost prices
• Administrative data - Internal notes, purchase information
• Sensitive content - Proprietary descriptions, competitive data

Security considerations:

• Data privacy - Exclude personal or sensitive information
• Competitive protection - Prevent exposure of internal data
• Compliance requirements - Meet data protection regulations
• Feed optimization - Reduce unnecessary data transmission

​

Exclude Out of Stock Products From Recommenders

Purpose: Hide unavailable products from recommendations
Options: Yes/No
Default: No When enabled, out-of-stock products are flagged as excluded, preventing them from appearing in recommendations. Considerations for enabling:

• Customer experience - Prevents frustration with unavailable products
• Conversion optimization - Focuses recommendations on purchasable items
• Inventory management - Reduces promotion of unavailable stock

Considerations for disabling:

• Product discovery - Customers can see full catalog
• Back-in-stock notifications - Maintains product visibility
• Seasonal planning - Shows upcoming availability

​

Performance Optimization

​

Feed Scheduling Strategy

Optimal configuration for most stores:

• Product Indexing: Enabled (real-time updates)
• Daily Feed: Enabled (comprehensive backup)
• Customer Group Pricing: As needed for business model
• Brand Feed: Enabled if using brand recommendations

​

Indexer Management

Ensure PureClarity indexers are configured correctly:

1. Navigate to System > Index Management
2. Set PureClarity indexers to “Update by Schedule”
3. Monitor indexer status regularly

​

Monitoring Feed Performance

​

Key Metrics to Track

• Feed completion time - Monitor for performance degradation
• Error rates - Watch for synchronization failures
• Data accuracy - Verify product information matches store
• Recommendation quality - Check for data-related issues

​

Regular Maintenance Tasks

• Review excluded attributes quarterly
• Monitor brand category structure for organization changes
• Validate customer group pricing accuracy
• Check indexer status weekly

​

Troubleshooting Configuration Issues

​

Common Problems

Feeds not running:

• Verify daily feed and indexing are enabled
• Check Magento cron job configuration
• Review indexer settings (Update by Schedule)
• Monitor system logs for errors

Pricing inconsistencies:

• Check customer group pricing configuration
• Verify pricing rules in Magento
• Consider server-side mode for complex pricing
• Test with different customer groups

Brand feed issues:

• Confirm brand parent category is selected
• Verify brand category structure
• Check brand feed enabled setting
• Validate product assignments to brands

Performance problems:

• Review excluded attributes to reduce feed size
• Monitor server resources during feed processing
• Consider disabling customer group pricing if not needed
• Optimize indexer scheduling

​

Related Configuration

​

Integration Points

Data feed settings work with:

• Feed Status Monitoring - Track feed execution
• Types of Data Feeds - Understanding feed content
• Brand Feed Configuration - Brand setup requirements

​

Advanced Features

• Server-Side Mode - Complex pricing scenarios
• Product Attributes - Custom product data
• Customer Specific Prices - Advanced pricing

​

Best Practices Summary

​

Recommended Settings

• Enable product indexing for real-time updates
• Keep daily feeds enabled for data consistency
• Use customer group pricing only when necessary
• Configure brand feeds if using brand recommendations
• Exclude sensitive attributes for security
• Monitor out-of-stock exclusion impact on recommendations

​

Performance Optimization

• Schedule feeds during low traffic periods
• Exclude unnecessary attributes to reduce feed size
• Monitor indexer performance regularly
• Test configuration changes in staging environments

​

Security Considerations

• Review attribute exclusions regularly
• Protect sensitive data from transmission
• Monitor access to configuration settings
• Document configuration decisions for compliance