> ## Documentation Index
> Fetch the complete documentation index at: https://docs.pureclarity.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Data Feeds & Indexing Configuration

> Comprehensive guide to configuring data feeds and indexing settings in Magento 2.x for optimal PureClarity performance

The Data Feeds & Indexing section controls how and when your store data is synchronized with PureClarity. These settings determine feed schedules, content inclusion, and real-time update behavior.

## Accessing Configuration

Navigate to **Stores > Configuration > PureClarity** and expand the **"Data Feeds / Indexing"** section.

<img src="https://mintlify.s3.us-west-1.amazonaws.com/pureclarity/images/magento/data-feeds-indexing-settings.webp" alt="Data feeds/indexing settings in PureClarity configuration page in Magento 2 admin" />

## Core Feed Settings

### Product Indexing Enabled

**Purpose:** Controls real-time product updates (delta indexing)\
**Options:** Yes/No\
**Default:** Yes\
**Recommended:** Yes

When enabled, product changes are automatically detected and sent to PureClarity within minutes through Magento's indexing system.

<Note>
  Product indexing enables near real-time synchronization of product changes, ensuring recommendations stay current with inventory and pricing updates.
</Note>

**Benefits of enabling:**

* **Real-time updates** - Product changes reflected within 1-2 minutes
* **Inventory accuracy** - Stock status updates immediately
* **Price synchronization** - Pricing changes appear in recommendations quickly
* **Reduced manual effort** - Automatic change detection and transmission

For detailed information about indexing, see [When Data Feeds Run](/integrations/magento/magento-2/when-feeds-run).

### Daily Feed Enabled

**Purpose:** Controls scheduled full data synchronization\
**Options:** Yes/No\
**Default:** Yes\
**Recommended:** Yes

Enables nightly full feed transmission at 3:00 AM, providing complete data refresh and backup to real-time indexing.

**Why keep enabled:**

* **Data consistency** - Full refresh ensures complete accuracy
* **Backup mechanism** - Catches any missed real-time updates
* **Comprehensive sync** - Includes data not covered by indexing
* **Error recovery** - Resolves any synchronization issues

<Warning>
  Disabling daily feeds may lead to data inconsistencies over time. Only disable if you have specific performance requirements and alternative synchronization methods.
</Warning>

## Pricing Configuration

### Product Feed - Send Customer Group Pricing

**Purpose:** Include customer group-specific pricing in feeds\
**Options:** Yes/No\
**Default:** No

When enabled, customer group pricing rules are included in product feeds, allowing personalized pricing in recommendations.

**When to enable:**

* **B2B stores** with customer group discounts
* **Membership programs** with tiered pricing
* **Volume pricing** based on customer categories
* **Regional pricing** variations

**Impact of enabling:**

* **Larger feed sizes** - Additional pricing data increases transmission time
* **Complex processing** - More data to manage and update
* **Enhanced personalization** - Better pricing accuracy for customers
* **Improved conversions** - Accurate pricing in recommendations

<Info>
  For complex pricing scenarios that can't be handled through customer group pricing, consider using [Server-Side Mode](/integrations/magento/magento-2/configuration-mode) instead.
</Info>

### Customer-Specific Pricing

For highly customized pricing that goes beyond standard customer groups, you'll need to use server-side mode. See [Customer Specific Prices](/integrations/magento/magento-2/customer-specific-prices) for implementation details.

## Brand Feed Configuration

### Brand Feed Enabled

**Purpose:** Controls brand data transmission\
**Options:** Yes/No\
**Default:** No

Enables brand feed functionality when you've configured brand categories.

**Prerequisites for enabling:**

* Brand category structure created
* Brand parent category selected (see below)
* Products assigned to brand categories
* Brand images configured

### Brand Parent Category

**Purpose:** Designates which category contains brand subcategories\
**Options:** Category dropdown\
**Default:** Empty

Select the parent category that contains your brand structure. All first-level subcategories will be treated as individual brands.

<Note>
  The brand parent category must be configured before enabling brand feeds. See [Enabling Brand Feeds](/integrations/magento/magento-2/enabling-brand-feed) for complete setup instructions.
</Note>

## Data Filtering Options

### Excluded Product Attributes

**Purpose:** Prevent sensitive product attributes from being sent to PureClarity\
**Options:** Multi-select attribute list\
**Default:** Empty

**Common exclusions:**

* **Internal codes** - SKU prefixes, internal categories
* **Supplier information** - Vendor details, cost prices
* **Administrative data** - Internal notes, purchase information
* **Sensitive content** - Proprietary descriptions, competitive data

**Security considerations:**

* **Data privacy** - Exclude personal or sensitive information
* **Competitive protection** - Prevent exposure of internal data
* **Compliance requirements** - Meet data protection regulations
* **Feed optimization** - Reduce unnecessary data transmission

<Warning>
  Carefully review excluded attributes to ensure they don't impact recommendation quality. Some attributes may be valuable for personalization algorithms.
</Warning>

### Exclude Out of Stock Products From Recommenders

**Purpose:** Hide unavailable products from recommendations\
**Options:** Yes/No\
**Default:** No

When enabled, out-of-stock products are flagged as excluded, preventing them from appearing in recommendations.

**Considerations for enabling:**

* **Customer experience** - Prevents frustration with unavailable products
* **Conversion optimization** - Focuses recommendations on purchasable items
* **Inventory management** - Reduces promotion of unavailable stock

**Considerations for disabling:**

* **Product discovery** - Customers can see full catalog
* **Back-in-stock notifications** - Maintains product visibility
* **Seasonal planning** - Shows upcoming availability

<Tip>
  Consider your inventory turnover rate and customer expectations when configuring this setting. Fast-moving inventory may benefit from exclusion, while seasonal items might stay visible.
</Tip>

## Performance Optimization

### Feed Scheduling Strategy

**Optimal configuration for most stores:**

* **Product Indexing:** Enabled (real-time updates)
* **Daily Feed:** Enabled (comprehensive backup)
* **Customer Group Pricing:** As needed for business model
* **Brand Feed:** Enabled if using brand recommendations

### Indexer Management

Ensure PureClarity indexers are configured correctly:

1. Navigate to **System > Index Management**
2. Set PureClarity indexers to **"Update by Schedule"**
3. Monitor indexer status regularly

<img src="https://mintlify.s3.us-west-1.amazonaws.com/pureclarity/images/magento/pureclarity-indexers-schedule.webp" alt="PureClarity indexers set to Update by Schedule in Magento indexer management" />

## Monitoring Feed Performance

### Key Metrics to Track

* **Feed completion time** - Monitor for performance degradation
* **Error rates** - Watch for synchronization failures
* **Data accuracy** - Verify product information matches store
* **Recommendation quality** - Check for data-related issues

### Regular Maintenance Tasks

* **Review excluded attributes** quarterly
* **Monitor brand category structure** for organization changes
* **Validate customer group pricing** accuracy
* **Check indexer status** weekly

## Troubleshooting Configuration Issues

### Common Problems

**Feeds not running:**

* Verify daily feed and indexing are enabled
* Check Magento cron job configuration
* Review indexer settings (Update by Schedule)
* Monitor system logs for errors

**Pricing inconsistencies:**

* Check customer group pricing configuration
* Verify pricing rules in Magento
* Consider server-side mode for complex pricing
* Test with different customer groups

**Brand feed issues:**

* Confirm brand parent category is selected
* Verify brand category structure
* Check brand feed enabled setting
* Validate product assignments to brands

**Performance problems:**

* Review excluded attributes to reduce feed size
* Monitor server resources during feed processing
* Consider disabling customer group pricing if not needed
* Optimize indexer scheduling

## Related Configuration

### Integration Points

Data feed settings work with:

* [Feed Status Monitoring](/integrations/magento/magento-2/feed-status) - Track feed execution
* [Types of Data Feeds](/integrations/magento/magento-2/types-of-feed) - Understanding feed content
* [Brand Feed Configuration](/integrations/magento/magento-2/enabling-brand-feed) - Brand setup requirements

### Advanced Features

* [Server-Side Mode](/integrations/magento/magento-2/serverside) - Complex pricing scenarios
* [Product Attributes](/integrations/magento/magento-2/product-attributes) - Custom product data
* [Customer Specific Prices](/integrations/magento/magento-2/customer-specific-prices) - Advanced pricing

## Best Practices Summary

### Recommended Settings

* **Enable product indexing** for real-time updates
* **Keep daily feeds enabled** for data consistency
* **Use customer group pricing** only when necessary
* **Configure brand feeds** if using brand recommendations
* **Exclude sensitive attributes** for security
* **Monitor out-of-stock exclusion** impact on recommendations

### Performance Optimization

* **Schedule feeds during low traffic** periods
* **Exclude unnecessary attributes** to reduce feed size
* **Monitor indexer performance** regularly
* **Test configuration changes** in staging environments

### Security Considerations

* **Review attribute exclusions** regularly
* **Protect sensitive data** from transmission
* **Monitor access** to configuration settings
* **Document configuration decisions** for compliance