Advanced Source Limiting

Advanced Source Limiting allows you to limit the number of records returned from each individual data source tab within a Selection, and apply deduplication across them. This gives you more precise control over how much data is retrieved from each source, compared to the standard Source Limiting.

This feature is especially useful when working with multiple data sources and you want to include only a specific number of records from each, rather than applying a global limit across all sources.

How it works

When Advanced Source Limiting is enabled, each data source tab in your Selection will show a Limit field. This allows you to set a custom number of records to retrieve from each tab. You can choose to:

Set a different limit for each data source.

Just limit some sources, while leaving others uncapped

Preview the total results and understanding where records are coming from

Once the limits are set and the Selection is executed, DESelect will apply the limits per source and combine the results accordingly, automatically applying deduplication across the different sources, and keeping the priorities you've set.

Enable Advanced Source Limiting

In the Output step, click Tools and select Source Limiting.

Toggle on Enable Source Limiting and Apply Deduplication Between Sources. You'll see a list of all the sources of your Selection, and you'll be able to limit the number of records you want to keep per Source, and determine the deduplication priority

After you run your Selection, you'll be able to see the number of records each source generated, so that you can determine if you need to further limit your sources or not.