Delivering a Stamp of Trust for the Media Industry

Robots and Spiders

Bots SpidersBThe IAB (Internet Advertising Bureau) US and ABC UK global list for ad and site traffic-related non-human (robotic) activity, known as the IAB/ABC Spiders & Robots list, helps filter non-human activity that can significantly inflate ad impressions and site traffic counts.

Effective use of the data can lead to a more transparent and accurate measurement for you and your clients. 

Implementation of the List is a requirement in the UK by ABC & JICWEBS 'Web Reporting Standards' and in the US for the IAB's 'Ad Impression Measurement Guidelines' & the MRC's 'Invalid Traffic Detection and Filtration Guidelines'.

What you get access to

  • IAB/ABC Spiders & Robots List
  • Valid browsers List
  • IP Address Exclusion List
  • Monthly updates
  • This email address is being protected from spambots. You need JavaScript enabled to view it.

    From £3,000 + VAT per year

    ABC members who have a web audit with us get access to this service included - contact your account manager to learn more.

The International IAB/ABC Spiders & Robots List

To help exclude known robotic traffic, the International IAB/ABC Spiders & Robots List contains a list of User-Agent strings previously found to have made material levels of robotic activity.

Access Spider & Robots List

The International IAB/ABC list of valid browsers

Media Owners may wish to use a more rigorous robot exclusion process by adopting the dual-pass approach recommended by the IAB. This approach first checks that the User-Agent matches the include list and then excludes it if it matches the exclude list.

Access Valid Browsers List

The ABC IP Address Exclusion List

ABC also publishes a list of IP addresses that have previously been found to make material levels of invalid robotic activty. These IP addresses typically represent activity from external site monitoring tools, and from certain robots which use generic User-Agents.

Access IP Exclusion List

ABC Reports

ABC reports are available to all ABC Members and paid users.

View our latest reports


ABC Breakfast Briefing 

Missed our last Breakfast Briefing?

View the presentations here

Contact Us

ABC - Audit Bureau of Circulations Ltd
Saxon House, 211 High Street, Berkhamsted, Hertfordshire, HP4 1AD

Switchboard: +44 (1442) 870 800
Office hours are 9am - 5.30pm Monday to Friday

Send us a message

Supported by

ppa logoisba newppa logoPPA P ASSOCIATE MEMBER LOGO RGBplus many more...

jic white

The Joint Industry Currencies (JICs) are owned by the industry - advertisers, agencies and media owners – to provide transparent and objective audience measurement for each medium. These data are produced and sold at cost providing both industry accountability and a robust trading currency for each medium.


Setting the standard   ABCpreferredcontrast50