How to Evaluate Email Security Services?

Apr 8, 2025 | Blog

Written by Matt Elvin – Technical Services Manager at Gradian

Broadcom recently published a guide in investigating methods, challenges and best practices when evaluating email security services, explaining top tips and what you need to know to test and compare email security solutions with confidence. 

You can find this article here: https://www.security.com/product-insights/email-security 

In a nutshell…

This blog post provides valuable insights into assessing email security solutions to protect from email-borne threats. Authored by Warren Sealey, who has nearly 25 years of experience in the email security industry, the article outlines three primary evaluation methods

Published Tests: These are conducted by organisations that compare multiple vendors and release their findings periodically. However, major vendors often opt out due to resource constraints or disagreements over methodologies, leading to tests featuring mainly emerging or niche companies.

Email Penetration Testing: Third-party vendors perform these tests by sending sample threat emails through the service and reporting on detection rates. A limitation is that many rely on manufactured test articles rather than real-world threats, and they may be reluctant to share samples for independent analysis.

In-House Testing:This approach allows organisations to control the evaluation process, ensuring relevance and realism. Despite being costly and time-consuming, in-house testing is beneficial for selecting the best product and continuously monitoring its effectiveness.

The blog also presents seven critical questions to consider when evaluating email security services testing, such as funding sources, vendors’ ability to adjust configurations, the age and authenticity of test samples, and whether vendors can challenge test results before publication.

An excellent way to start to gain understanding of the complexities involved in evaluating email security solutions, this article will help enable you to make informed decisions to enhance your organisation’s email security posture.

Still don’t know where to start or aren’t sure?  Gradian offers free assessments, so gain some visibility with our free services or simply get in touch with us today and we can help you take the first step!