From tens of thousands to more than 150 million pages, Veridian Software is designed to support digital newspaper collections at any scale—without compromising performance or usability.
In the GLAM sector, scalability is often talked about in the context of very large collections. This is something we work with every day — supporting digital newspaper collections ranging from tens of thousands of pages to several million pages, without compromising performance or usability. In fact, the Veridian Software platform is capable of supporting collections with more than 150 million pages.
Many platforms can handle 50,000 or even 500,000 pages, but far fewer are designed to support collections that grow into the millions, as Veridian does.
But scalability is about more than size alone. In practice, it’s about maintaining a consistent user experience as collections grow and as demand increases.
Designed for ongoing growth
Digitisation projects are often treated as if they have a finish line. In reality, launching a collection is just the beginning.
In our experience, digital newspaper collections rarely stand still. New content is added over time, metadata is refined, and usage patterns continue to evolve. As collections grow and mature, it’s critical that the software supporting them continues to perform reliably — without slowing down or becoming difficult to use.
Why scalability matters to users
Today’s users have been conditioned by modern search engines and digital platforms. Whether a collection contains 50,000 pages or more than 150 million, user expectations are the same — fast search, reliable access, and responsive discovery.
When performance degrades, users don’t interpret this as a consequence of scale — they assume something is wrong. Even small delays can undermine confidence and discourage engagement.
Systems that are not designed to scale effectively often show signs of strain over time, such as:
- Longer wait times after submitting a search.
- Inconsistencies in search result ranking.
- Lags when browsing using filters, such as publication date or newspaper title.
- Errors or timeouts during periods of high concurrent usage.
- User features — such as clipping, tagging, or commenting on articles — becoming slow or unresponsive.
The Veridian Software platform is designed to avoid these issues by scaling efficiently as data volumes increase, ensuring access to all features remains responsive even as collections grow significantly.
The LLMC collection provides online access to more than 100 million pages of legal and government materials. It includes over 180,000 volumes across 40,000 titles, with coverage spanning more than 185 countries and 65 languages.
Software scalability and infrastructure capacity
Veridian’s software is designed to scale efficiently within a given environment, handling large page volumes and search indexes without introducing bottlenecks. However, overall performance during periods of high usage is also influenced by the underlying hosting infrastructure.
An everyday way to think about this is a supermarket self-checkout. Veridian’s software is the checkout system itself — designed to process items quickly and efficiently. The hosting infrastructure is the number of self-checkouts operating. If customer numbers increase but the number of checkouts stays the same, queues form — not because the checkout system is inefficient, but because capacity hasn’t been adjusted.
For this reason, Veridian offers managed hosting built on Amazon Web Services, where infrastructure can be sized and adjusted to meet demand. Some clients choose to use their own hosting infrastructure, and in those cases we work closely with them to ensure it is appropriately provisioned. Without sufficient capacity, performance issues related to high user activity can occur — not because of the software, but because of infrastructure limits.
This approach gives libraries flexibility, while ensuring scalability is addressed holistically across both software and hosting.
Find out how Veridian Software can support your collection
