How Ballarat's Digital Archives Ended Up Full of Duplicates — and What's Being Done About It

Ballarat's cultural institutions are mid-way through a significant housekeeping exercise: systematically identifying and replacing thousands of duplicate digital images that have accumulated across shared repositories over more than a decade. The work, driven largely by the convergence of collections management software upgrades at Sovereign Hill and the Art Gallery of Ballarat, has brought into sharp focus just how chaotic early digitisation efforts were across the region's heritage sector.

The problem did not emerge overnight. It is the direct product of decisions made between roughly 2008 and 2019, when councils, galleries, libraries and tourism bodies each ran their own scanning programs with little coordination. Files were named inconsistently, uploaded to separate servers, then progressively migrated into shared platforms without deduplication checks. The result: the same photograph of Sturt Street in flood, or the same lithograph of an 1850s mining operation on the Eureka goldfields, might exist in four or five slightly different file formats across as many databases.

A Problem Hiding in Plain Sight

The City of Ballarat's local history collection, held primarily at the Ballarat Library on Davison Street, is one of several repositories caught up in this. The library's digitised collection has grown substantially since 2010, and successive rounds of equipment upgrades — higher-resolution scanners, better camera rigs for three-dimensional objects — meant earlier low-resolution scans were often re-done without the originals being retired from the system. Multiply that across the Ballarat Clarendon College archives, the Eureka Centre's reference imagery and Sovereign Hill's education resource library, and the duplication compounds quickly.

Sovereign Hill, which draws on a substantial bank of historical photographs and illustrations for its school programs and visitor materials, began a formal audit of its digital image holdings in late 2024 as part of a broader collections management review. That audit identified a material proportion of its catalogued images as duplicates or near-duplicates — some stored at different resolutions, others re-uploaded under different metadata tags after staff changeovers. The organisation has not publicly released precise figures from the audit.

The Art Gallery of Ballarat on Lydiard Street North, which manages one of the largest regional public art collections in Victoria, has been running its own parallel review. The gallery's collections are governed under the Public Record Office Victoria framework, which sets specific standards for file naming, metadata and retention — standards that the earlier generation of ad-hoc digitisation simply did not meet. Bringing legacy files into compliance has required manual checking of records that automated deduplication tools flag as ambiguous.

Why It Matters Beyond Tidying Up

The practical stakes are higher than storage costs alone. Duplicate images with conflicting metadata — different dates, different attribution notes, different rights flags — create real problems for researchers, educators and journalists who draw on these collections. A school group booking a program at Sovereign Hill in August 2025, for example, might have been shown two versions of the same historical illustration with subtly different captions, because the content management system had not resolved which version was authoritative.

State government investment in regional digitisation through Creative Victoria and the Public Record Office has increased in recent years, with funding rounds in both 2023 and 2025 targeting exactly this kind of remediation work at institutions outside Melbourne. Ballarat institutions were among those that applied for support under those programs, though the specific allocations to individual organisations have not been confirmed publicly.

The deduplication work also intersects with the broader capital funding pressures facing Ballarat Health Services and local government, since shared digital infrastructure — servers, cloud storage, licensing for collections management platforms — is a cost that institutions increasingly want to pool rather than duplicate. A joint digitisation steering group involving the City of Ballarat, Sovereign Hill and the Art Gallery of Ballarat has been meeting periodically to coordinate the clean-up, though the group has not published a formal completion timeline.

For community members who contribute historical photographs to local archives — a longstanding and active practice in Ballarat — the most immediate practical advice is to check with the receiving institution which file format and resolution is preferred before submitting, and to retain originals. The Ballarat Library's local history team can be contacted directly through the Davison Street branch to confirm current submission guidelines.