Ballarat's arts institutions move to fix duplicate image problem as digital audit wraps up this week

Ballarat's two largest public heritage collections have begun deduplicating their digitised image libraries this week after a joint audit found significant overlap between records held by the Ballarat Heritage Services unit and the Art Gallery of Ballarat on Lydiard Street North. The review, which concluded on Friday, identified duplicate entries running into the thousands across both catalogues — many of them high-resolution scans of goldfields-era photographs that were independently digitised by separate teams over the past decade.

The problem is not trivial. Cultural institutions across regional Victoria have been under mounting pressure from Heritage Victoria and Creative Victoria to improve the accessibility and accuracy of their digital collections before the next funding round closes in September 2026. Duplicates distort search results, waste server storage, and — critically — mean that grant-funded digitisation work is sometimes being done twice on the same object, burning public money on labour that has already been completed elsewhere.

What the audit actually found

The review was conducted internally across eight weeks beginning in early May. According to documentation circulated to staff at the Art Gallery of Ballarat and tabled at a recent collections committee meeting, auditors cross-referenced image metadata against Ballarat Heritage Services records and found that roughly one in six digitised items in a sample set appeared in both catalogues. The sample covered approximately 4,800 records drawn from the goldfields and Central Highlands photography collections.

The duplication problem has a clear origin point. Between 2018 and 2023, both institutions received separate digitisation grants — the Gallery through the National Collecting Institutions Touring and Outreach program and the heritage unit through a Victorian Government regional grants stream — and neither had a shared metadata standard in place at the time. The result was parallel scanning projects that frequently targeted the same physically available donor material, particularly photographic prints donated through the Ballarat and District Genealogical Society on Doveton Street North.

Storage costs have become a live concern. Cloud hosting for large TIFF image files runs at commercial rates, and duplicated high-resolution masters add up quickly. An unverified internal estimate cited in committee discussion put unnecessary storage costs in the low tens of thousands of dollars annually across both institutions, though neither organisation has publicly confirmed a precise figure.

What happens from here

The Art Gallery of Ballarat confirmed this week it has begun implementing deduplication protocols using open-source metadata reconciliation tools. The process involves flagging records where file checksums or descriptive metadata overlap, then routing them to a human reviewer before any deletion takes place — a precaution designed to avoid accidentally removing a genuine variant image. The gallery's collections team expects the first clean pass through the backlog to take until October.

Ballarat Heritage Services, which operates under the City of Ballarat council structure from offices in the Ballarat town hall precinct on Sturt Street, is expected to adopt a compatible approach, though a formal resolution from the council's Community and Cultural committee has not yet been publicly scheduled.

For local researchers and family historians who use these catalogues — and there are hundreds of registered users through the Sovereign Hill educational programs alone — the practical upside will eventually be cleaner search results and faster load times on the collections portal. In the short term, some records may temporarily disappear from public-facing search while they are under review. Both institutions have urged users to contact their respective collections staff directly if a record they have previously saved appears to go missing during the audit period.

The longer-term fix depends on both organisations agreeing to a shared metadata standard before any new digitisation grant applications go in this financial year. Creative Victoria's regional collections funding round is expected to open in August 2026, giving Ballarat's institutions roughly six weeks to formalise an agreement if they want to present a coordinated submission rather than competing ones.