MTL Archives case studyTechnical implementation

How the collection was prepared for search.

This page documents the technical work behind MTL Archives, from municipal source datasets to search, visual browsing, and editorial interfaces.

The metrics on this page come from dated reports and saved artifacts. They describe specific runs, not a general performance promise.

01/Overview

One public collection, several working layers.

MTL Archives began with open photographic datasets from the City of Montréal. The images were available, but the records, files, and identifiers were not yet a practical basis for research.

The work linked records to files, preserved source references, added derived information in separate fields, and indexed text and images for more than one search mode.

02/Source collection

The starting material was digitized. It was not uniform.

The inspected manifests contain JPG, TIFF, and a small number of PDF files, along with names, descriptions, dates, credits, cotes, and source URLs. Fields are not consistently populated. Some titles look like file codes, and records from different datasets can point to the same image.

Source

City of Montréal photographic and aerial photothèque datasets

Formats

7,945 JPG, 6,875 TIFF, and 2 PDF files in the working manifest

Fields

Name, description, date, credit, cote, source URL, portal match

Real MTL Archives source record capture
Real source record
File identifier

mtl_archives_metadata_0.json

Title

Rue Saint-Antoine

Date

Décennie 1920

Description

En direction Est, à l’angle de la rue Saint-David (aujourd’hui disparue). On y aperçoit l’Édifice de The Gazette Printing Co ainsi que des panneaux-réclames de Magic Baking Powder et JJ Joubert Limitée.

Cote

VM94,SY,SS1,SSS17,D1

Credit

Archives de la Ville de Montréal

Source URL

depot.ville.montreal.qc.ca/phototheque-archives/jpeg/VM94-Z2.jpg

Record extracted from manifest_search_canonical.jsonl. The accents and punctuation are retained here to show source content, not a new description.

03/Reconciliation

Linking records, files, and identifiers.

Ingestion downloads catalogues in batches, normalizes fields, associates records with images, and produces a canonical manifest. Duplicates are not removed without a trace. Source identifiers remain attached to the production result.

  1. 01

    Ingest

    Download catalogues and associated files.

  2. 02

    Normalize

    Standardize fields while retaining original values.

  3. 03

    Associate

    Link records, images, and source URLs.

  4. 04

    Deduplicate

    Keep one production record and document duplicate relationships.

18,462Input records

Total in the January 8, 2026 reconciliation run.

13,499Production records

Unique records after deduplication in that run.

4,963Duplicate records

Difference between input records and unique records in that run.

04/Enrichment

The source record and derived observations are different objects.

SOURCE DATA
  • Original identifier and cote

  • Original title and date

  • Description and credit

  • Institutional source URL

DERIVED DATA
  • OCR where text is present

  • Generated caption with model and status

  • Text and image representations

  • Geographic and taxonomy fields where available

The principle is straightforward: enrich a record without presenting a machine observation as an archival description. Migrations and API responses retain caption provenance, model, and status fields.

05/VLM captioning

A full run, with its failures visible.

The May 2026 VLM report contains 14,822 input rows. 14,706 received a caption. 14,627 outputs met the expected structure. The 79 structurally invalid outputs and 116 image or model errors remain counted separately.

14,706 / 14,822Captioned records

99.2% of the rows in this recorded run.

14,627 / 14,822Structured-valid outputs

98.7%. Structural validity does not establish historical accuracy.

24.47 GPU hoursEstimated run time

Estimate from a recovered A10 run, not a billing measurement.

The report reconstructs the first 12,100 rows from saved chunks, then resumes the remaining 2,722. No complete historical per-record cost is retained in the available artifacts.

06/Search architecture

Indexes connect preparation work to the interface.

Preparation runs outside the public interface. The Worker receives a query, calls the available retrieval branch, hydrates returned identifiers from the database, and returns results with their retrieval source.

  1. 01

    Source records

    identifiers, titles, descriptions, credits

  2. 02

    Normalized corpus

    linked and deduplicated manifests

  3. 03

    Representations

    enriched text and image vectors

  4. 04

    Indexes

    metadata search, semantic retrieval, visual similarity

  5. 05

    Interfaces

    public search, browsing, explorer, editorial tools

Metadata and text

For cotes, titles, and exact fields.

Semantic retrieval

For comparing a text query with indexed text fields.

Visual similarity

For comparing an image with saved CLIP vectors.

07/Tested queries

Testing language that exact fields do not express directly.

These queries returned results from the public semantic search on September 21, 2026. They illustrate retrieval behavior. They are not archival descriptions of the records.

08/Image representations

Search, inspect sources, and build a collection.

The live Explorer supports semantic and visual search; its 2D/3D map displays a separate snapshot of 14,715 points, so some results can remain in the list without appearing on the map. The responsive view uses date colors, a legend, and decade emphasis. Researchers can inspect sources, copy citations, save a collection locally, export CSV or JSON, and inspect 20 snapshot-similarity neighbors. The displayed count is separate from the dated 13,499-record production corpus. The snapshot model and date are unknown, and proximity is not proof of geographic relation or historical subject similarity.

MTL Archives Explorer research workspace in light theme, with a query, a date-colored 2D image map, and a results list on the right

Live Explorer workspace in light theme: a query, date-colored 2D image map with legend, and a results list with source titles and references.

09/Products supported by the data

The pipeline feeds tools people use.

The work does not stop at the index. The same identifiers and files support several interfaces, each with a different purpose.

Search and browsing
Search and browsing

Text queries, results, records, and source links.

Public site
Public site

Browsing, search, a daily game, and print ordering.

Research workspace
Research workspace

Semantic and visual search, a 2D/3D view, source details, local collections, and CSV/JSON export.

10/Governance and provenance

What is preserved, what is added, and what remains uncertain.

Original identifiers, credits, cotes, and source URLs remain attached to records. Generated captions have a source, model, and status. Repair and rollback procedures are documented. MTL Archives enrichment should not be described as curator-approved.

Preserved

Identifiers, titles, dates, descriptions, credits, cotes, and source URLs.

Derived

OCR, captions, image representations, taxonomy, and coordinates where available.

State

Caption status, model information, generation source, and documented revisions.

Provenance workflow

A Provenance implementation can add review, correction, approval, or rejection before reuse.

11/Current measurement limits

What the artifacts do not yet measure.

  • 01

    Historical cost per record or batch, because no retained billing export was found.

  • 02

    Production p50 and p95 latency, because no representative time series was found.

  • 03

    Acceptance, correction, or review-time rates, because no complete review-event dataset exists.

  • 04

    Research time saved, because no controlled study exists.

  • 05

    Historical accuracy of every generated caption, because no exhaustive human validation exists.

  • 06

    Current geolocation coverage, because the available geocoding artifacts are dated.

12/For another collection

The schema can change. The questions remain concrete.

Another institution will have different formats, rights, identifiers, review rules, and search needs. The reusable work is to reconcile the source, preserve its authority, add derived layers, evaluate retrieval, index the results, and connect that data to tools people can use.

[ Discuss a collection]