2025W50

Earlier work 8–14 Dec 2025

Scrapers, Archive.org, and a test suite

Commits
13
In this project
Week 2 of 3
ISO week
2025-W50

13 commits to Bow & Bridge (.NET, 2025) from Mon 8 Dec to Thu 11 Dec 2025. The .NET app grew its intake side: a crawler that walks a site’s sitemap, an EPUB importer, a page-quality scorer for scraped pages, and an Archive.org integration under one ‘resources’ model. It also got the things a production app needs: health checks, error handling, logging and unit tests for every data service.

  • Built the scraping pipeline: sitemap-driven crawling, normalization and background job processing, plus EPUB import.
  • Added a page-quality analysis system so low-value scraped pages are scored before they clutter the catalogue.
  • Unified books, scraped pages and Archive.org items into one resources model with quality analytics.
  • Logged search terms and added analytics to feed a learning search ranker.
  • Production readiness: error handling, health checks and structured logging, with full unit test coverage for all data services.
  • Modernized navigation with MudBlazor, a theme and a command palette; improved search and display for luthiers and auction houses.

Every week of Earlier work