Collaboratory ingestion report
Date: 2026-06-14
Packet: sources/inbox/2026-06-14-collaboratory-ingestion
Primary source: DePaul Collaboratory
API: https://api.noblehour.com (NobleHour/Collaboratory platform)
Governance: Repository-wide refactor + mandatory Promotion Discovery Rule
1. Executive summary
Ingested the DePaul Collaboratory as a recurring institutional knowledge system (not a single landing page). Via NobleHour API with SSR session token, crawled 715 public activities, 676 unique partner organizations, 275 institutional groups, 18 programs, and 48 keyword search slices. HTML captures of landing and key activity routes supplement API exports.
Outcomes: 2 new external partners promoted (EXT-013 CPS, EXT-014 Lurie Children's); 6 existing resources enriched (CDM-023, UNI-004, EXT-009, EXT-010, CSH-021, RC-007 evidence); 4 new facility/center candidates preserved (RC-027–RC-030); 3+ external partner candidates logged. No duplicate lab/center pages created for entities already in corpus. Collaboratory confirms Steans Center as the dominant engagement hub (209 activity partner references) and surfaces legal clinics, health partners, and community-research pathways invisible on pure “hard-tech” web crawls.
2. Sources captured
| Type | Count | Location |
|---|---|---|
| HTML captures | 9 | source_snapshot/captured/ |
| Full activity summaries | 715 | extracted/activity_summaries.json |
| Partner organization index | 676 | extracted/partner_organizations.json |
| Institutional groups | 275 | extracted/groups_detailed.json |
| Programs | 18 | extracted/programs.json |
| Keyword search slices | 48 × ≤100 hits | extracted/search_results.json |
| Org relationship edges | 1,399 | extracted/org_relationships.json |
| Analysis summary | 1 | extracted/analysis.json |
Access note: Plain HTTP without browser User-Agent returns 403 on several routes; API requires Bearer token from SSR JSON bootstrap on /depaul/activities.
3. Existing entities enriched
| ID | Enrichment |
|---|---|
| CDM-023 | Collaboratory activity D36EYO741 — AGIF funder, Steans client pipeline, campus partners; linked UNI-004 |
| UNI-004 | 209 Collaboratory partner references; designated recurring provenance source |
| EXT-009 | Sinai MPH practicum / CHW data-science activity evidence |
| EXT-010 | Rush Preventive Medicine practicum; AARTS partner network |
| CSH-021 | Collaboratory as recurring provenance for community-research activities |
| RC-007 | Asylum/immigration activity theme corroboration (deferred promotion) |
4. New resources discovered
None beyond §5–§7 below. Most “discoveries” map to existing corpus pages (CyberLabs, CCR, CCHE, etc.) or were preserved as candidates.
5. New facilities discovered
None promoted. RC-027 (Labor Education Center) and RC-030 (ABCD Institute) preserved as center/institute candidates.
6. New laboratories discovered
None. Collaboratory activities reference existing labs (e.g., SAI public-space NSF project) without standalone facility pages sufficient for promotion.
7. New clinics discovered
None promoted. CDM-023 Cybersecurity Clinic corroborated; RC-007 Asylum/Immigration Legal Clinic remains candidate with strengthened Collaboratory evidence (Croak Community Legal Clinic, eviction clinics, orders-of-protection clinics as related activity theme).
8. New equipment discoveries
None. Collaboratory does not publish equipment inventories.
9. New technical capabilities
None promoted. Search hits for “HPC,” “5G,” “IoT,” “makerspace” appear primarily in activity narratives, not as documented capability pages.
10. New external partners
| ID | Organization | Activity partner count | Status |
|---|---|---|---|
| EXT-013 | Chicago Public Schools | 60+ | Promoted |
| EXT-014 | Ann & Robert H. Lurie Children's Hospital | 8+ | Promoted |
| EPC-COL-001 | Archdiocese of Chicago | 13 | Candidate |
| EPC-COL-002 | Erie Neighborhood House | 7 | Candidate |
| EPC-COL-003 | Chicago Coalition for the Homeless | 4 | Candidate |
656 additional external-ish partner organizations indexed in partner_organizations.json for future recurring updates.
11. New grants/publications/outputs
Activity-level funder fields captured where present (e.g., Cybersecurity Clinic AGIF $100,000 in activity detail). No new GRA registry entries — grant titles in Collaboratory are activity-scoped, not ORS-grade extramural records. 183 activities flagged research or scholarly_research in API export for future grant/publication crosswalk.
12. New relationships
| From | To | Type | Evidence |
|---|---|---|---|
| UNI-004 | CDM-023 | community_partner_sourcing | Cybersecurity Clinic activity |
| UNI-004 | EXT-013 | K–12 service-learning | CPS partner frequency |
| EXT-009 | UNI-012 | practicum / CHW research | Sinai activities |
| EXT-010 | UNI-012 | MPH practicum | Rush Preventive Medicine activity |
| CDM-023 | UNI-004 | reciprocal (linked IDs) | Resource page updates |
13. Promotion-review outcomes
| Candidate | Decision | ID / notes |
|---|---|---|
| CPS partner frequency | Promoted | EXT-013 |
| Lurie Children's | Promoted | EXT-014 |
| RC-007 Asylum clinic | Deferred | Law clinic page still needed |
| RC-027 Labor Education | Deferred | RC-027 |
| RC-028 Stockyard Institute | Deferred | RC-028 |
| RC-029 CPIL | Deferred | RC-029 |
| RC-030 ABCD Institute | Deferred | RC-030 |
| Argonne/APS from search | Rejected | False-positive “APS” substring matches |
14. Candidates preserved
RC-027, RC-028, RC-029, RC-030; EPC-COL-001..003; RC-007 (enriched, still candidate). Full ledger: extracted/candidates.yaml, evidence_checklist.md.
15. Reciprocity review
- CDM-023 ↔ UNI-004 reciprocal links added on resource pages.
- EXT-013 ↔ UNI-004, UNI-012 linked on EXT-013 page.
- EXT-014 ↔ UNI-012, EXT-010 linked on EXT-014 page.
- EXT-009 / EXT-010 enrichment notes reference UNI-012 (existing reciprocal structure maintained).
16. Infrastructure pathways discovered
| Pathway | Collaboratory signal | Map connection |
|---|---|---|
| Cybersecurity clinic → nonprofits | CDM-023 activity | CDM-023, CDM-004, UNI-004 |
| CHW + data science → Sinai | SUHI practicum activity | EXT-009, CDM-011, UNI-012 |
| MPH practicum → Rush | Preventive Medicine activity | EXT-010, UNI-012 |
| CPS → FCS / Music / Nursing | 60+ school partnerships | EXT-013, UNI-004 |
| Legal clinics → CPIL / Croak | Eviction, asylum, pro bono activities | RC-007, RC-029 |
| Stockyard / sound art → COE / DPAM | Media-production engagement | RC-028 |
| Labor Education → worker justice CSS | Labor Education Center partner | RC-027 |
Not discovered in Collaboratory: Argonne beamline usage, APS instrumentation, RFUMS lab equipment — existing EXT-003/011/012 evidence remains from prior packets.
17. Remaining gaps
- Individual activity HTML routes return SPA shell (~587 KB); API JSON is authoritative capture.
- Search API capped at 100 results per query — full corpus requires activity pagination (completed) not search alone.
- Org
affiliationsendpoint returned 404; partners extracted from activitycommunity_partners/campus_partnersfields. - 596 external partners lack map pages — prioritize by recurrence on future Collaboratory syncs.
- Law clinic (RC-007), Labor Education (RC-027), Stockyard (RC-028) need official DePaul web captures for promotion.
18. Recommendations for future recurring Collaboratory updates
- Schedule quarterly API export — diff
activity_summaries.jsonandpartner_organizations.jsonagainst prior snapshot. - Monitor partner frequency deltas — auto-flag partners crossing recurrence thresholds (e.g., 10+ new activities) for EXT promotion review.
- Crosswalk
research: trueactivities todata/grants.yamland ORS records. - Steans Center (UNI-004) as index — any new Steans-linked activity may surface unknown infrastructure or partners.
- Preserve browser User-Agent in capture scripts; document token bootstrap from SSR JSON.
- Do not rely on Collaboratory alone for hard-tech promotion — pair with institutional lab/center pages (CDM/CSH web discovery pattern).
N. Promotion review summary (metrics)
| Metric | Count |
|---|---|
| Sources reviewed | 715 activities + 676 partners + 9 HTML + 48 searches |
| Sources imported | 9 HTML + 7 API export files |
| New resources promoted | 2 (EXT-013, EXT-014) |
| Existing resources enriched | 6 |
| Facilities created | 0 |
| Partners created | 2 |
| Relationships added / enriched | 5 |
| Reciprocal links added | 3 pairs |
| Candidates preserved | 7+ |
| Unresolved discoveries | ~596 external partners (indexed, not promoted) |
Validation
./sync_docs.sh— pass (281 resources indexed)pytest— 44 passedmkdocs build --strict— pass
Collaboratory ↔ Resource Map relationship (evaluation)
The Collaboratory is complementary, not redundant, to this Resource Map effort. The map prioritizes operating research infrastructure, equipment, and verified facility pages; the Collaboratory prioritizes community-engaged activity metadata, partner graphs, and translational pathways. Roughly 688 of 715 activities match infrastructure-adjacent keywords, but most describe programs and partnerships rather than instrument inventories.
High value for the map: external partner discovery (CPS, Lurie, Sinai, Rush practicums), Steans Center as engagement hub, clinic course linkages (Cybersecurity Clinic), and legal/health clinic themes for candidate promotion review.
Low value alone for hard-tech promotion: equipment, HPC, makerspaces, Argonne/APS — these require institutional lab pages already captured in CDM/CSH web discovery. Best practice: treat Collaboratory as a recurring partner-and-pathway layer that enriches existing resources and feeds the candidate registry, while hard-tech promotion continues to require facility-grade evidence.