5 Commits

Author	SHA1	Message	Date
Ho Ngoc Hai	fba536406d	feat(osm): foundation — admin boundaries, POI catalog, sync orchestrator ... This is the Phase 0 + Phase 1 + Phase 4 foundation of the full OSM integration plan. It backfills three things the rest of the platform has been faking with hardcoded tables, and gives admins one dashboard for every OSM-sourced layer. Phase 0 — Vietnam administrative boundaries * New columns on vn_provinces / vn_districts / vn_wards: PostGIS geometry (MultiPolygon), centroid (Point), areaKm2, osmId, population, lastSyncedAt + GIST indexes on geometry/centroid. * `scripts/sync-osm-admin-boundaries.ts` pulls `boundary=administrative + admin_level=4|6|8` from Overpass per chunk, filters to mainland VN via the existing country polygon, resolves the GSO code (or generates `OSM_<id>`), and upserts via raw SQL because Prisma can't manage PostGIS columns. * `GeoLookupService` (shared module) replaces the old `nearestProvince()` heuristic — `lookup(lng,lat)` returns province/district/ward via `ST_Contains` on the GIST-indexed polygons. * The KCN sync now resolves province/district from the polygon table and falls back to the centroid heuristic only when polygons aren't loaded yet. * `scripts/backfill-admin-codes.ts` rewrites province/district/ward on IndustrialPark, ProjectDevelopment and Property using the new lookup. Phase 1 — POI catalog (15 categories, schema only here) * New `Poi` table with `PoiCategory` enum, OSM provenance columns, GIST index on `location`. New `TransportLine` for metro/highway multilinestrings. * `scripts/sync-osm-poi.ts` queries Overpass per category × chunk, resolves province/district codes from the boundary polygons, upserts with `osmLocked` / `lockedFields` honour same as KCN. * New NestJS `PoiModule` exposes: GET /poi/by-bbox — GeoJSON for map overlays GET /poi/nearby — sidebar "tiện ích xung quanh" (HMAC distance ranks) GET /poi/coverage — admin per-category counts * New web component `<NearbyPoiSidebar />` ready to drop into listing / project / KCN detail pages. Phase 4 — Sync orchestrator + admin dashboard * New `OsmSyncRun` audit table tracks every sync invocation (RUNNING / SUCCESS / PARTIAL / FAILED + row stats + error message). * `OsmSyncService` spawns the right tsx script for any (layer, category, chunk) tuple, parses stats out of stdout, updates the run row. * `OsmSyncCronService` schedules: Daily 02:00 → POI category rotation (1/day, 20-day cycle) Mon 02:30 → admin-boundaries provinces Wed 02:30 → admin-boundaries districts Sat 02:30 → admin-boundaries wards 1st of month 03:00 → industrial-parks (per chunk) All gated by `OSM_SYNC_ENABLED=true`. * New admin endpoints under `/admin/osm/*` (layers / coverage / runs / trigger), guarded by JWT + ADMIN role. * New `/admin/osm` Next.js page: stat cards, coverage table with per-row "Sync now", recent runs list with auto-refresh every 15s. Run on dev so far: 33 provinces + 1100+ districts (still finishing) + 305 hospitals POI imported. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-05-01 12:01:19 +07:00
Ho Ngoc Hai	d6ac7c316f	feat(industrial): drop non-VN OSM rows + gate sync with country polygon ... The OSM bbox sync was picking up `landuse=industrial` polygons that sit just across the borders in Laos, Thailand, Cambodia and southern China. After the bulk promote we ended up with 220 of those in the public catalog — Vientiane SEZ, Phnom Penh SEZ, Sihanoukville SEZ, several Thai industrial estates etc. Two-part fix: 1. `scripts/data/vn-country-polygon.ts` — a hand-traced ~30-vertex GeoJSON polygon that follows VN's land + sea border. The eastern edge is generous (110°E) so every coastal industrial zone (Vũng Áng / Formosa, Dung Quất, Nhơn Hội, Vũng Tàu / Long Sơn) sits comfortably inside; the western/northern edges trace the actual neighbour borders. Includes a pure-JS `isPointInVietnam(lng, lat)` ray-cast helper for the sync script (no extra dep). 2. `scripts/prune-non-vietnam-osm.ts` — one-shot cleaner. Uses PostGIS `ST_Within(location, polygon)` to delete every OSM row whose centroid falls outside. Verified the polygon doesn't reject genuine VN parks (Formosa Hà Tĩnh, Dung Quất, Nhơn Hội, KCN Đất Đỏ etc. all pass). 3. `sync-osm-industrial-parks.ts` `parseFeature()` now calls `isPointInVietnam` after computing the centroid and bails early on a miss, so the next monthly cron run won't re-import them. Run on dev: removed 220 rows. Final catalog 1,483 KCN, all inside the Vietnam mainland polygon. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-04-30 00:27:37 +07:00
Ho Ngoc Hai	63a449ad9d	feat(industrial): bulk-promote OSM imports + drop demo seed ... The KCN catalog was running in two parallel modes — 20 hand-curated demo rows (MANUAL) plus 2,193 OSM imports stuck in the review queue. The user asked to drop the demo data and publish all OSM rows in one shot, so the public catalog reflects the full Vietnamese landscape from the start. Steps run against the dev DB: • DELETE 20 MANUAL parks (12 IndustrialListing rows cascaded out) • UPDATE 2,193 OSM rows → dataSource = 'OSM_PROMOTED', isPublic = true • DELETE 490 polygons that bled across the northern border bbox and have only CJK names (no Latin / Vietnamese letter at all). These were Chinese industrial sites — Fangcheng Port, Guangxi Steel, BYD test site etc. — picked up because the Quảng Ninh / Lạng Sơn chunks of the Overpass query include the cross-border buffer. Artefacts: • `scripts/promote-all-osm.ts` — re-runnable bulk action with --dry-run and --keep-manual flags. Idempotent (already-promoted rows skipped). • `scripts/sync-osm-industrial-parks.ts` now drops non-Latin names at `parseFeature()` so the next monthly sync won't re-import them. Catalog ergonomics improvements that followed: • PrismaIndustrialParkRepository.list now `ORDER BY totalAreaHa DESC NULLS LAST` so the largest KCN appear first instead of being buried under 0-ha NODE imports. Bàu Bàng (2,597 ha), Nhơn Trạch (2,535 ha), Phước Đông, Hòa Lạc, etc. now lead the list. • IndustrialParksBboxDto default `limit` raised 1000 → 3000 so a country-zoom request returns the entire promoted set without truncation. The bbox handler already orders by area DESC so the truncated case keeps the meaningful entries. Final catalog: 1,703 promoted KCN, 0 raw OSM, 0 manual. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-04-30 00:19:03 +07:00
Ho Ngoc Hai	c15bdcc6bf	fix(industrial): improve OSM review UX + public map visibility ... Four UX issues surfaced when reviewing the new OSM-sync pipeline against the actual 2,193 imports — fixed in this commit: 1. Admin queue surfaced noise first. `ListOsmPendingHandler` now sorts by `totalAreaHa DESC` (real KCN first, single-factory `landuse=industrial` polygons last) and accepts `minAreaHa` (default 50 ha) plus a `region` filter. The admin page exposes both as dropdowns — "Tất cả / ≥ 5 / ≥ 50 / ≥ 200 / ≥ 500 ha". Top-of-queue is now Bàu Bàng (2,597 ha) and Nhơn Trạch (2,535 ha). 2. Promote dialog said "KCN KCN Đại An" — duplicate prefix. Reworded to "Sắp promote: <name>" so the row name stands on its own. 3. Province was "Chưa xác định" on 2,107 of 2,193 OSM rows. The OSM tags lacked any addr:* hint, so the importer never had anything to write. Added `scripts/data/vn-province-centroids.ts` (63 provinces with capital-city coords) and a `nearestProvince(lat, lng)` fallback in `parseFeature()`. Shipped a one-shot backfill script `scripts/backfill-osm-provinces.ts` and ran it — every existing OSM row now has a province (Hồ Chí Minh: 408, Lạng Sơn: 232, Quảng Ninh: 220, Hà Nội: 172, Hải Phòng: 105, …). Admin can correct on promote if the nearest-centroid heuristic picked the wrong neighbour for a long-thin province. 4. Public map looked empty — only 20 curated parks visible. Added an opt-in toggle "Hiển thị KCN OSM" with a small legend above the map. When on, the bbox endpoint returns OSM raw rows too; markers render in amber (vs. green for curated) at slightly smaller radius and lower opacity, so the visual hierarchy stays clear. Refetch is wired through a ref so the toggle takes effect without remounting the map. Verified in browser preview: zoom-out shows clusters of 320 / 71 / etc. across the country with the toggle on, and just three small clusters (20 curated parks) when off. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-04-30 00:09:24 +07:00
Ho Ngoc Hai	b3143991ce	feat(industrial): OSM bulk import + bbox map + admin review (PR 2-4/4) ... Pulls every `landuse=industrial` feature from OpenStreetMap into the IndustrialPark catalog and surfaces it on the public KCN map. Admins can promote raw OSM rows into the public catalog or lock individual fields to protect them from the monthly reconciliation sync. PR 2 — Bulk import script (scripts/sync-osm-industrial-parks.ts): • Splits Vietnam into 4 chunks (north / northCentral / southCentral / south) to stay under Overpass 504 timeouts. • Posts to overpass-api.de with form-encoded body, converts via osmtogeojson, derives centroid + area via @turf/centroid + @turf/area. • Upsert keyed on osmId. Honours `osmLocked` (skip row entirely) and `lockedFields[]` (skip individual columns) so admin edits survive. • Inserts use $executeRawUnsafe with ST_SetSRID(ST_MakePoint, 4326) because Prisma can't manage the Unsupported geometry NOT NULL column. • CLI flags: --dry-run, --chunk=NAME. PR 3 — Bbox spatial API + Mapbox layer: • GET /industrial/parks/by-bbox returns a GeoJSON FeatureCollection filtered by ST_MakeEnvelope. Sends Point-only at zoom < 12, MultiPolygon outline at zoom >= 12 to keep payloads light. • Public consumers see MANUAL + OSM_PROMOTED only; admins can pass includeOsmRaw=true to also see raw OSM imports. • OsmParkBboxMap component drives Mapbox from viewport moveend with AbortController-debounced fetches, clusters at zoom < 12, expands via getClusterExpansionZoom (callback-style API). • /khu-cong-nghiep page now uses the bbox map in map + split views. PR 4 — Admin review queue + monthly cron: • Commands: PromoteOsmPark (OSM → OSM_PROMOTED + isPublic=true, optional lockFields), LockOsmPark (toggle row-level skip flag). • Query: ListOsmPending lists rows with dataSource='OSM' for review. • OsmSyncCronService runs `0 2 1 * *` Asia/Ho_Chi_Minh and spawns sync-osm-industrial-parks.ts per chunk. Skipped unless OSM_SYNC_ENABLED=true so dev never accidentally hits Overpass. • New admin page /admin/industrial/osm-review: searchable table, promote dialog with quick-pick lock fields (name, developer, description, etc.) plus a free-text fallback, lock/unlock toggle, deep-link to openstreetmap.org for verification. Repository changes: • PrismaIndustrialParkRepository now filters public queries to `isPublic = true AND dataSource IN (MANUAL, OSM_PROMOTED)` so raw OSM rows stay hidden from end users. • Added *.rdb to .gitignore (Redis dump local artefact). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-04-29 19:22:32 +07:00