Update project docs and problem notes
This commit is contained in:
@@ -1,7 +1,7 @@
|
||||
# MD Hub Secure - Project Plan
|
||||
|
||||
**Version:** 1.0
|
||||
**Date:** 2026-04-28
|
||||
**Version:** 1.0\
|
||||
**Date:** 2026-04-28\
|
||||
**Status:** Draft
|
||||
|
||||
## Vision
|
||||
@@ -21,15 +21,17 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
## Milestones
|
||||
|
||||
### Milestone 1: Foundation (Weeks 1-2)
|
||||
|
||||
**Goal:** Working server that can serve markdown files as HTML
|
||||
|
||||
- Go HTTP server with chi router
|
||||
- libsql database with schema migration system
|
||||
- Markdown-to-HTML pipeline with all extensions
|
||||
- Markdown-to-HTML pipeline with most common extensions enabled
|
||||
- Static file serving for attachments
|
||||
- Basic Dockerfile and docker-compose.yml
|
||||
|
||||
**Acceptance Criteria:**
|
||||
|
||||
- [ ] Server starts and listens on configurable port
|
||||
- [ ] Database auto-migrates on startup
|
||||
- [ ] Markdown files with wiki-links, tags, callouts, mermaid, math render correctly
|
||||
@@ -41,6 +43,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
---
|
||||
|
||||
### Milestone 2: Sync Protocol (Weeks 3-4)
|
||||
|
||||
**Goal:** Bidirectional file sync between server and filesystem/web client
|
||||
|
||||
- Content-addressed storage (SHA-256 filesystem layout)
|
||||
@@ -50,6 +53,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
- Offline queue with conflict detection
|
||||
|
||||
**Acceptance Criteria:**
|
||||
|
||||
- [ ] File changes on disk automatically sync to server within 5 seconds
|
||||
- [ ] Web client can sync after reconnection, even with changes made offline
|
||||
- [ ] Concurrent edits to different files succeed without conflict
|
||||
@@ -60,6 +64,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
---
|
||||
|
||||
### Milestone 3: Authentication & Authorization (Weeks 5-6)
|
||||
|
||||
**Goal:** Secure access control with passkeys and granular permissions
|
||||
|
||||
- Passkey (WebAuthn) primary authentication
|
||||
@@ -69,6 +74,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
- Content signing with Ed25519 (optional per-user)
|
||||
|
||||
**Acceptance Criteria:**
|
||||
|
||||
- [ ] Users can register and log in with passkeys on modern browsers
|
||||
- [ ] Password fallback works with proper hashing
|
||||
- [ ] Sessions expire securely and are revocable
|
||||
@@ -79,6 +85,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
---
|
||||
|
||||
### Milestone 4: Collaboration Features (Weeks 7-8)
|
||||
|
||||
**Goal:** Comments, notifications, and conflict resolution
|
||||
|
||||
- Comment system linked to file versions (by hash)
|
||||
@@ -88,6 +95,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
- Comment threading and email replies
|
||||
|
||||
**Acceptance Criteria:**
|
||||
|
||||
- [ ] Users can comment on specific lines/sections of a document
|
||||
- [ ] Comments persist and are linked to document versions
|
||||
- [ ] Email notifications sent for watched file changes
|
||||
@@ -98,6 +106,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
---
|
||||
|
||||
### Milestone 5: Search & UI Polish (Weeks 9-10)
|
||||
|
||||
**Goal:** Fast search, design system, and production readiness
|
||||
|
||||
- Full-text search with SQLite FTS5
|
||||
@@ -108,6 +117,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
- Performance benchmarking
|
||||
|
||||
**Acceptance Criteria:**
|
||||
|
||||
- [ ] Search returns results in <50ms on client
|
||||
- [ ] Search works offline after initial sync
|
||||
- [ ] Design system documented at `/design` route
|
||||
@@ -118,6 +128,7 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
---
|
||||
|
||||
### Milestone 6: Production Hardening (Weeks 11-12)
|
||||
|
||||
**Goal:** Deploy with confidence
|
||||
|
||||
- Comprehensive test suite (unit, integration, e2e)
|
||||
@@ -127,7 +138,8 @@ A minimal-dependency, ultra-fast documentation platform that publishes markdown
|
||||
- Documentation for operators
|
||||
|
||||
**Acceptance Criteria:**
|
||||
- [ ] >80% test coverage
|
||||
|
||||
- [ ] 80% test coverage
|
||||
- [ ] No critical or high-severity security findings
|
||||
- [ ] Backup script exports database + attachments as tar.gz
|
||||
- [ ] Health check endpoint returns status of all dependencies
|
||||
@@ -177,44 +189,48 @@ See [architecture-overview.md](architecture-overview.md) for detailed component
|
||||
## Technology Stack
|
||||
|
||||
### Backend (Go 1.22+)
|
||||
| Component | Library | Justification |
|
||||
|-----------|---------|---------------|
|
||||
| HTTP Router | `github.com/go-chi/chi` | Minimal, idiomatic, stdlib-compatible |
|
||||
| Database | `github.com/tursodatabase/libsql-client-go` | Embedded SQLite with replication option |
|
||||
| Migrations | `github.com/golang-migrate/migrate` | Battle-tested, version-controlled schema |
|
||||
| Auth/Passkeys | `github.com/go-webauthn/webauthn` | Reference implementation, well-audited |
|
||||
| Password Hash | `golang.org/x/crypto/argon2` | Winner of Password Hashing Competition |
|
||||
| Markdown | `github.com/yuin/goldmark` + extensions | Fast, extensible, CommonMark compliant |
|
||||
| WebSocket | `github.com/gorilla/websocket` | Most widely used Go WS library |
|
||||
| File Watch | `github.com/fsnotify/fsnotify` | Cross-platform, stdlib-adjacent |
|
||||
| Email | `github.com/keighl/postmark` + `net/smtp` | Postmark adapter + SMTP fallback |
|
||||
| Crypto | `crypto/ed25519`, `crypto/sha256` | Standard library, no external deps |
|
||||
| Templates | `html/template` | Stdlib, auto-escaping, SSR-safe |
|
||||
|
||||
| Component | Library | Justification |
|
||||
| ------------- | ------------------------------------------- | ---------------------------------------- |
|
||||
| HTTP Router | `github.com/go-chi/chi` | Minimal, idiomatic, stdlib-compatible |
|
||||
| Database | `github.com/tursodatabase/libsql-client-go` | Embedded SQLite with replication option |
|
||||
| Migrations | `github.com/golang-migrate/migrate` | Battle-tested, version-controlled schema |
|
||||
| Auth/Passkeys | `github.com/go-webauthn/webauthn` | Reference implementation, well-audited |
|
||||
| Password Hash | `golang.org/x/crypto/argon2` | Winner of Password Hashing Competition |
|
||||
| Markdown | `github.com/yuin/goldmark` + extensions | Fast, extensible, CommonMark compliant |
|
||||
| WebSocket | `github.com/gorilla/websocket` | Most widely used Go WS library |
|
||||
| File Watch | `github.com/fsnotify/fsnotify` | Cross-platform, stdlib-adjacent |
|
||||
| Email | `github.com/keighl/postmark` + `net/smtp` | Postmark adapter + SMTP fallback |
|
||||
| Crypto | `crypto/ed25519`, `crypto/sha256` | Standard library, no external deps |
|
||||
| Templates | `html/template` | Stdlib, auto-escaping, SSR-safe |
|
||||
|
||||
### Frontend (Preact + TypeScript)
|
||||
| Component | Library | Justification |
|
||||
|-----------|---------|---------------|
|
||||
| Framework | `preact` (10KB) | React API, tiny bundle, fast hydration |
|
||||
| Routing | `preact-iso` | Lightweight isomorphic routing |
|
||||
| Markdown | `marked` + `micromark` | Server+client compatible |
|
||||
| Search | `flexsearch` | Client-side full-text, zero server load |
|
||||
| Styling | Native CSS + custom properties | No build-time CSS processing needed |
|
||||
| Icons | Inline SVG | No icon font dependency |
|
||||
| Build | `vite` | Fast HMR, modern output, minimal config |
|
||||
|
||||
| Component | Library | Justification |
|
||||
| --------- | ------------------------------ | --------------------------------------- |
|
||||
| Framework | `preact` (10KB) | React API, tiny bundle, fast hydration |
|
||||
| Routing | `preact-iso` | Lightweight isomorphic routing |
|
||||
| Markdown | `marked` + `micromark` | Server+client compatible |
|
||||
| Search | `flexsearch` | Client-side full-text, zero server load |
|
||||
| Styling | Native CSS + custom properties | No build-time CSS processing needed |
|
||||
| Icons | Inline SVG | No icon font dependency |
|
||||
| Build | `vite` | Fast HMR, modern output, minimal config |
|
||||
|
||||
### Infrastructure
|
||||
| Component | Technology | Justification |
|
||||
|-----------|-----------|---------------|
|
||||
| Container | Docker + Compose | Universal deployment target |
|
||||
| Reverse Proxy | Traefik (optional) | Auto-HTTPS, included in compose |
|
||||
| Database | libsql/SQLite | Single file, zero external dependency |
|
||||
| Storage | Local filesystem | Content-addressed, immutable, backup-friendly |
|
||||
|
||||
| Component | Technology | Justification |
|
||||
| ------------- | ------------------ | --------------------------------------------- |
|
||||
| Container | Docker + Compose | Universal deployment target |
|
||||
| Reverse Proxy | Traefik (optional) | Auto-HTTPS, included in compose |
|
||||
| Database | libsql/SQLite | Single file, zero external dependency |
|
||||
| Storage | Local filesystem | Content-addressed, immutable, backup-friendly |
|
||||
|
||||
---
|
||||
|
||||
## Security Model
|
||||
|
||||
### Threats Addressed
|
||||
|
||||
1. **Supply Chain Attacks**: Minimal external dependencies; all pinned with go.sum; vendored if needed
|
||||
2. **Data Tampering**: All document versions SHA-256 hashed; optional Ed25519 signatures
|
||||
3. **Unauthorized Access**: RBAC with principle of least privilege; content never served without auth check
|
||||
@@ -224,11 +240,13 @@ See [architecture-overview.md](architecture-overview.md) for detailed component
|
||||
7. **DoS**: Rate limiting on auth endpoints; file upload size limits; query timeouts
|
||||
|
||||
### Content Security
|
||||
|
||||
- Attachment uploads: Magic number validation, extension whitelist, size limits
|
||||
- Markdown rendering: Sanitized HTML output; no raw HTML injection
|
||||
- File paths: Canonicalization prevents directory traversal
|
||||
|
||||
### Audit & Compliance
|
||||
|
||||
- Every data modification logged with user, timestamp, IP, and content hash
|
||||
- Immutable history table — updates are inserts
|
||||
- GDPR-compliant: full data export and deletion capability
|
||||
@@ -237,14 +255,14 @@ See [architecture-overview.md](architecture-overview.md) for detailed component
|
||||
|
||||
## Performance Targets
|
||||
|
||||
| Metric | Target | Measurement |
|
||||
|--------|--------|-------------|
|
||||
| Initial Page Load | <100ms | TTFB + First Contentful Paint |
|
||||
| Time to Interactive | <200ms | Hydration complete |
|
||||
| Search Query | <50ms | Client-side after initial sync |
|
||||
| File Sync | <5s | From disk save to server persist |
|
||||
| Bundle Size | <100KB | Gzipped JS + CSS |
|
||||
| Concurrent Users | 1000 readers, 100 editors | Load tested |
|
||||
| Metric | Target | Measurement |
|
||||
| ------------------- | ------------------------- | -------------------------------- |
|
||||
| Initial Page Load | <100ms | TTFB + First Contentful Paint |
|
||||
| Time to Interactive | <200ms | Hydration complete |
|
||||
| Search Query | <50ms | Client-side after initial sync |
|
||||
| File Sync | <5s | From disk save to server persist |
|
||||
| Bundle Size | <100KB | Gzipped JS + CSS |
|
||||
| Concurrent Users | 1000 readers, 100 editors | Load tested |
|
||||
|
||||
---
|
||||
|
||||
@@ -295,14 +313,14 @@ md-hub-secure/
|
||||
|
||||
## Risk Register
|
||||
|
||||
| Risk | Likelihood | Impact | Mitigation |
|
||||
|------|-----------|--------|------------|
|
||||
| WebAuthn/passkey adoption issues | Medium | Medium | Password fallback always available; extensive browser testing |
|
||||
| SQLite performance at scale | Low | High | libsql replication path; FTS5 for search; benchmark early |
|
||||
| Markdown extension parser bugs | Medium | Medium | Fuzz testing; strict CommonMark base; gradual feature rollout |
|
||||
| Email deliverability | Medium | Medium | Postmark reputation monitoring; SPF/DKIM setup; SMTP fallback |
|
||||
| Frontend bundle bloat | Medium | Medium | Bundle analysis in CI; tree-shaking enforced; lazy loading |
|
||||
| File sync conflicts in teams | High | Medium | Clear UX for conflict resolution; email notification; automatic merge when possible |
|
||||
| Risk | Likelihood | Impact | Mitigation |
|
||||
| -------------------------------- | ---------- | ------ | ----------------------------------------------------------------------------------- |
|
||||
| WebAuthn/passkey adoption issues | Medium | Medium | Password fallback always available; extensive browser testing |
|
||||
| SQLite performance at scale | Low | High | libsql replication path; FTS5 for search; benchmark early |
|
||||
| Markdown extension parser bugs | Medium | Medium | Fuzz testing; strict CommonMark base; gradual feature rollout |
|
||||
| Email deliverability | Medium | Medium | Postmark reputation monitoring; SPF/DKIM setup; SMTP fallback |
|
||||
| Frontend bundle bloat | Medium | Medium | Bundle analysis in CI; tree-shaking enforced; lazy loading |
|
||||
| File sync conflicts in teams | High | Medium | Clear UX for conflict resolution; email notification; automatic merge when possible |
|
||||
|
||||
---
|
||||
|
||||
|
||||
Reference in New Issue
Block a user