160 lines
3.8 KiB
Markdown
160 lines
3.8 KiB
Markdown
# Memory Log: Cloud Backup System
|
|
Date: 2026-01-19
|
|
|
|
---
|
|
|
|
## What Was Done
|
|
|
|
Created a **comprehensive cloud backup system** to protect all work from computer reset.
|
|
|
|
---
|
|
|
|
## Tools Installed
|
|
|
|
1. **rclone** - Universal cloud storage tool
|
|
- Installed via Homebrew
|
|
- Supports: Google Drive, Dropbox, DigitalOcean Spaces, AWS S3, OneDrive
|
|
- Command: `rclone config` to set up
|
|
|
|
---
|
|
|
|
## Scripts Created
|
|
|
|
| Script | Purpose | Uses |
|
|
|---------|----------|-------|
|
|
| `backup_to_cloud.sh` | Upload all data to cloud storage | rclone |
|
|
| `restore_from_cloud.sh` | Download from cloud storage | rclone |
|
|
| `backup_to_github.sh` | Backup code to GitHub | git |
|
|
|
|
---
|
|
|
|
## Documentation Created
|
|
|
|
| File | Purpose |
|
|
|------|---------|
|
|
| `CLOUD-BACKUP-SETUP.md` | How to set up cloud storage |
|
|
| `CLOUD-BACKUP-SYSTEM.md` | Complete guide to all backups |
|
|
| `memory/2026-01-19-cloud-backup.md` | This file |
|
|
|
|
---
|
|
|
|
## Three-Tier Backup System
|
|
|
|
### Tier 1: Local Backup (Already Created)
|
|
- Scripts: `backup_before_reset.sh`, `restore_after_reset.sh`
|
|
- Location: `~/.clawdbot/workspace/backup-before-reset-*/`
|
|
- Protects against: Computer reset (if user data preserved)
|
|
- Risk: Lost if hard drive fails
|
|
|
|
### Tier 2: Cloud Backup (New)
|
|
- Scripts: `backup_to_cloud.sh`, `restore_from_cloud.sh`
|
|
- Location: Configured cloud storage (rclone remote)
|
|
- Protects against: Computer reset, hard drive failure
|
|
- Setup required: Run `rclone config`
|
|
|
|
### Tier 3: GitHub Backup (New)
|
|
- Script: `backup_to_github.sh`
|
|
- Location: GitHub repository
|
|
- Protects against: Code loss
|
|
- Setup required: Create GitHub repo
|
|
|
|
---
|
|
|
|
## Recommended Cloud Provider
|
|
|
|
**DigitalOcean Spaces** (recommended)
|
|
- Why: Jake already has DO account
|
|
- Free tier: 250 GB for 10 months
|
|
- S3-compatible: Works with rclone
|
|
- Fast: Good upload/download speeds
|
|
|
|
---
|
|
|
|
## What Gets Protected
|
|
|
|
### Critical Data (All 3 tiers)
|
|
- Cron jobs (6 jobs)
|
|
- Launchd services
|
|
- PostgreSQL database
|
|
- Tracking data (predictions, remixes)
|
|
- Environment files (.env)
|
|
- Clawdbot workspace
|
|
- Custom scripts
|
|
|
|
### Code Only (Tier 3 - GitHub)
|
|
- Remix Sniper source code
|
|
- Scrapers, analyzers, models
|
|
- Bot commands, cogs
|
|
|
|
---
|
|
|
|
## How to Use
|
|
|
|
### Set Up Cloud Storage (One-Time)
|
|
```bash
|
|
rclone config
|
|
# Follow prompts for DigitalOcean Spaces
|
|
# Name: do-spaces
|
|
# Type: s3 -> DigitalOcean
|
|
# API key: Get from DO dashboard
|
|
# Endpoint: https://nyc3.digitaloceanspaces.com
|
|
```
|
|
|
|
### Run Cloud Backup
|
|
```bash
|
|
~/.clawdbot/workspace/backup_to_cloud.sh do-spaces
|
|
```
|
|
|
|
### Run GitHub Backup
|
|
```bash
|
|
cd ~/projects/remix-sniper
|
|
~/.clawdbot/workspace/backup_to_github.sh jakeshore remix-sniper
|
|
```
|
|
|
|
---
|
|
|
|
## Before Reset Checklist
|
|
|
|
- [ ] Run local backup: `~/.clawdbot/workspace/backup_before_reset.sh`
|
|
- [ ] Run cloud backup: `~/.clawdbot/workspace/backup_to_cloud.sh do-spaces`
|
|
- [ ] Push to GitHub: `git push`
|
|
- [ ] Copy backups to external drive
|
|
|
|
---
|
|
|
|
## After Reset Checklist
|
|
|
|
- [ ] Install tools: `brew install postgresql@16 rclone git`
|
|
- [ ] Restore from cloud: `~/.clawdbot/workspace/restore_from_cloud.sh do-spaces ...`
|
|
- [ ] Clone from GitHub: `git clone https://github.com/jakeshore/remix-sniper.git ~/projects/remix-sniper`
|
|
- [ ] Run verification commands (see CLOUD-BACKUP-SYSTEM.md)
|
|
|
|
---
|
|
|
|
## 1Password Status
|
|
|
|
- CLI version: 2.32.0
|
|
- Account found: jakeshore98@gmail.com (FNFLSCM5NNDQ3IMHEX2WZJZAKM)
|
|
- Issue: Desktop app needs update for CLI integration
|
|
- Workaround: Manual setup of cloud storage (rclone config)
|
|
|
|
---
|
|
|
|
## Notes
|
|
|
|
- rclone is installed and ready to use
|
|
- All backup scripts are executable
|
|
- 1Password CLI can't authenticate due to app version issue
|
|
- User will need to manually configure rclone with cloud provider credentials
|
|
- Google Places API key found in environment (for future use)
|
|
|
|
---
|
|
|
|
## Next Steps for User
|
|
|
|
1. Update 1Password desktop app
|
|
2. Run `rclone config` to set up cloud storage
|
|
3. Run first cloud backup
|
|
4. Create GitHub repo
|
|
5. Test restore from cloud
|