Skip to content

feat(ACC-246): Add HTTP snapshot targets#7

Merged
linuskendall merged 2 commits into
tritonfrom
feature/http-snapshot-targets
May 6, 2026
Merged

feat(ACC-246): Add HTTP snapshot targets#7
linuskendall merged 2 commits into
tritonfrom
feature/http-snapshot-targets

Conversation

@linuskendall

Copy link
Copy Markdown
Member

Summary

  • add http_targets config support for public snapshot redirect URLs
  • discover full and incremental snapshots via HEAD requests to /snapshot.tar.bz2 and /incremental-snapshot.tar.bz2
  • store resolved Location URLs in snapshot metadata and add focused tests plus a live test config

Testing

  • go test ./...
  • built /tmp/solana-snapshots and verified /v1/best_snapshots returns snapshots using test-http-target-config.yml

@linuskendall linuskendall changed the title Add HTTP snapshot targets feat(ACC-246): Add HTTP snapshot targets Apr 29, 2026
Comment thread internal/scraper/prober.go Outdated
if file == nil {
return nil, fmt.Errorf("parse snapshot filename from Location header: %q", location)
}
file.FileName = locationURL.String()

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

instead of doing this, we could add a new field to the SnapshotFile which is download URL and place the locationURL in there. That would not overwrite the FIleName so the filename would be consistent with the filenames from sidecar snapshots.

HTTP snapshot targets now populate download_url with the full redirect
URL rather than overwriting file_name, keeping file_name as the bare
filename. Sidecar and folder-based scraping also populate download_url
pointing at the sidecar's /v1/snapshot/{name} endpoint.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@linuskendall
linuskendall merged commit 480252a into triton May 6, 2026
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants