Spillbox / Jul 2024 – Oct 2024
Predictive File Caching
Globally distributed predictive file cache built in Go, trained on 100K+ access logs and achieving 95%+ prediction accuracy.
timelineJul 2024 - Oct 2024
focussystems, devtools
stack
Go
problem
Globally distributed file access incurs avoidable I/O latency when likely future reads are not cached near the requester.
approach
Analyzed request histories to predict upcoming file accesses, then integrated the predictor into a distributed caching architecture with resilient error handling.
impact
- Processed 100K+ access logs
- Achieved 95%+ prediction accuracy
- access logs analyzed
- 100,000
- accuracy
- 95%