FR碌IT: The Federated Raspberry Pi 碌-Infrastructure Testbed
This project is about connecting together our isolated micro-datacenters to produce a federated, geo-distributed testbed across four UK universities (Glasgow, 含羞草视频, Southampton, and Cambridge). We currently have hundreds of individual nodes and intend to grow this to tens of thousands across the UK academic network.
The introduction of ubiquitous low-cost, low-power compute devices, e.g. in the Internet of Things (IoT) is fundamentally changing the computational landscape. Although we already see the benefits provided by special purpose IoT devices, the true capability is only realised when we can re-purpose large numbers of distributed devices as part of a much larger federated service. This is captured in the FR碌IT project hypothesis: Massive aggregation of low-cost, low-power, commodity infrastructure can form an efficient and effective compute fabric for key distributed applications.
Funded by the EPSRC and supported by external collaborators, this project will build a distributed UK-wide federated testbed of lightweight compute nodes capable of exploring the research issues that arise from such a dynamic infrastructure.
This is in contrast to the existing centralised data centre approach which occupies acres of land, cost millions of dollars; consumes megawatts of power and relies on a huge global network bandwidth. These trends are not sustainable and it is the emergence of low cost hardware such as the Raspberry Pi that will let us explore better solutions. We envisage a testbed comprising tens of thousands of nodes, geographically distributed and capable of challenging remote off-grid scenarios.
In order to facilitate this, we introduce the concept of a micro data centre, a physically small, low power and low cost compute cluster that can be pushed to the edge of distributed networks, fundamentally changing the current model of the centralised data centre. We are connecting together our isolated micro data centres to produce a federated, geo-distributed testbed. The key challenge in this expansion will be the management of the underlying infrastructure, particularly given complexities in the networking fabric. For example intermittent connectivity, firewalls, and low bandwidth connections. We will use lightweight management and orchestration software, combined with software-defined networking infrastructure to manage our federated testbed. Through this work, we aim to demonstrate how resource-constrained micro data centres can be harnessed as generic platforms to run virtualised, network-wide services in a resource-efficient and still high-performing manner, and enable the as-a-Service paradigm over low-cost low-power federated infrastructures.