The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


NEWS & UPDATES 》 Introducing TOFFEE-DataCenter

Since past couple of days I was having sleepless nights as I was working on a new TOFFEE WAN Optimization software variant called as TOFFEE Data-Center. Unlike existing TOFFEE TOFFEE Data-Center is specifically meant for Data Center, Cluster Computing, HPC applications. TOFFEE is built in Linux Kernel core. This makes it inflexible to adapt according to the hardware configuration. It does sequential packet processing and does not scale up well in large multi-core CPU based systems (such as Intel Xeon servers, Core i7 Extreme Desktop systems,etc). Apart from this since it is kernel based, if there is an issue in kernel, it may crash entire system. This becomes a challenge for any carrier grade equipment (CGE) hardware build.

The new upcoming TOFFEE Data-Center will have basic minimal kernel module plus TOFFEE user-space components. The entire packet processing is done within user-space. And these modules can be spawned according to the load, and system's hardware capabilities. In a typical scenario you can have 10-100 such threads executing simultaneously at any given point of time. If due to any reason if one thread crashes/fails, the other threads will continue to operate. And if required based on the load, new threads can be spawned dynamically. With high-speed load balancing systems, you can build a complete WAN Optimization hardware cluster(s) based on TOFFEE Data-Center variant.

Here is an example of TOFFEE Data-Center deployment in which TOFFEE Data-Center is deployed in one more many servers with optional load-balancers. Click HERE to know more about TOFFEE deployment scenarios and topology.
TOFFEE-DataCenter WAN Optimization

Initial Prototyping and Feasibility tests: A basic prototype and PoC (proof of concept) software is built to test this idea. With the prototype various scenarios are tested with different hardware platforms such as low-end mini-PC, an extreme Core i7 Gaming Desktop, and Intel Xeon server(s). With Xeon Server and Core i7 we can process up to 1-Gigabit Network speeds thus achieving almost wire-speed performance everything within software layer. Making it to work smoothly within software layer is a challenge but it is required for VM, SDN based WAN Optimization device builds.

Software Development standpoint: Unlike the existing TOFFEE, since the new TOFFEE Data-Center is user-space centric, I can do code build, compile, test, debug, bug-fix cycles at much higher rates. Since the architecture is discrete, in future any new components can be plugged in it on demand basis with/without significant code changes. TOFFEE Data-Center (like TOFFEE) can also be used with any hardware compression/acceleration cards. This way you can offload some amount of packet processing load and improve overall system performance.

TOFFEE Data-Center for VM/SDN/Cloud Applications: The TOFFEE Data-Center with its modular architecture is well suited for VM based builds, SDN and Cloud deployments. TOFFEE Data-center is highly portable code which makes it easier to port for any hardware platforms such as ARM, MIPS besides x86.

Hardware Requirements TOFFEE vs TOFFEE Data-Center: TOFFEE needs a good CPU with excellent per-core performance. Traditionally Linux Kernel itself (kernel space modules) is not good at scaling in multi-core/multi-cpu CPU platforms. Instead the user-space apps in a Linux System is good at scaling in multi-core/multi-cpu CPU scenarios. This is the main drawback which can degrade the performance of TOFFEE. But TOFFEE Data-Center is modular so it prefers average single core CPU performance, but more CPU cores since it works in user-space and the load is shared across multiple TOFFEE Data-Center user-space computing modules.

Release schedule of the new upcoming TOFFEE Data-Center: TOFFEE Data-Center is just started (as on 4-Aug-2016) and its a huge project. Once a basic, stable version is developed, as a part of initial first phase the same will be released soon once it is mature and stable. Here is my Youtube VLOG of the same:



Suggested Topics:


TOFFEE-DataCenter - WAN Optimization


Categories

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

Introducing TOFFEE-Butterscotch - Save and Optimize your Internet/WAN bandwidth ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch yet another variant of TOFFEE can be used to save and optimize your Home/SOHO Internet/WAN bandwidth. Unlike TOFFEE (and TOFFEE-DataCenter) TOFFEE-Butterscotch is a non peer-to-peer (and asymmetric) network optimization solution. This makes TOFFEE-Butterscotch an ideal tool for all Home and SOHO users.

Network Latency and Bandwidth Assessment - for Network Admins and Infrastructure Architects ↗
Saturday' 13-Mar-2021

CDN Content Delivery Networks - Types ↗
Saturday' 13-Mar-2021

TEST CASES :: TEST RESULTS :: TOFFEE-Mocha-1.0.14 Development version ↗
Saturday' 13-Mar-2021

Introducing TrueBench - a high resolution CPU benchmarking system ↗
Saturday' 13-Mar-2021
TrueBench is an unique open-source benchmarking system in which the core system performance and efficiency parameters are measured at extreme high resolution in the order of several million/billion ยต-seconds for a given specific task. TrueBench is a part of The TOFFEE Project research. With TrueBench Raspberry Pi 3, Raspberry Pi 2B, Raspberry Pi 2 and other embedded SoC devices are benchmarked and you can do a comparative analysis with standard mainstream x86 devices.

TOFFEE-DataCenter :: Optimized ISP backbone networks for countries with slowest Internet Speed ↗
Saturday' 13-Mar-2021

Watch on Youtube - [1801//1] Deep Space Communication - Episode1 - Introduction ↗


Recording Lab Monthly off-grid power-consumption readings for research ↗
Saturday' 13-Mar-2021

TOFFEE Benchmarks :: TOFFEE-1.1.28 ↗
Saturday' 13-Mar-2021
Here is the TOFFEE WAN Optimization benchmarks of the TOFFEE version: TOFFEE-1.1.28. This is the current TOFFEE development version till date (2-Jul-2016). This is a HPC TOFFEE variant meant for high-end custom build servers and high-end desktops (i.e High Performance Computing a.k.a HPC). TOFFEE built this way often needs customized kernel compilation and build such as processor specific and hardware specific tune-ups since it is highly CPU intensive (if not offloaded via Hardware Accelerator Cards).

TOFFEE hardware selection guide ↗
Saturday' 13-Mar-2021
When you build a WAN Optimization device with TOFFEE the entire packet processing (data optimization) takes place in software layer or in other words more precisely Operating System kernel space. However if you have any compression or encryption hardware accelerator hardware card the parts of the TOFFEE packet processing modules can be offloaded to hardware layer and thus improving its efficiency.

Internet optimization through TOFFEE-DataCenter WAN Optimization Demo ↗
Saturday' 13-Mar-2021
Internet optimization through TOFFEE-DataCenter WAN Optimization Demo



Featured Educational Video:
Watch on Youtube - [16129//1] 294 - VRF - Virtual Routing and Forwarding - Introduction ↗

The TOFFEE Project :: TOFFEE-Butterscotch :: Save and Optimize your Internet/WAN bandwidth ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch is an open-source software which can be used to save and optimize your Internet/WAN bandwidth. Unlike TOFFEE (and TOFFEE-DataCenter) TOFFEE-Butterscotch is a non peer-to-peer (and asymmetric) network optimization solution. This makes TOFFEE-Butterscotch an ideal tool for all Home and SOHO users.

Off-Grid Solar Power System for Raspberry Pi ↗
Saturday' 13-Mar-2021
When you choose to use your Raspberry Pi device as your IoT based remote weather station or if you are building Linux kernel (like kernel compilation) within the same, you need a good uninterrupted power source (UPS). But if you are using it on site or in some research camping location you can choose to power your Raspberry Pi device with your custom off-grid solar power source.

TOFFEE-Butterscotch Bandwidth saver software development - Update: 28-Oct-2016 ↗
Saturday' 13-Mar-2021
Here is my first software development update of TOFFEE-Butterscotch. In my first TOFFEE-Butterscotch news update I have introduced about TOFFEE-Butterscotch research, project specifications, use-cases, etc. Introducing TOFFEE-Butterscotch Alerts: These are simple packet counters which corresponds to the filter type. For example if the incoming TCP-SYN packets are blocked then its corresponding alert counter will increment whenever such a packet arrives and gets filtered (dropped).

TOFFEE-DataCenter Live Demo with Clash of Clans game data - 30-Aug-2016 ↗
Saturday' 13-Mar-2021
Today I have done a test setup so that I can able to connect my Android Samsung Tab via TOFFEE DataCenter. Below is my complete test topology of my setup. For demo (and research/development) context I configured TOFFEE DataCenter in engineering debug mode. So that I do not need two devices for this purpose.




Building my own CDN - choosing a web-hosting to deploy my CDN - Update: 28-July-2016 ↗
Saturday' 13-Mar-2021
The TOFFEE Project website is hosted on Inmotion Hosting. And so I am looking for alternate hosting provider to build my first CDN node. My plan is to make multiple sub-domains of my website such as cdn1.the-toffee-project.org, cdn2.the-toffee-project.org and point each of this corresponding subdomain(s) to various alternative web hosting servers geographically spread across the world. Sometimes choosing the same vendor for multiple CDN nodes may result multiple servers existing in the data-center. And this becomes an issue if there is some catastrophic network disaster.



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server