The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


NEWS & UPDATES 》 Introducing TOFFEE-DataCenter

Since past couple of days I was having sleepless nights as I was working on a new TOFFEE WAN Optimization software variant called as TOFFEE Data-Center. Unlike existing TOFFEE TOFFEE Data-Center is specifically meant for Data Center, Cluster Computing, HPC applications. TOFFEE is built in Linux Kernel core. This makes it inflexible to adapt according to the hardware configuration. It does sequential packet processing and does not scale up well in large multi-core CPU based systems (such as Intel Xeon servers, Core i7 Extreme Desktop systems,etc). Apart from this since it is kernel based, if there is an issue in kernel, it may crash entire system. This becomes a challenge for any carrier grade equipment (CGE) hardware build.

The new upcoming TOFFEE Data-Center will have basic minimal kernel module plus TOFFEE user-space components. The entire packet processing is done within user-space. And these modules can be spawned according to the load, and system's hardware capabilities. In a typical scenario you can have 10-100 such threads executing simultaneously at any given point of time. If due to any reason if one thread crashes/fails, the other threads will continue to operate. And if required based on the load, new threads can be spawned dynamically. With high-speed load balancing systems, you can build a complete WAN Optimization hardware cluster(s) based on TOFFEE Data-Center variant.

Here is an example of TOFFEE Data-Center deployment in which TOFFEE Data-Center is deployed in one more many servers with optional load-balancers. Click HERE to know more about TOFFEE deployment scenarios and topology.
TOFFEE-DataCenter WAN Optimization

Initial Prototyping and Feasibility tests: A basic prototype and PoC (proof of concept) software is built to test this idea. With the prototype various scenarios are tested with different hardware platforms such as low-end mini-PC, an extreme Core i7 Gaming Desktop, and Intel Xeon server(s). With Xeon Server and Core i7 we can process up to 1-Gigabit Network speeds thus achieving almost wire-speed performance everything within software layer. Making it to work smoothly within software layer is a challenge but it is required for VM, SDN based WAN Optimization device builds.

Software Development standpoint: Unlike the existing TOFFEE, since the new TOFFEE Data-Center is user-space centric, I can do code build, compile, test, debug, bug-fix cycles at much higher rates. Since the architecture is discrete, in future any new components can be plugged in it on demand basis with/without significant code changes. TOFFEE Data-Center (like TOFFEE) can also be used with any hardware compression/acceleration cards. This way you can offload some amount of packet processing load and improve overall system performance.

TOFFEE Data-Center for VM/SDN/Cloud Applications: The TOFFEE Data-Center with its modular architecture is well suited for VM based builds, SDN and Cloud deployments. TOFFEE Data-center is highly portable code which makes it easier to port for any hardware platforms such as ARM, MIPS besides x86.

Hardware Requirements TOFFEE vs TOFFEE Data-Center: TOFFEE needs a good CPU with excellent per-core performance. Traditionally Linux Kernel itself (kernel space modules) is not good at scaling in multi-core/multi-cpu CPU platforms. Instead the user-space apps in a Linux System is good at scaling in multi-core/multi-cpu CPU scenarios. This is the main drawback which can degrade the performance of TOFFEE. But TOFFEE Data-Center is modular so it prefers average single core CPU performance, but more CPU cores since it works in user-space and the load is shared across multiple TOFFEE Data-Center user-space computing modules.

Release schedule of the new upcoming TOFFEE Data-Center: TOFFEE Data-Center is just started (as on 4-Aug-2016) and its a huge project. Once a basic, stable version is developed, as a part of initial first phase the same will be released soon once it is mature and stable. Here is my Youtube VLOG of the same:



Suggested Topics:


TOFFEE-DataCenter - WAN Optimization


Categories

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

Optimization of network data (WAN Optimization) at various levels ↗
Saturday' 13-Mar-2021
WAN Network data can be optimized at various levels depending upon the network applications, protocols, topology and use-cases. So the amount of data you can optimize will depend on the strategy you choose to optimize. Such as: Network Packet level optimization, Session level optimization, File level optimization, etc.

TOFFEE-Mocha-1.0.32-1-x86_64 and TOFFEE-Mocha-1.0.32-1-i386 Code Release ↗
Saturday' 13-Mar-2021
This is my first TOFFEE-Mocha combined x86-64 and i386 (Intel x86 64-bit and 32-bit) code release.

TEST CASES :: TEST RESULTS :: Raspberry Pi WAN Emulator TOFFEE-Mocha-1.0.14-1-rpi2 ↗
Saturday' 13-Mar-2021

Raspberry Pi as a Networking Device ↗
Saturday' 13-Mar-2021
Raspberry Pi is often used as a single board computer for applications such as IoT, hobby projects, DIY, education aid, research and prototyping device. But apart from these applications Raspberry Pi can be used for real-world applications such as in making a full-fledged networking devices. Raspberry Pi is a single board ARM based hardware which is why it is also classified as ARM based SoC. Since it is ARM based it is highly efficient, tiny form-factor and lower in power consumption with moderate computational power. This will allow it to work several hours on emergency battery backup power supply such as low-cost domestic UPS and or some renewable energy source, which is a prerequisite for a typical networking device.

First TOFFEE Code Release ↗
Saturday' 13-Mar-2021
I started working on the new TOFFEE project (which is the fork of my earlier TrafficSqueezer open-source project) starting from 1st January 2016 onwards. Ever since I was busy in research and altering certain old features so that it is more minimal than TrafficSqueezer, a more focused agenda, deliver refined code and a broader vision. I have lined up more things to follow in the upcoming months. I want to focus about all aspects of WAN communication technologies not just on core WAN Optimization research and technology.

TOFFEE-Mocha WAN Emulation software development - Update: 18-June-2016 ↗
Saturday' 13-Mar-2021
In the previous update (17-Jun-2016) I discussed about the upcoming new Random Packet drop feature along with other completed features. Now I completed the entire TOFFEE-Mocha Random packet drop feature. I completed all the kernel components and the UI support of the same. And to make GUI settings more organized I split the earlier Basic-Settings page into two separate pages namely: Packet Drop and Packet Delay. So this way it is simple to understand settings according to their functionality.

Watch on Youtube - [889//1] 280 WAN Optimization - Animated demo of Packet Optimization in TOFFEE-DataCenter ↗


TOFFEE-DataCenter as a VNF for NFV ↗
Saturday' 13-Mar-2021

Internet optimization through TOFFEE-DataCenter WAN Optimization Demo ↗
Saturday' 13-Mar-2021
Internet optimization through TOFFEE-DataCenter WAN Optimization Demo

Introducing TOFFEE-DataCenter ↗
Saturday' 13-Mar-2021
TOFFEE TOFFEE Data-Center is specifically meant for Data Center, Cluster Computing, HPC applications. TOFFEE is built in Linux Kernel core. This makes it inflexible to adapt according to the hardware configuration. It does sequential packet processing and does not scale up well in large multi-core CPU based systems (such as Intel Xeon servers, Core i7 Extreme Desktop systems,etc). Apart from this since it is kernel based, if there is an issue in kernel, it may crash entire system. This becomes a challenge for any carrier grade equipment (CGE) hardware build.

TOFFEE-Mocha-1.0.32-1-x86_64 and TOFFEE-Mocha-1.0.32-1-i386 Code Release ↗
Saturday' 13-Mar-2021
This is my first TOFFEE-Mocha combined x86-64 and i386 (Intel x86 64-bit and 32-bit) code release.



Featured Educational Video:
Watch on Youtube - [1836//1] x257 tp-link UE300 Linux Kernel Realtek Driver Codewalk rtl8153a-3 r8152 USB 3.0 to Gigabit - Part1 ↗

TOFFEE (and TOFFEE-DataCenter) optimized Satellite (inflight/marine/defense) ISP Networks ↗
Saturday' 13-Mar-2021
TOFFEE Optimized Satellite ISP Network: TOFFEE/TOFFEE-DataCenter can be used to optimize Satellite Networks (Satellite based Internet Networks, VoIP, Data, private leased-links) as shown. Ground station transponders can be connected via array of TOFFEE Devices and in the remote CPE can have dedicated or inbuilt TOFFEE with which you can establish a WAN Optimized Satellite Network Tunnel as shown.

TOFFEE-Mocha Documentation :: TOFFEE-Mocha-1.0.18-1-x86_64 ↗
Saturday' 13-Mar-2021

TOFFEE Data-Center optimized Internet of Things (IoT) Platform ↗
Saturday' 13-Mar-2021

TOFFEE-DataCenter - First Live Demo and software development - Update: 26-Aug-2016 ↗
Saturday' 13-Mar-2021
Today I have done a test setup so that I can able to connect my Android Samsung Tab via TOFFEE DataCenter. Below is my complete test topology of my setup. For demo (and research/development) context I configured TOFFEE DataCenter in engineering debug mode. So I do not need two devices for this purpose.



Watch on Youtube - [1888//1] Deep Space Communication - Episode1 - Introduction ↗

PiPG - Raspberry Pi Network Packet Generator ↗
Saturday' 13-Mar-2021
PiPG is a powerful and yet simple Raspberry Pi Network Packet Generator. With PiPG you can now fabricate custom network packets and send via any Network Interface. Supports all kinds of standard Network Ports (Linux Kernel driver generated) such as Physical Network Interface ports, and an array of virtual ports such as loopback, tun/tap, bridge, etc. indispensable tool for: Network Debugging, Testing and Performance analysis Network Administrators Students Network R&D Protocol Analysis and Study Network Software Development Compliance Testing Ethical Hackers you can generate the following test traffic: L2-Bridging/Slow protocols: STP, LACP, OAM, LLDP, EAP, etc Routing protocols: RIPv1, RIPv2, IGMPv1, IGMPv2, OSPF, IS-IS, EIGRP, HSRP, VRRP, etc Proprietary protocols: CISCO, etc Generic: IPv4 TCP/UDP, etc Malformed random packets



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server