O projeto TOFFEE
CASADOCUMENTAÇÃOATUALIZAÇÕESVÍDEOSPESQUISADESCARREGARPATROCINADORESCONTATO


NEWS & UPDATES 》 Introducing TOFFEE-DataCenter

Since past couple of days I was having sleepless nights as I was working on a new TOFFEE WAN Optimization software variant called as TOFFEE Data-Center. Unlike existing TOFFEE TOFFEE Data-Center is specifically meant for Data Center, Cluster Computing, HPC applications. TOFFEE is built in Linux Kernel core. This makes it inflexible to adapt according to the hardware configuration. It does sequential packet processing and does not scale up well in large multi-core CPU based systems (such as Intel Xeon servers, Core i7 Extreme Desktop systems,etc). Apart from this since it is kernel based, if there is an issue in kernel, it may crash entire system. This becomes a challenge for any carrier grade equipment (CGE) hardware build.

The new upcoming TOFFEE Data-Center will have basic minimal kernel module plus TOFFEE user-space components. The entire packet processing is done within user-space. And these modules can be spawned according to the load, and system's hardware capabilities. In a typical scenario you can have 10-100 such threads executing simultaneously at any given point of time. If due to any reason if one thread crashes/fails, the other threads will continue to operate. And if required based on the load, new threads can be spawned dynamically. With high-speed load balancing systems, you can build a complete WAN Optimization hardware cluster(s) based on TOFFEE Data-Center variant.

Here is an example of TOFFEE Data-Center deployment in which TOFFEE Data-Center is deployed in one more many servers with optional load-balancers. Click HERE to know more about TOFFEE deployment scenarios and topology.
TOFFEE-DataCenter WAN Optimization

Initial Prototyping and Feasibility tests: A basic prototype and PoC (proof of concept) software is built to test this idea. With the prototype various scenarios are tested with different hardware platforms such as low-end mini-PC, an extreme Core i7 Gaming Desktop, and Intel Xeon server(s). With Xeon Server and Core i7 we can process up to 1-Gigabit Network speeds thus achieving almost wire-speed performance everything within software layer. Making it to work smoothly within software layer is a challenge but it is required for VM, SDN based WAN Optimization device builds.

Software Development standpoint: Unlike the existing TOFFEE, since the new TOFFEE Data-Center is user-space centric, I can do code build, compile, test, debug, bug-fix cycles at much higher rates. Since the architecture is discrete, in future any new components can be plugged in it on demand basis with/without significant code changes. TOFFEE Data-Center (like TOFFEE) can also be used with any hardware compression/acceleration cards. This way you can offload some amount of packet processing load and improve overall system performance.

TOFFEE Data-Center for VM/SDN/Cloud Applications: The TOFFEE Data-Center with its modular architecture is well suited for VM based builds, SDN and Cloud deployments. TOFFEE Data-center is highly portable code which makes it easier to port for any hardware platforms such as ARM, MIPS besides x86.

Hardware Requirements TOFFEE vs TOFFEE Data-Center: TOFFEE needs a good CPU with excellent per-core performance. Traditionally Linux Kernel itself (kernel space modules) is not good at scaling in multi-core/multi-cpu CPU platforms. Instead the user-space apps in a Linux System is good at scaling in multi-core/multi-cpu CPU scenarios. This is the main drawback which can degrade the performance of TOFFEE. But TOFFEE Data-Center is modular so it prefers average single core CPU performance, but more CPU cores since it works in user-space and the load is shared across multiple TOFFEE Data-Center user-space computing modules.

Release schedule of the new upcoming TOFFEE Data-Center: TOFFEE Data-Center is just started (as on 4-Aug-2016) and its a huge project. Once a basic, stable version is developed, as a part of initial first phase the same will be released soon once it is mature and stable. Here is my Youtube VLOG of the same:



Suggested Topics:


TOFFEE-DataCenter - WAN Optimization


Categories

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Tópicos recomendados:

Why TOFFEE is forked from TrafficSqueezer ↗
Saturday' 13-Mar-2021
TrafficSqueezer is an open-source WAN Optimization project. TrafficSqueezer is mainly a research project which is started around mid-2006. It is initially started as a research (or prototype) code even before it is officially registered in Sourceforge.net. But this code is just primitive user-space raw socket modules. This is later refined and a pre-alpha version is created. Followed by which Alpha release. This prototype code is moved from user-space to Linux Kernel (Kernel Space) and then the journey begin in terms of making a serious WAN Optimization solution. Once the pre-beta and beta releases are complete the mainstream series is started.

A study on Deep Space Networks (DSN) ↗
Saturday' 13-Mar-2021
When you are dealing Deep Space Networks (DSN) one among the most challenging parts is the Interplanetary distances and communicating data across such vast distances. This is where we are not dealing with common Internet type traffic such as HTTP/FTP/VoIP/etc but it is completely different when it comes to DSN so far. So optimizing data in DSN becomes mandatory. For example if you think one of the Mars Rovers, they have used LZO lossless compression.

TOFFEE (and TOFFEE-DataCenter) deployment in SD-WAN Applications ↗
Saturday' 13-Mar-2021
Software-Defined Wide Area Networking (SD-WAN) is a new innovative way to provide optimal application performance by redefining branch office networking. Unlike traditional expensive private WAN connection technologies such as MPLS, etc., SD-WAN delivers increased network performance and cost reduction. SD-WAN solution decouple network software services from the underlying hardware via software abstraction.

TOFFEE-Mocha WAN Emulator Jitter Feature ↗
Saturday' 13-Mar-2021

CDN Hosting ↗
Saturday' 13-Mar-2021
It is quite interesting that there are few web hosting firms are offering direct CDN based hosting services. Since it is a direct CDN based hosting, it is cheap, extremely easy or transparent CDN service. It is transparent, since each time you publish your content in the hosting web-server (origin server), it is immediately is in sync automatically in the user-serving CDN caching machines. Since the hosting vendor and the CDN vendor are all the same, it is also easy to use their services. There is no incompatibility issues, interoperability issues, and better integrated analytics, are all the benefits of CDN Hosting services.

Upgrading Ubuntu 17.10 to 18.04 via TOFFEE-DataCenter WAN Optimization Screenshots ↗
Saturday' 13-Mar-2021

Assista no Youtube - [976//1] 293 - iPerf Network Optimization - WAN Optimization Demo ↗


TOFFEE-DataCenter WAN Optimization software development - Update: 13-Aug-2016 ↗
Saturday' 13-Mar-2021
Earlier the TOFFEE is intended to work on IoT devices, Satellite Networks, branch office/SOHO deployments. In most cases the users may deploy just one or couple of TOFFEE devices per site. But in the case of TOFFEE-DataCenter, users can scale-up deploying the same in multiple servers in a sort of distributed cluster computing scenario. Besides the core TOFFEE-DataCenter components (such as packet processing engine/framework), I need to do lot of changes in its Graphical User Interface (GUI) too to address these new requirements.

TOFFEE (and TOFFEE-DataCenter) deployment with VPN devices ↗
Saturday' 13-Mar-2021
In case if you need to deploy TOFFEE along with your existing VPN devices you can deploy the same as shown below. This will allow your VPN devices to encrypt your TOFFEE WAN Optimized network data. NOTE: Make sure about the VPN deployment topology done in the right order. Else TOFFEE (LAN side) may get VPN encrypted packets which may not be possible (and or difficult) to further optimize. Hence always make sure to deploy them in a topology suggested below so that TOFFEE devices are out of VPN tunnel.

TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016 ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016

My Lab HDD and SSD logs for research ↗
Saturday' 13-Mar-2021



Featured Educational Video:
Assista no Youtube - [164//1] 169 Q&A - Add additional HardDrive or storage space in Linux VirtualBox VM ↗

Network Latency and Bandwidth Assessment - for Network Admins and Infrastructure Architects ↗
Saturday' 13-Mar-2021

DIY TOFFEE WAN Optimization Device with Intel Celeron Mini PC ↗
Saturday' 13-Mar-2021
Here is a step-by-step DIY to build your own Intel based Mini PC WAN Optimization Device with TOFFEE. I chose this below Intel Celeron Mini PC since it is fan-less aluminium case and as well it has 2 dedicated inbuilt Gigabit Ethernet ports. You can use one for LAN Network and one for WAN Network.

Upgrading Ubuntu 17.10 to 18.04 via TOFFEE-DataCenter WAN Optimization Screenshots ↗
Saturday' 13-Mar-2021

My sample Wireshark packet capture files for research ↗
Saturday' 13-Mar-2021
I have a huge repository (or collection) of sample Wireshark packet capture files for reference. I use them extensively for research and development of TOFFEE as well to understand various protocol PDUs and protocol standards. I personally collected various test captures via Wireshark during my test and experimental research setup during the course of TOFFEE development. Say if you are a student and learning Networking and or say VoIP data and VoIP packets, you can analyse my VoIP sample Wireshark captures. Or in other case assume you are doing some quick research (or development) and want to refer few handful of VoIP packets then you can download and analyse my sample packet capture files.



Assista no Youtube - [1844//1] Deep Space Communication - Episode1 - Introduction ↗

Introducing TOFFEE-Butterscotch - Save and Optimize your Internet/WAN bandwidth ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch yet another variant of TOFFEE can be used to save and optimize your Home/SOHO Internet/WAN bandwidth. Unlike TOFFEE (and TOFFEE-DataCenter) TOFFEE-Butterscotch is a non peer-to-peer (and asymmetric) network optimization solution. This makes TOFFEE-Butterscotch an ideal tool for all Home and SOHO users.



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server