TOFFEEプロジェクト
ホームドキュメンテーション更新ビデオ研究ダウンロードスポンサー接触


RESEARCH 》 Optimization of network data (WAN Optimization) at various levels

WAN Network data can be optimized at various levels depending upon the network applications, protocols, topology and use-cases. So the amount of data you can optimize will depend on the strategy you choose to optimize.

Network Packet level optimization: You can optimize your network data down to individual packets. This may be useful to optimize discrete network data such as VoIP and streaming networking applications. So depending on your network you can do frame level optimization in case if it is a Layer-2 switched network something like MPLS/VPLS scenarios. And in case it is a IP based routed networks you can do IP packet level optimization. So that the IP-header is intact where-as its other protocol headers and the payload is optimized. Hence packet level optimization suits for discrete network data and corresponding network applications.
Network Packet level network data WAN Optimization

Session level optimization: Session level (or session based) optimization is suited for complete/full sessions bound by a network connection. For example TCP-connection. A remote MySQL or Oracle database access involves a TCP-connection (or a session). So in this case we are not talking about discrete packet level access (although a session will always comprise multiple packet transfers to and fro) and we are not talking about individual file-level access, instead it is a session-level bulk data transfers. In this case we can employ different network optimization strategy so that the entire session can be optimized.
Network Session level network data WAN Optimization

File level optimization: Last but not least a file-level optimization involves a typical file-download/file-upload scenario such as HTTP, FTP and so on. In this case in general even before sending across the wire we can do lossy (and lossless) compression of these files depending on its contents. But when it is being transferred across the network we can employ a network optimization strategy where an entire file transfer is optimized. We can also implement both above discussed techniques such as network packet-level and session-level to optimize file-level network data transfer. Some of the examples which comes in this category are CDN networks, HTTP Cache Proxy (such as Squid-Cache) and so on.
Network File level network data WAN Optimization

Case study :: Dolby Servers in movie theaters: Movie theaters these days get digitized extremely high-quality movie files from film producers/distributor channels. Since these files are so huge they are transferred via high-speed wire (fibre-optic) networks. But in case if the movie theaters lack high-speed network connectivity then they ship these movie copies on a regular computer hard-drive. This is a good case study and use-case where file-level network data optimization can be deployed.
Here are some interesting videos on Digital Cinema movie servers and projection technology:


Here is my detailed video of the same:

In case if you are having a company and if you are looking for ways to optimize your network, performance tune-up and or building network optimization product(s) (which may or may not include porting/integrating TOFFEE on to your product), in that case I can offer my technical consultation services. If you are interested you can contact me for the same.



Suggested Topics:


WAN Optimization and Network Optimization

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


おすすめトピック:

TOFFEE-Butterscotch Bandwidth saver software development - Update: 28-Oct-2016 ↗
Saturday' 13-Mar-2021
Here is my first software development update of TOFFEE-Butterscotch. In my first TOFFEE-Butterscotch news update I have introduced about TOFFEE-Butterscotch research, project specifications, use-cases, etc. Introducing TOFFEE-Butterscotch Alerts: These are simple packet counters which corresponds to the filter type. For example if the incoming TCP-SYN packets are blocked then its corresponding alert counter will increment whenever such a packet arrives and gets filtered (dropped).

Timelapse Screen Capture of TOFFEE-DataCenter Network Acceleration - with new RRDtool graph support ↗
Saturday' 13-Mar-2021
Timelapse Screen Capture of TOFFEE-DataCenter Network Acceleration - with new RRDtool graph support

VPN Network Optimization via TOFFEE WAN Optimization ↗
Saturday' 13-Mar-2021
VPN Networks may degrade network performance due to various packet processing overheads such as encryption and by adding extra network protocol header(s) (such as IPv4/IPv6, IPSec, etc). This may inflate near MTU sized packets and causes excessive packet fragmentation. Here are the few examples of packet processing involved in a VPN (or a VPN like) Tunnel. With TOFFEE you can optimize these packets even before they get processed on to a VPN device. TOFFEE optimizes packet contents (application payload and transport headers) so that these TOFFEE optimized packets when they get processed by VPN devices (or VPN software stack) they may never need further packet fragmentation. Here is a deployment scenario of TOFFEE with VPN devices.

My Lab Battery Purchase and Service logs for Research ↗
Saturday' 13-Mar-2021
Here is a complete log of my lab battery purchase, service record which I maintain in Google drive. These I use for my home (or my family generic use) as well as a part of my home lab. I maintain a detailed log this way to monitor the failure rate of these batteries. This will allow me to select a specific brand/model which has higher success rate and to monitor any premature failure/expiry. The service log helps me to monitor and schedule the next service routine so that I can maintain these batteries in tip-top condition.

Internet optimization through TOFFEE-DataCenter WAN Optimization Demo ↗
Saturday' 13-Mar-2021
Internet optimization through TOFFEE-DataCenter WAN Optimization Demo

Bufferbloat in a Networking Device or an Appliance ↗
Saturday' 13-Mar-2021

Youtubeで見る - [889//1] 280 WAN Optimization - Animated demo of Packet Optimization in TOFFEE-DataCenter ↗


Demo TOFFEE-DataCenter WAN Optimization VM Test Setup ↗
Saturday' 13-Mar-2021

TOFFEE (and TOFFEE-DataCenter) deployment with VPN devices ↗
Saturday' 13-Mar-2021
In case if you need to deploy TOFFEE along with your existing VPN devices you can deploy the same as shown below. This will allow your VPN devices to encrypt your TOFFEE WAN Optimized network data. NOTE: Make sure about the VPN deployment topology done in the right order. Else TOFFEE (LAN side) may get VPN encrypted packets which may not be possible (and or difficult) to further optimize. Hence always make sure to deploy them in a topology suggested below so that TOFFEE devices are out of VPN tunnel.

Replacing in Lab Intel Core i7 5820K Desktop PC with Intel Celeron 1037U Mini-PC ↗
Saturday' 13-Mar-2021
As a research experiment I replaced my Intel Core i7 5820K desktop PC with my Intel Celeron 1037U Mini-PC as my everyday desktop system. This is an attempt to reduce my overall monthly power consumption. As well an attempt to do feasibility tests and research to know how far Mini PC will dominate the market in future and to study the real potential of Mini PCs.

My Lab Battery Purchase and Service logs for Research ↗
Saturday' 13-Mar-2021
Here is a complete log of my lab battery purchase, service record which I maintain in Google drive. These I use for my home (or my family generic use) as well as a part of my home lab. I maintain a detailed log this way to monitor the failure rate of these batteries. This will allow me to select a specific brand/model which has higher success rate and to monitor any premature failure/expiry. The service log helps me to monitor and schedule the next service routine so that I can maintain these batteries in tip-top condition.



Featured Educational Video:
Youtubeで見る - [89//1] B.E and M.E Final Year Projects - Form your Team ↗

TOFFEE with Hardware Compression and Decompression Accelerator Cards ↗
Saturday' 13-Mar-2021
You can build a basic TOFFEE WAN Optimization hardware completely in software layer (i.e its networking data-plane and control-plane). And if you are a product manufacturer you can make commercial WAN Optimization products with TOFFEE with software layer alone. And if you choose to improve its performance, you can use any third-party PCIe Compression Accelerator cards.

Bufferbloat in a Networking Device or an Appliance ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha WAN Emulator Jitter Feature ↗
Saturday' 13-Mar-2021

TOFFEE-DataCenter WAN Optimization :: TOFFEE-DATACENTER-1.3.25-1-portable ↗
Saturday' 13-Mar-2021
Download TOFFEE-DATACENTER-1.3.25-1-portable.tar.xz via Google Drive share: platform independent (portable) source: TOFFEE-DATACENTER-1.2.2-1-portable.tar.xz * Alternatively download from SOURCEFORGE project site. * Here are the TOFFEE-DataCenter supported features. * To know more about the project kindly refer TOFFEE-Datacenter Documentation, News and Updates



Youtubeで見る - [1888//1] Deep Space Communication - Episode1 - Introduction ↗

Demo TOFFEE-DataCenter WAN Optimization packaging feature ↗
Saturday' 13-Mar-2021



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server