The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


RESEARCH 》 Optimization of network data (WAN Optimization) at various levels

WAN Network data can be optimized at various levels depending upon the network applications, protocols, topology and use-cases. So the amount of data you can optimize will depend on the strategy you choose to optimize.

Network Packet level optimization: You can optimize your network data down to individual packets. This may be useful to optimize discrete network data such as VoIP and streaming networking applications. So depending on your network you can do frame level optimization in case if it is a Layer-2 switched network something like MPLS/VPLS scenarios. And in case it is a IP based routed networks you can do IP packet level optimization. So that the IP-header is intact where-as its other protocol headers and the payload is optimized. Hence packet level optimization suits for discrete network data and corresponding network applications.
Network Packet level network data WAN Optimization

Session level optimization: Session level (or session based) optimization is suited for complete/full sessions bound by a network connection. For example TCP-connection. A remote MySQL or Oracle database access involves a TCP-connection (or a session). So in this case we are not talking about discrete packet level access (although a session will always comprise multiple packet transfers to and fro) and we are not talking about individual file-level access, instead it is a session-level bulk data transfers. In this case we can employ different network optimization strategy so that the entire session can be optimized.
Network Session level network data WAN Optimization

File level optimization: Last but not least a file-level optimization involves a typical file-download/file-upload scenario such as HTTP, FTP and so on. In this case in general even before sending across the wire we can do lossy (and lossless) compression of these files depending on its contents. But when it is being transferred across the network we can employ a network optimization strategy where an entire file transfer is optimized. We can also implement both above discussed techniques such as network packet-level and session-level to optimize file-level network data transfer. Some of the examples which comes in this category are CDN networks, HTTP Cache Proxy (such as Squid-Cache) and so on.
Network File level network data WAN Optimization

Case study :: Dolby Servers in movie theaters: Movie theaters these days get digitized extremely high-quality movie files from film producers/distributor channels. Since these files are so huge they are transferred via high-speed wire (fibre-optic) networks. But in case if the movie theaters lack high-speed network connectivity then they ship these movie copies on a regular computer hard-drive. This is a good case study and use-case where file-level network data optimization can be deployed.
Here are some interesting videos on Digital Cinema movie servers and projection technology:


Here is my detailed video of the same:

In case if you are having a company and if you are looking for ways to optimize your network, performance tune-up and or building network optimization product(s) (which may or may not include porting/integrating TOFFEE on to your product), in that case I can offer my technical consultation services. If you are interested you can contact me for the same.



Suggested Topics:


WAN Optimization and Network Optimization

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

TOFFEE-Mocha Documentation :: TOFFEE-Mocha-1.0.14-1-x86_64 ↗
Saturday' 13-Mar-2021

First TOFFEE-Mocha Code Release ↗
Saturday' 13-Mar-2021
TOFFEE-Mocha is my dream project which I thought working on it since several years. I want to make a WAN emulation software which is straight forward and simple to use. I used tc scripts along with iptables for testing my TOFFEE (and TrafficSqueezer before TOFFEE) and I am not quite satisfied with the same. As one can understand these scripts are not meant for WAN emulation.

TOFFEE Documentation :: TOFFEE-1.1.24-3-rpi2 ↗
Saturday' 13-Mar-2021
Here is my VLOG Youtube video of the same which includes details about version release notes, future road-map and so on. The TOFFEE release is highly optimized and customized for hardware platforms such as x86-64 based Intel NUC and other Intel mobile computing platforms such as laptops and so on. This version (or release) is not suited and so not recommended to be used for high-end desktop and server hardware platform.

TOFFEE hardware selection guide ↗
Saturday' 13-Mar-2021
When you build a WAN Optimization device with TOFFEE the entire packet processing (data optimization) takes place in software layer or in other words more precisely Operating System kernel space. However if you have any compression or encryption hardware accelerator hardware card the parts of the TOFFEE packet processing modules can be offloaded to hardware layer and thus improving its efficiency.

TOFFEE (and TOFFEE-DataCenter) optimized Wireless Mesh-Networks - B.A.T.M.A.N [open-mesh.org (Open Mesh)] ↗
Saturday' 13-Mar-2021
TOFFEE/TOFFEE-DataCenter can be used to optimize Ad-Hoc Mobile Wireless Mesh-Networks. To learn more about the same here are some references: B.A.T.M.A.N. - https://en.wikipedia.org/wiki/B.A.T.M.A.N. Mobile ad hoc network (MANET) - https://en.wikipedia.org/wiki/Mobile_ad_hoc_network Wireless ad hoc network (WANET) - https://en.wikipedia.org/wiki/Wireless_ad_hoc_network open-mesh.org (Open Mesh) Wiki - https://www.open-mesh.org/projects/open-mesh/wiki

Amazon Prime video - Video Acceleration No more Buffering Problems - WAN Acceleration ↗
Saturday' 13-Mar-2021



Grid Hosting vs CDN Hosting ↗
Saturday' 13-Mar-2021

TOFFEE-DataCenter as a VNF for NFV ↗
Saturday' 13-Mar-2021

My sample Wireshark packet capture files for research ↗
Saturday' 13-Mar-2021
I have a huge repository (or collection) of sample Wireshark packet capture files for reference. I use them extensively for research and development of TOFFEE as well to understand various protocol PDUs and protocol standards. I personally collected various test captures via Wireshark during my test and experimental research setup during the course of TOFFEE development. Say if you are a student and learning Networking and or say VoIP data and VoIP packets, you can analyse my VoIP sample Wireshark captures. Or in other case assume you are doing some quick research (or development) and want to refer few handful of VoIP packets then you can download and analyse my sample packet capture files.

Building my own CDN - choosing a web-hosting to deploy my CDN - Update: 28-July-2016 ↗
Saturday' 13-Mar-2021
The TOFFEE Project website is hosted on Inmotion Hosting. And so I am looking for alternate hosting provider to build my first CDN node. My plan is to make multiple sub-domains of my website such as cdn1.the-toffee-project.org, cdn2.the-toffee-project.org and point each of this corresponding subdomain(s) to various alternative web hosting servers geographically spread across the world. Sometimes choosing the same vendor for multiple CDN nodes may result multiple servers existing in the data-center. And this becomes an issue if there is some catastrophic network disaster.



Featured Educational Video:
Watch on Youtube - [8613//1] x254 Kernel Init Code without Kernel Module - Kernel Programming Tip #linode ↗

TOFFEE-Butterscotch a TOFFEE for Home/SOHO Internet/WAN bandwidth ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch a TOFFEE for Home/SOHO Internet/WAN bandwidth

TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016 ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch Documentation :: TOFFEE-Butterscotch-1.0.11-rpi2-23-nov-2016

Communication data network standards and data transfer speeds :: Chart ↗
Saturday' 13-Mar-2021
Here is a complete chart comprising popular communication data network standards and their respective transfer rates. I hope this reference chart will help network engineers and network software developers while performing networking tests and experiments, building WAN/network products, building WAN simulated networks of a specific standard and so on. This may also helps us to track technological advancements of communication data networks.

TOFFEE (and TOFFEE-DataCenter) deployment in SD-WAN Applications ↗
Saturday' 13-Mar-2021
Software-Defined Wide Area Networking (SD-WAN) is a new innovative way to provide optimal application performance by redefining branch office networking. Unlike traditional expensive private WAN connection technologies such as MPLS, etc., SD-WAN delivers increased network performance and cost reduction. SD-WAN solution decouple network software services from the underlying hardware via software abstraction.




Introducing TrueBench - a high resolution CPU benchmarking system ↗
Saturday' 13-Mar-2021
TrueBench is an unique open-source benchmarking system in which the core system performance and efficiency parameters are measured at extreme high resolution in the order of several million/billion ยต-seconds for a given specific task. TrueBench is a part of The TOFFEE Project research. With TrueBench Raspberry Pi 3, Raspberry Pi 2B, Raspberry Pi 2 and other embedded SoC devices are benchmarked and you can do a comparative analysis with standard mainstream x86 devices.



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server