The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


DOCUMENTATION 》 TOFFEE Data-Center WAN Optimization deployment in Big Data Analytics

Big Data Analytics as we know is a new trend in the technology industry, where it is getting deployed across the industries. The information collected can then be fed into knowledge analysis platforms such as AI, and so on where the existing system can be analyzed real-time and can be improved time to time after each subsequent iteration of learning cycle.

Here are some of the industries(and sectors) where Big data analytics is fueling innovation:

  • Internet of Things (IoT)
  • Green Energy - offshore Solar and Wind farms
  • Environment Studies - marine ecology, forest and wildlife
  • Automotive Industry
  • Urban Vertical Farming - 95% less water, half the fertilizer and 0% pesticides - a new way to grow local produce in cities

The Real Challenge!
The data monitored across these platforms can be fed into central data-center upon which big data analytics can be performed in real-time. But the challenge is often the data where it is being produced (data source) is situated at offshore remote sites. And this is the real challenge.

Big Data Analytics - data source vs data-center connectivity - the real challenge [CDN]

Addressing the same via TOFFEE DataCenter platform:
This data produced this way is quite unique and discrete unlike a traditional TCP session based data (such as user browsing data). TOFFEE is specifically architected keeping this aspect in mind so that it can optimize wide variety of use-cases unlike a simple traditional outdated WAN Optimization approach.

TOFFEE DataCenter WAN Optimiation - Big Data Analytics



Suggested Topics:


TOFFEE-DataCenter - WAN Optimization


Categories

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

Network Latency in WAN Networks and performance optimization ↗
Saturday' 13-Mar-2021
Here is my video article on Network Latency in WAN Networks (such as long distance Satellite links, etc) and how you can optimize the same to achieve better network performance.

TOFFEE Benchmarks :: TOFFEE-1.1.28 ↗
Saturday' 13-Mar-2021
Here is the TOFFEE WAN Optimization benchmarks of the TOFFEE version: TOFFEE-1.1.28. This is the current TOFFEE development version till date (2-Jul-2016). This is a HPC TOFFEE variant meant for high-end custom build servers and high-end desktops (i.e High Performance Computing a.k.a HPC). TOFFEE built this way often needs customized kernel compilation and build such as processor specific and hardware specific tune-ups since it is highly CPU intensive (if not offloaded via Hardware Accelerator Cards).

A study on WAN Optimization Techniques ↗
Saturday' 13-Mar-2021
There are various techniques with which one can optimize their WAN Network Data. Any long distance communication can be considered as WAN Network. A decade ago any network connecting two countries, considered as a WAN network, and a network within a city as MAN and soon. But these days in general any long distance communication is considered as WAN Network. Such as your Mobile communication networks, Satellite networks, Space Networks (Deep space networks), Trans-Atlantic cable networks, etc.

Demo TOFFEE-DataCenter WAN Optimization VM Test Setup ↗
Saturday' 13-Mar-2021

TOFFEE (and TOFFEE-DataCenter) deployment in Large Infrastructure and or ISP Networks ↗
Saturday' 13-Mar-2021
Large Infrastructure or ISP setup: In case if you are an ISP and interested in deploying a large customer WAN Optimized network or an add-on enhanced (WAN Optimized) network for select few customers, then you can deploy something as shown below. Although this case is not meant for hobby/DIY users. This is a feasible solution for high-end professional application and the same can be deployed.

Setting up a WAN Emulator within VirtualBox ↗
Saturday' 13-Mar-2021



Grid Hosting vs CDN Hosting ↗
Saturday' 13-Mar-2021

TOFFEE Data-Center WAN Optimization deployment in Big Data Analytics ↗
Saturday' 13-Mar-2021

Off-Grid Solar Power System for Raspberry Pi ↗
Saturday' 13-Mar-2021
When you choose to use your Raspberry Pi device as your IoT based remote weather station or if you are building Linux kernel (like kernel compilation) within the same, you need a good uninterrupted power source (UPS). But if you are using it on site or in some research camping location you can choose to power your Raspberry Pi device with your custom off-grid solar power source.

TrueBench - Linux CPU Benchmarking system ↗
Saturday' 13-Mar-2021
TrueBench is an unique open-source benchmarking system in which the core system performance and efficiency parameters are measured at extreme high resolution in the order of several million/billion ยต-seconds for a given specific task. TrueBench is a part of The TOFFEE Project research.



Featured Educational Video:
Watch on Youtube - [435//1] 0x1d3 Who gets Laid off (or Fired) during a recession ? #TheLinuxChannel #KiranKankipati ↗

First TOFFEE-Butterscotch Code Release ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch is a variant of TOFFEE can be used to save and optimize your Home/SOHO Internet/WAN bandwidth. Unlike TOFFEE (and TOFFEE-DataCenter) TOFFEE-Butterscotch is a non peer-to-peer (and asymmetric) network optimization solution. This makes TOFFEE-Butterscotch an ideal tool for all Home and SOHO users.

Off-Grid Home Lab Research Solar Installation ↗
Saturday' 13-Mar-2021

Riverbed and Silver Peak WAN Optimization vs TOFFEE-DataCenter (TOFFEE and or TrafficSqueezer) - FAQ ↗
Saturday' 13-Mar-2021

Streaming CDN Types ↗
Saturday' 13-Mar-2021



Watch on Youtube - [466//1] 158 VLOG - TOFFEE WAN Optimization Software Development live update - 6-Nov-2016 ↗

Live demo - Data Transfer - High bandwidth to Low bandwidth ↗
Saturday' 13-Mar-2021
I always wanted to do some real experiments and research on packet flow patterns from High-bandwidth to Low-bandwidth networks via networking devices. This is something can be analyzed via capturing Network stack buffer data and other parameters, bench-marking, and so on. But eventually the data-transfer nature and other aspects is often contaminated due to the underlying OS and the way Network stack is implemented. So to understand the nature of packet flow from Higher to Lower bandwidth and vice-versa such as Lower to higher bandwidth, I thought I experiment with various tools and things which physically we can observe this phenomena.



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server