The TOFFEE Project
HOMEDOCUMENTATIONUPDATESVIDEOSRESEARCHDOWNLOADSPONSORSCONTACT


RESEARCH 》 Building my own CDN - Moving away from Joomla to non-Joomla website - Update: 01-Oct-2016

Its been a roller-coaster month (the entire Sep-2016), if you understand and believe in astrology you may well know the reason why. There are couple of eclipses and then there is the Mercury retrograde. Mercury retrograde started around in the month of Aug-30th and it was straight by around Sep-22-25th-2016. If there is a Mercury retrograde we need to be prepared to face any sort of equipment damage, equipment breakdown, downtime, loss of data, hard-disk corruption and so on. And coincidentally we can see there are lot of Samsung's exploding Galaxy Note 7s and exploding Samsung Washing-machine incidents.

Strangely I too had an issue with the entire The TOFFEE Project website (on 25-Sep-2016). Seems there are couple of Inmotionhosting servers are down. And one of the server includes The TOFFEE Project website hosted server. I was in touch with the Inmotionhosting team trying to resolve the same. I found a unique issue that all my website files are intact and the Joomla database. But the Joomla database tables are completely wiped out and missing. Besides there is also a sort of upgrade going on in their servers. Once I communicated with them they requested me to authorize so that they can restore the database from their existing backups. They informed me that they take backups at specific intervals. But no one is sure if that includes recent periodic changes I did in the website.

Luckily I have the most recent backup of the entire website. And just couple of days before this downtime I did couple of minor changes and I forgot to take the full site backup after this change. Luckily this change is trivial. So I requested them to ignore my request. And I gone ahead and restored the Joomla database myself from my own snapshot/backup which I had it in my NAS. From that moment I decided I am done with Joomla. I need to move away from Joomla to non-Joomla The TOFFEE Project website.

And in case if you guys are using Inmotionhosting hosting, then at any given point in time they have this great page http://status.inmotionhosting.com. This shows the live status of the Inmotionhosting. If there is any network or server issue they will list here. And before you contact their customer support you can once check the status of your hosted server here. In most cases they may be well aware of this situation/issue and may display over here.
Live Status Inmotionhosting

Moving away from Joomla: The site on that day is completely down for around 12-hours. Since I am anyway thinking about building my own CDN, this incident is a great learning curve. Joomla is great in terms of managing small to medium website(s). But since Joomla manages your content in the database it is an added stress to the server for each page request. And if there is an issue with the database, the site will completely vanish in a blink of an eye. As it happened in my case too. And during this time it will show a nasty mysql connect issue error which looks embarrassing and ugly. And this happens if there is excess load on the server or the database engine.

Besides it is also cumbersome in Joomla managing additional components such as customized tables, scripts, frames, etc. There are workarounds, but it is often inflexible, redundant and cumbersome. And this is the case happened to me while I was inserting Google Adsense ADs. The ADs are appearing out of the article boundary in smart-phones and tabs especially in the portrait mode. I got a warning from the Google Adsense team about it. But I was completely clueless how to solve this weired issue in Joomla. Luckily I found a solution that there are these Responsive ADs which addresses this problem. Finally after I did changes things started looking better. Apart from this there are also issues in case if you are looking for any extensive customization in terms of managing your article categories, etc. Not that they are impossible in Joomla, but they are tricky to do so and you need to repeat these steps all over again for each article/category.

Joomla is troublesome when you are building your own CDN too. Since you cannot extensively control the dynamic links/resources/etc. However if you purchase third-party CDN services, by installing Joomla extensions/plug-ins you can deploy over a CDN. But it is still tricky and challenging. In my case it is out of question. So this is also one of the reasons I took a decision to move away from Joomla and build my own PHP-based website from scratch.

Screenshot of old The TOFFEE Project website built with Joomla:
Screenshot of old The TOFFEE Project website built with Joomla

and as you know here is the screenshot of the The TOFFEE Project website built from scratch with PHP:
Screenshot of old The TOFFEE Project website built from scratch with PHP

While this transition I have also changed the Logo and the theme from Brown to vibrant Orange. With this change the website looks spacious, dynamic, vibrant, and the orange theme allows the website links stand out unlike the old brown theme links. Since it is entirely custom written website it is easy in future to write further automated scripts to spread the website (contents/resources) on a custom built CDN infrastructure. We can load-share, redirect/point images/resources to different dedicated CDN node(s), if the main website is facing glitches, we can redirect to different CDN node(s). We can host multiple CDN nodes on multiple web-hosting provider servers. We can even modify the DNS-entry to point to a different hosting server whenever it is needed or if the main site (hosting server) is down.

Here is my live video log of the same:



Suggested Topics:


Generic CDN


Building my own CDN

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Recommended Topics:

TrueBench - Linux CPU Benchmarking system ↗
Saturday' 13-Mar-2021
TrueBench is an unique open-source benchmarking system in which the core system performance and efficiency parameters are measured at extreme high resolution in the order of several million/billion µ-seconds for a given specific task. TrueBench is a part of The TOFFEE Project research.

Recording Lab Monthly off-grid power-consumption readings for research ↗
Saturday' 13-Mar-2021

Live demo - Data Transfer - High bandwidth to Low bandwidth ↗
Saturday' 13-Mar-2021
I always wanted to do some real experiments and research on packet flow patterns from High-bandwidth to Low-bandwidth networks via networking devices. This is something can be analyzed via capturing Network stack buffer data and other parameters, bench-marking, and so on. But eventually the data-transfer nature and other aspects is often contaminated due to the underlying OS and the way Network stack is implemented. So to understand the nature of packet flow from Higher to Lower bandwidth and vice-versa such as Lower to higher bandwidth, I thought I experiment with various tools and things which physically we can observe this phenomena.

TOFFEE with Hardware Compression and Decompression Accelerator Cards ↗
Saturday' 13-Mar-2021
You can build a basic TOFFEE WAN Optimization hardware completely in software layer (i.e its networking data-plane and control-plane). And if you are a product manufacturer you can make commercial WAN Optimization products with TOFFEE with software layer alone. And if you choose to improve its performance, you can use any third-party PCIe Compression Accelerator cards.

TOFFEE-Mocha WAN Emulation software development - Update: 15-July-2016 ↗
Saturday' 13-Mar-2021
Today I completed doing all the changes which are meant for the new upcoming TOFFEE-Mocha release. I have increased the resolution and the range of all factor variables. Instead 1 to 10 range now they have a range of 1 to 30. Unlike before the value 1 means it is lot more intense (or in some cases less intense) and the uppermost value 30 means lot less intense (or in some cases lot intense).

How to check a website using CDN ? ↗
Saturday' 13-Mar-2021



TOFFEE (and TOFFEE-DataCenter) deployment with web-proxy cache ↗
Saturday' 13-Mar-2021
If you want to deploy TOFFEE along with a web-proxy cache (such as Squid Proxy) you can deploy the same as shown below. TOFFEE does not cache files. TOFFEE does packet level network optimization. So if you want caching your web content you can use transparent mode web-proxy cache intercepting your WAN links. A web-proxy may reduce amount of data being processed (optimized) within these TOFFEE devices and so reduce the CPU overheads and improve its performance.

The TOFFEE Project :: TOFFEE-Mocha :: WAN Emulator ↗
Saturday' 13-Mar-2021
The TOFFEE Project :: TOFFEE-Mocha :: Linux Open-Source WAN Emulator

First TOFFEE-Mocha Code Release ↗
Saturday' 13-Mar-2021
TOFFEE-Mocha is my dream project which I thought working on it since several years. I want to make a WAN emulation software which is straight forward and simple to use. I used tc scripts along with iptables for testing my TOFFEE (and TrafficSqueezer before TOFFEE) and I am not quite satisfied with the same. As one can understand these scripts are not meant for WAN emulation.

TOFFEE-Mocha-1.0.32-1-x86_64 and TOFFEE-Mocha-1.0.32-1-i386 Code Release ↗
Saturday' 13-Mar-2021
This is my first TOFFEE-Mocha combined x86-64 and i386 (Intel x86 64-bit and 32-bit) code release.



Featured Educational Video:
Watch on Youtube - [943//1] x23e TrueNAS ZFS Pool Resilver over and over again issue | ZFS NAS Storage | Forever Resilver ↗

Benchmark Raspberry Pi and other embedded SoC with TrueBench ↗
Saturday' 13-Mar-2021
TrueBench is an unique open-source benchmarking system in which the core system performance and efficiency parameters are measured at extreme high resolution in the order of several million/billion µ-seconds for a given specific task. TrueBench is a part of The TOFFEE Project research. With TrueBench Raspberry Pi 3, Raspberry Pi 2B and Raspberry Pi 2 are benchmarked and you can do a comparative analysis with standard mainstream x86 devices.

MySQL Database Network Data - WAN Acceleration ↗
Saturday' 13-Mar-2021
Here is a quick demo of TOFFEE WAN Optimization optimizing MySQL Data transfers of a MySQL Client to Server Remote Access.

Internet optimization through TOFFEE-DataCenter WAN Optimization Demo ↗
Saturday' 13-Mar-2021

Building my own CDN - choosing a web-hosting to deploy my CDN - Update: 28-July-2016 ↗
Saturday' 13-Mar-2021
The TOFFEE Project website is hosted on Inmotion Hosting. And so I am looking for alternate hosting provider to build my first CDN node. My plan is to make multiple sub-domains of my website such as cdn1.the-toffee-project.org, cdn2.the-toffee-project.org and point each of this corresponding subdomain(s) to various alternative web hosting servers geographically spread across the world. Sometimes choosing the same vendor for multiple CDN nodes may result multiple servers existing in the data-center. And this becomes an issue if there is some catastrophic network disaster.




LoRaWAN - Network Optimization via TOFFEE WAN Optimization ↗
Saturday' 13-Mar-2021
LoRaWAN - Network Optimization via TOFFEE WAN Optimization



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server