TOFFEEプロジェクト
ホームドキュメンテーション更新ビデオ研究ダウンロードスポンサー接触


RESEARCH 》 Building my own CDN - Moving away from Joomla to non-Joomla website - Update: 01-Oct-2016

Its been a roller-coaster month (the entire Sep-2016), if you understand and believe in astrology you may well know the reason why. There are couple of eclipses and then there is the Mercury retrograde. Mercury retrograde started around in the month of Aug-30th and it was straight by around Sep-22-25th-2016. If there is a Mercury retrograde we need to be prepared to face any sort of equipment damage, equipment breakdown, downtime, loss of data, hard-disk corruption and so on. And coincidentally we can see there are lot of Samsung's exploding Galaxy Note 7s and exploding Samsung Washing-machine incidents.

Strangely I too had an issue with the entire The TOFFEE Project website (on 25-Sep-2016). Seems there are couple of Inmotionhosting servers are down. And one of the server includes The TOFFEE Project website hosted server. I was in touch with the Inmotionhosting team trying to resolve the same. I found a unique issue that all my website files are intact and the Joomla database. But the Joomla database tables are completely wiped out and missing. Besides there is also a sort of upgrade going on in their servers. Once I communicated with them they requested me to authorize so that they can restore the database from their existing backups. They informed me that they take backups at specific intervals. But no one is sure if that includes recent periodic changes I did in the website.

Luckily I have the most recent backup of the entire website. And just couple of days before this downtime I did couple of minor changes and I forgot to take the full site backup after this change. Luckily this change is trivial. So I requested them to ignore my request. And I gone ahead and restored the Joomla database myself from my own snapshot/backup which I had it in my NAS. From that moment I decided I am done with Joomla. I need to move away from Joomla to non-Joomla The TOFFEE Project website.

And in case if you guys are using Inmotionhosting hosting, then at any given point in time they have this great page http://status.inmotionhosting.com. This shows the live status of the Inmotionhosting. If there is any network or server issue they will list here. And before you contact their customer support you can once check the status of your hosted server here. In most cases they may be well aware of this situation/issue and may display over here.
Live Status Inmotionhosting

Moving away from Joomla: The site on that day is completely down for around 12-hours. Since I am anyway thinking about building my own CDN, this incident is a great learning curve. Joomla is great in terms of managing small to medium website(s). But since Joomla manages your content in the database it is an added stress to the server for each page request. And if there is an issue with the database, the site will completely vanish in a blink of an eye. As it happened in my case too. And during this time it will show a nasty mysql connect issue error which looks embarrassing and ugly. And this happens if there is excess load on the server or the database engine.

Besides it is also cumbersome in Joomla managing additional components such as customized tables, scripts, frames, etc. There are workarounds, but it is often inflexible, redundant and cumbersome. And this is the case happened to me while I was inserting Google Adsense ADs. The ADs are appearing out of the article boundary in smart-phones and tabs especially in the portrait mode. I got a warning from the Google Adsense team about it. But I was completely clueless how to solve this weired issue in Joomla. Luckily I found a solution that there are these Responsive ADs which addresses this problem. Finally after I did changes things started looking better. Apart from this there are also issues in case if you are looking for any extensive customization in terms of managing your article categories, etc. Not that they are impossible in Joomla, but they are tricky to do so and you need to repeat these steps all over again for each article/category.

Joomla is troublesome when you are building your own CDN too. Since you cannot extensively control the dynamic links/resources/etc. However if you purchase third-party CDN services, by installing Joomla extensions/plug-ins you can deploy over a CDN. But it is still tricky and challenging. In my case it is out of question. So this is also one of the reasons I took a decision to move away from Joomla and build my own PHP-based website from scratch.

Screenshot of old The TOFFEE Project website built with Joomla:
Screenshot of old The TOFFEE Project website built with Joomla

and as you know here is the screenshot of the The TOFFEE Project website built from scratch with PHP:
Screenshot of old The TOFFEE Project website built from scratch with PHP

While this transition I have also changed the Logo and the theme from Brown to vibrant Orange. With this change the website looks spacious, dynamic, vibrant, and the orange theme allows the website links stand out unlike the old brown theme links. Since it is entirely custom written website it is easy in future to write further automated scripts to spread the website (contents/resources) on a custom built CDN infrastructure. We can load-share, redirect/point images/resources to different dedicated CDN node(s), if the main website is facing glitches, we can redirect to different CDN node(s). We can host multiple CDN nodes on multiple web-hosting provider servers. We can even modify the DNS-entry to point to a different hosting server whenever it is needed or if the main site (hosting server) is down.

Here is my live video log of the same:



Suggested Topics:


Generic CDN


Building my own CDN

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


おすすめトピック:

TOFFEE-Mocha - WAN Emulator :: TOFFEE-MOCHA-2.0.3-0-10-nov-2018-x86-64.iso ↗
Saturday' 13-Mar-2021
Download TOFFEE-MOCHA-2.0.3-0-10-nov-2018-x86-64.iso via Google Drive share: Live bootable x86-64 Debian Stretch 9.5 with light-weight LXDE UI ISO (includes source-code): TOFFEE-MOCHA-2.0.3-0-10-nov-2018-x86-64.iso You can find the source tar-ball in the /root folder. To know more about the project kindly refer TOFFEE- Mocha: News and Updates - Documentation. To know more about current specific release, objectives, features, release notes/updates, quick demo and future road-map, you can watch my video below.

TOFFEE deployment topology guide ↗
Saturday' 13-Mar-2021
Assume you have two sites (such as Site-A and Site-B) connected via slow/critical WAN link as shown below. You can optimize this link by saving the bandwidth as well possibly improve the speed. However, the WAN speed can be optimized only if the WAN link speeds are below that of the processing latency of your TOFFEE installed hardware. Assume your WAN link is 12Mbps, and assume the maximum WAN optimization speed/capacity of Raspberry Pi is 20Mbps, then your link will get speed optimization too. And in another case, assume your WAN link is 50Mbps, then using the Raspberry Pi as WAN Optimization device will actually increase the latency (i.e slows the WAN link). But in all the cases the bandwidth savings should be the same irrespective of the WAN link speed. In other words, if you want to cut down the WAN link costs via this WAN Optimization set up, you can always get it since it reduces the overall bandwidth in almost all the cases (including encrypted and pre-compressed data).

Introducing TOFFEE-Butterscotch - Save and Optimize your Internet/WAN bandwidth ↗
Saturday' 13-Mar-2021
TOFFEE-Butterscotch yet another variant of TOFFEE can be used to save and optimize your Home/SOHO Internet/WAN bandwidth. Unlike TOFFEE (and TOFFEE-DataCenter) TOFFEE-Butterscotch is a non peer-to-peer (and asymmetric) network optimization solution. This makes TOFFEE-Butterscotch an ideal tool for all Home and SOHO users.

TOFFEE WAN Optimization software development, roadmap, live-demo - Update: 06-Nov-2016 ↗
Saturday' 13-Mar-2021
Here are some of the screenshots of the new upcoming TOFFEE WAN Optimization release and live demo.

TOFFEE-Mocha WAN Emulation software development - Update: 1-July-2016 ↗
Saturday' 13-Mar-2021
Today I got a feature request from Jonathan Withers. Jonathan is from a company called MultiWave Australia. He said he is able to get the TOFFEE-Mocha Raspberry Pi setup up and with that he is able to emulate geostationary satellite link. But he requested me is there a way to extend the constant packet delay from 40mS to 500mS. So as a part of his request I supported the same in the current ongoing development version of TOFFEE-Mocha.

Live demo - Data Transfer - High bandwidth to Low bandwidth ↗
Saturday' 13-Mar-2021
I always wanted to do some real experiments and research on packet flow patterns from High-bandwidth to Low-bandwidth networks via networking devices. This is something can be analyzed via capturing Network stack buffer data and other parameters, bench-marking, and so on. But eventually the data-transfer nature and other aspects is often contaminated due to the underlying OS and the way Network stack is implemented. So to understand the nature of packet flow from Higher to Lower bandwidth and vice-versa such as Lower to higher bandwidth, I thought I experiment with various tools and things which physically we can observe this phenomena.

Youtubeで見る - [174//1] 306 - Introducing TOFFEE-Fudge - Network Packet Generator ↗


Tracking Live Network Application Data - in a WAN Acceleration (WAN Optimization) Device ↗
Saturday' 13-Mar-2021

TrueBench - Linux CPU Benchmarking system ↗
Saturday' 13-Mar-2021
TrueBench is an unique open-source benchmarking system in which the core system performance and efficiency parameters are measured at extreme high resolution in the order of several million/billion µ-seconds for a given specific task. TrueBench is a part of The TOFFEE Project research.

Amazon Prime video - Video Acceleration No more Buffering Problems - WAN Acceleration ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha Documentation :: TOFFEE-Mocha - Jitter feature ↗
Saturday' 13-Mar-2021



Featured Educational Video:
Youtubeで見る - [913//1] x23b 802.3x Ethernet Flow Control | L2 multicast | Switching protocols ↗

TOFFEE-Mocha Documentation :: TOFFEE-Mocha-1.0.18-1-x86_64 ↗
Saturday' 13-Mar-2021

Building my own CDN - Finally Completed - Update: 17-Dec-2017 ↗
Saturday' 13-Mar-2021
Today I finally completed building my own private CDN. As I discussed so far in my earlier topics (Building my own CDN), I want to custom build the same step-by-step from scratch. And I don't want to for now use/buy third-party CDN subscriptions from Akamai, CloudFlare, Limelight, etc as I discussed earlier.

CDN Hosting ↗
Saturday' 13-Mar-2021
It is quite interesting that there are few web hosting firms are offering direct CDN based hosting services. Since it is a direct CDN based hosting, it is cheap, extremely easy or transparent CDN service. It is transparent, since each time you publish your content in the hosting web-server (origin server), it is immediately is in sync automatically in the user-serving CDN caching machines. Since the hosting vendor and the CDN vendor are all the same, it is also easy to use their services. There is no incompatibility issues, interoperability issues, and better integrated analytics, are all the benefits of CDN Hosting services.

TOFFEE Download :: TOFFEE-1.1.70-1-portable ↗
Saturday' 13-Mar-2021




Internet optimization through TOFFEE-DataCenter WAN Optimization Demo ↗
Saturday' 13-Mar-2021



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server