O projeto TOFFEE
CASADOCUMENTAÇÃOATUALIZAÇÕESVÍDEOSPESQUISADESCARREGARPATROCINADORESCONTATO


RESEARCH 》 Building my own CDN - Moving away from Joomla to non-Joomla website - Update: 01-Oct-2016

Its been a roller-coaster month (the entire Sep-2016), if you understand and believe in astrology you may well know the reason why. There are couple of eclipses and then there is the Mercury retrograde. Mercury retrograde started around in the month of Aug-30th and it was straight by around Sep-22-25th-2016. If there is a Mercury retrograde we need to be prepared to face any sort of equipment damage, equipment breakdown, downtime, loss of data, hard-disk corruption and so on. And coincidentally we can see there are lot of Samsung's exploding Galaxy Note 7s and exploding Samsung Washing-machine incidents.

Strangely I too had an issue with the entire The TOFFEE Project website (on 25-Sep-2016). Seems there are couple of Inmotionhosting servers are down. And one of the server includes The TOFFEE Project website hosted server. I was in touch with the Inmotionhosting team trying to resolve the same. I found a unique issue that all my website files are intact and the Joomla database. But the Joomla database tables are completely wiped out and missing. Besides there is also a sort of upgrade going on in their servers. Once I communicated with them they requested me to authorize so that they can restore the database from their existing backups. They informed me that they take backups at specific intervals. But no one is sure if that includes recent periodic changes I did in the website.

Luckily I have the most recent backup of the entire website. And just couple of days before this downtime I did couple of minor changes and I forgot to take the full site backup after this change. Luckily this change is trivial. So I requested them to ignore my request. And I gone ahead and restored the Joomla database myself from my own snapshot/backup which I had it in my NAS. From that moment I decided I am done with Joomla. I need to move away from Joomla to non-Joomla The TOFFEE Project website.

And in case if you guys are using Inmotionhosting hosting, then at any given point in time they have this great page http://status.inmotionhosting.com. This shows the live status of the Inmotionhosting. If there is any network or server issue they will list here. And before you contact their customer support you can once check the status of your hosted server here. In most cases they may be well aware of this situation/issue and may display over here.
Live Status Inmotionhosting

Moving away from Joomla: The site on that day is completely down for around 12-hours. Since I am anyway thinking about building my own CDN, this incident is a great learning curve. Joomla is great in terms of managing small to medium website(s). But since Joomla manages your content in the database it is an added stress to the server for each page request. And if there is an issue with the database, the site will completely vanish in a blink of an eye. As it happened in my case too. And during this time it will show a nasty mysql connect issue error which looks embarrassing and ugly. And this happens if there is excess load on the server or the database engine.

Besides it is also cumbersome in Joomla managing additional components such as customized tables, scripts, frames, etc. There are workarounds, but it is often inflexible, redundant and cumbersome. And this is the case happened to me while I was inserting Google Adsense ADs. The ADs are appearing out of the article boundary in smart-phones and tabs especially in the portrait mode. I got a warning from the Google Adsense team about it. But I was completely clueless how to solve this weired issue in Joomla. Luckily I found a solution that there are these Responsive ADs which addresses this problem. Finally after I did changes things started looking better. Apart from this there are also issues in case if you are looking for any extensive customization in terms of managing your article categories, etc. Not that they are impossible in Joomla, but they are tricky to do so and you need to repeat these steps all over again for each article/category.

Joomla is troublesome when you are building your own CDN too. Since you cannot extensively control the dynamic links/resources/etc. However if you purchase third-party CDN services, by installing Joomla extensions/plug-ins you can deploy over a CDN. But it is still tricky and challenging. In my case it is out of question. So this is also one of the reasons I took a decision to move away from Joomla and build my own PHP-based website from scratch.

Screenshot of old The TOFFEE Project website built with Joomla:
Screenshot of old The TOFFEE Project website built with Joomla

and as you know here is the screenshot of the The TOFFEE Project website built from scratch with PHP:
Screenshot of old The TOFFEE Project website built from scratch with PHP

While this transition I have also changed the Logo and the theme from Brown to vibrant Orange. With this change the website looks spacious, dynamic, vibrant, and the orange theme allows the website links stand out unlike the old brown theme links. Since it is entirely custom written website it is easy in future to write further automated scripts to spread the website (contents/resources) on a custom built CDN infrastructure. We can load-share, redirect/point images/resources to different dedicated CDN node(s), if the main website is facing glitches, we can redirect to different CDN node(s). We can host multiple CDN nodes on multiple web-hosting provider servers. We can even modify the DNS-entry to point to a different hosting server whenever it is needed or if the main site (hosting server) is down.

Here is my live video log of the same:



Suggested Topics:


Generic CDN


Building my own CDN

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


Tópicos recomendados:

TOFFEE (and TOFFEE-DataCenter) deployment with VPN devices ↗
Saturday' 13-Mar-2021
In case if you need to deploy TOFFEE along with your existing VPN devices you can deploy the same as shown below. This will allow your VPN devices to encrypt your TOFFEE WAN Optimized network data. NOTE: Make sure about the VPN deployment topology done in the right order. Else TOFFEE (LAN side) may get VPN encrypted packets which may not be possible (and or difficult) to further optimize. Hence always make sure to deploy them in a topology suggested below so that TOFFEE devices are out of VPN tunnel.

Demo TOFFEE-DataCenter WAN Optimization VM Test Setup ↗
Saturday' 13-Mar-2021

Internet optimization through TOFFEE-DataCenter WAN Optimization Demo ↗
Saturday' 13-Mar-2021
Internet optimization through TOFFEE-DataCenter WAN Optimization Demo

Replacing in Lab Intel Core i7 5820K Desktop PC with Intel Celeron 1037U Mini-PC ↗
Saturday' 13-Mar-2021
As a research experiment I replaced my Intel Core i7 5820K desktop PC with my Intel Celeron 1037U Mini-PC as my everyday desktop system. This is an attempt to reduce my overall monthly power consumption. As well an attempt to do feasibility tests and research to know how far Mini PC will dominate the market in future and to study the real potential of Mini PCs.

TrueBench - Linux CPU Benchmarking system ↗
Saturday' 13-Mar-2021
TrueBench is an unique open-source benchmarking system in which the core system performance and efficiency parameters are measured at extreme high resolution in the order of several million/billion µ-seconds for a given specific task. TrueBench is a part of The TOFFEE Project research.

TOFFEE (and TOFFEE-DataCenter) optimized Wireless Mesh-Networks - B.A.T.M.A.N [open-mesh.org (Open Mesh)] ↗
Saturday' 13-Mar-2021
TOFFEE/TOFFEE-DataCenter can be used to optimize Ad-Hoc Mobile Wireless Mesh-Networks. To learn more about the same here are some references: B.A.T.M.A.N. - https://en.wikipedia.org/wiki/B.A.T.M.A.N. Mobile ad hoc network (MANET) - https://en.wikipedia.org/wiki/Mobile_ad_hoc_network Wireless ad hoc network (WANET) - https://en.wikipedia.org/wiki/Wireless_ad_hoc_network open-mesh.org (Open Mesh) Wiki - https://www.open-mesh.org/projects/open-mesh/wiki

Assista no Youtube - [1852//1] Deep Space Communication - Episode1 - Introduction ↗


TOFFEE hardware selection guide ↗
Saturday' 13-Mar-2021
When you build a WAN Optimization device with TOFFEE the entire packet processing (data optimization) takes place in software layer or in other words more precisely Operating System kernel space. However if you have any compression or encryption hardware accelerator hardware card the parts of the TOFFEE packet processing modules can be offloaded to hardware layer and thus improving its efficiency.

Network MTU research and optimization of WAN Links ↗
Saturday' 13-Mar-2021
Network MTU research and optimization of WAN Links

Introducing TOFFEE-Fudge - Network Packet Generator ↗
Saturday' 13-Mar-2021
TOFFEE Fudge is a simple intuitive Network Packet Generator which can be used to create custom test synthetic Network Packets and can be used in various applications such as networking research, network infrastructure troubleshooting, ethical hacking, as a network software development tool and so on.

TOFFEE-Mocha Documentation :: TOFFEE-Mocha-1.0.14-1-x86_64 ↗
Saturday' 13-Mar-2021



Featured Educational Video:
Assista no Youtube - [4798//1] 238 Opening Western Digital WD My Passport Essential 320GB WD3200MEW-00 - 2008 USB Drive ↗

Bufferbloat in a Networking Device or an Appliance ↗
Saturday' 13-Mar-2021

TOFFEE Download :: TOFFEE-1.1.70-1-portable ↗
Saturday' 13-Mar-2021

Optimization of network data (WAN Optimization) at various levels ↗
Saturday' 13-Mar-2021
WAN Network data can be optimized at various levels depending upon the network applications, protocols, topology and use-cases. So the amount of data you can optimize will depend on the strategy you choose to optimize. Such as: Network Packet level optimization, Session level optimization, File level optimization, etc.

TOFFEE deployment topology guide ↗
Saturday' 13-Mar-2021
Assume you have two sites (such as Site-A and Site-B) connected via slow/critical WAN link as shown below. You can optimize this link by saving the bandwidth as well possibly improve the speed. However, the WAN speed can be optimized only if the WAN link speeds are below that of the processing latency of your TOFFEE installed hardware. Assume your WAN link is 12Mbps, and assume the maximum WAN optimization speed/capacity of Raspberry Pi is 20Mbps, then your link will get speed optimization too. And in another case, assume your WAN link is 50Mbps, then using the Raspberry Pi as WAN Optimization device will actually increase the latency (i.e slows the WAN link). But in all the cases the bandwidth savings should be the same irrespective of the WAN link speed. In other words, if you want to cut down the WAN link costs via this WAN Optimization set up, you can always get it since it reduces the overall bandwidth in almost all the cases (including encrypted and pre-compressed data).



Assista no Youtube - [192//1] 306 - Introducing TOFFEE-Fudge - Network Packet Generator ↗

TOFFEE-Mocha WAN Emulation software development - Update: 20-Oct-2016 ↗
Saturday' 13-Mar-2021
I was doing some specific tests in my TOFFEE and TOFFEE-DataCenter (WAN optimization) scenarios such as variable upload and download speeds. And I was also doing some experiments with speedtest.net and I did some of these tests with TOFFEE-Mocha. I realized there is a case that I can introduce asymmetric constant delays so that you can get different download speed and a different upload speed. And in some cases much faster download speeds and relatively slower upload speeds.



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes [CDN]


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server