TOFFEE项目
文档更新影片研究下载赞助商联系


RESEARCH 》 A study on Deep Space Networks (DSN)

When you are dealing Deep Space Networks (DSN) one among the most challenging parts is the Interplanetary distances and communicating data across such vast distances. This is where we are not dealing with common Internet type traffic such as HTTP/FTP/VoIP/etc but it is completely different when it comes to DSN so far. So optimizing data in DSN becomes mandatory. For example if you think one of the Mars Rovers, they have used LZO lossless compression. Although they do to an extent lossy compression on images shot by these space-probes at times they we may also need high-resolution detailed high-quality images. And sometimes it is not just photos sent back to the earth, at times the space probes may also report their health status, keep alive messages as well transmit the scientific research data such as data recorded in various sensors situated on-board.

Although we got space probes across the space and ISS (International Space Station) orbiting over Earth, we do not have a scenario yet something like human colonies/bases on Moon or Mars and other planets. Eventually when such things happen in around 2020-2030 or so as the way NASA and scientists predict, DSN is going to be a case where more private companies may offer their solutions. But before that we need to still solve some of the fundamental data communication challenges involved in DSN. This is on of the fields which I am actively involved since a decade.

Unlike here on Earth upgrading a piece of hardware or communication technology is just impossible to do on a space probe which may exist millions of miles away from Earth. This also makes this technology evolve quite slowly unlike Earth bound communication technologies such as Mobile communications, Satellite networks and so on. For further complete coverage of this topic kindly refer my below detailed video titled Deep Space Communication - Episode1.

Understanding Communication Speeds: Most DSN networks are radio-wave signal based and not light (photonic) based communication. Radio waves do not travel at the speed of light. It is also one of the reason for the slow-down of the DSN unlike ground or earth bound fibre optic links since in this case data travels almost (since the medium is not vacuum and speed of light depends on the medium) at the speed of light. Before we imagine network speeds in DSN, let us understand an ideal situation of speed of light between two points in space:

Distance Speed of Light
Earth <> Moon1.5 seconds
Earth <> Mars4 minutes (240 seconds)
Earth <> Sun8 minutes (480 seconds)
Earth <> Jupiter30 minutes (1800 seconds)
Earth <> Saturn1 hour (3600 seconds)
Earth <> Neptune4 hours (14400 seconds)
Earth <> Pluto4.6 hours (16560 seconds)

NOTE: Since we compute network speeds often in bits/sec (and latency in nano-seconds and milli-seconds), in the above chart I am converting everything in seconds to understand the scale.

So based on the above chart now we can understand the scale of complexity in DSN. This underscores a fundamental limitation of physics !

Communication Protocols for DSN: For DSN a complete new set of protocols are defined which is SCP (stands for Space Communications Protocol). There are various RFCs which are defined which is called as SCPS (where S stands for Specifications). There are various variants under SCPS are defined such as SCPS-FP, SCPS-TP, SCPS-SP and SCPS-NP. The biggest difference you may find in DSN is that the delay involved due to inter-planetary distances. So based on the distance you may experience communication delays, loss of packets, etc. Say for example if you think a successful connection is established (for example a TCP session/connection), you may have to-and-fro keep alive acknowledgement packets exchanged every few milliseconds. But whereas in a case of DSN you may experience this happening every few minutes or every few hours. So that is how bizarre it is. Although there is no packet exchanges happening in few minutes or hours you should understand this is due to vast distances involved.

These SCPS specifications are defined by a committee called as CCSDS (stands for Consultative Committee for Space Data Systems). This is a body which is formed as per collaborative effort of various space agencies across the world. An Internet spanning across multiple planets is termed as IPN (stands for Interplanetary Network or in short InterPlanet). For further complete coverage of this topic kindly refer my below detailed video titled Deep Space Communication - Episode2.

Lossless Compression Algorithms for DSN: A specific set of tailor made algorithms are required for space communications unlike the ones which are used in communications here on Earth. They have to be light-weight and at the same time super-efficient and should have least processing latencies. The communication data could be just anything such as scientific research data collected via space probe sensors or it could be hi-resolution photos sent back to earth or it could be commands sent to these probes via ground control crew. I have done extensive research on this for almost more than a decade on various lossless compression algorithms. This is a case where we are dealing optimizing real-time data. This is not a passive file compression something like creating a tar-ball or some zipfile. This is a case you are sending and receiving packets continuously and you are processing them in real-time.

NASA have their own lossless compression variants and often they are customized. One of the well known algorithms which NASA uses is the LOCO-I (stands for Low Complexity Lossless Compression) which is mainly meant for compressing images. LOCO-I is a kind of lossless compression variant of JPEG. Which is why it is also can be sometimes called as JPEG-LS (stands for JPEG-Lossless). Based on LOCO-I NASA did hardware based solution which is FPGA-LOCO. Since it is hardware based, it is good in performance, reliability and extremely energy efficient.

Apart from this CCSDS have their own variant of RICE lossless compression algorithm. For further complete coverage of this topic kindly refer my below detailed video titled Space Lossless Compression.

References:

NASA:

Wikipedia:

Other:



Suggested Topics:


WAN Optimization and Network Optimization

💎 TOFFEE-MOCHA new bootable ISO: Download
💎 TOFFEE Data-Center Big picture and Overview: Download PDF


推荐主题:

INDEX :: Content Delivery Networks or Content Distribution Networks (CDN) ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha Documentation :: TOFFEE-Mocha-1.0.14-1-x86_64 ↗
Saturday' 13-Mar-2021

Off-Grid Solar Power System for Raspberry Pi ↗
Saturday' 13-Mar-2021
When you choose to use your Raspberry Pi device as your IoT based remote weather station or if you are building Linux kernel (like kernel compilation) within the same, you need a good uninterrupted power source (UPS). But if you are using it on site or in some research camping location you can choose to power your Raspberry Pi device with your custom off-grid solar power source.

PiPG - Raspberry Pi Network Packet Generator ↗
Saturday' 13-Mar-2021
PiPG is a powerful and yet simple Raspberry Pi Network Packet Generator. With PiPG you can now fabricate custom network packets and send via any Network Interface. Supports all kinds of standard Network Ports (Linux Kernel driver generated) such as Physical Network Interface ports, and an array of virtual ports such as loopback, tun/tap, bridge, etc. indispensable tool for: Network Debugging, Testing and Performance analysis Network Administrators Students Network R&D Protocol Analysis and Study Network Software Development Compliance Testing Ethical Hackers you can generate the following test traffic: L2-Bridging/Slow protocols: STP, LACP, OAM, LLDP, EAP, etc Routing protocols: RIPv1, RIPv2, IGMPv1, IGMPv2, OSPF, IS-IS, EIGRP, HSRP, VRRP, etc Proprietary protocols: CISCO, etc Generic: IPv4 TCP/UDP, etc Malformed random packets

TCP Tune-up and Performance Analysis Graphs - Congestion Control - Research - Dos and Don'ts ↗
Saturday' 13-Mar-2021

TOFFEE-Mocha WAN Emulation software development - Update: 19-July-2016 ↗
Saturday' 13-Mar-2021
Today I refined the first page consolidated report graphs. TOFFEE-Mocha (unlike TOFFEE) is a WAN Emulator, so the graphs are supposed to highlight this purpose and should display the overall network activity. Unlike TOFFEE, the TOFFEE-Mocha report should contain in general what is received versus what is sent across the wire. In case if the packet drop feature is enabled, you should see few missing bytes and packets. Similarly in future I may support packet duplication feature, in that case you may see more packets/bytes sent versus the packets/bytes actually received.



TOFFEE-Mocha WAN Emulator Jitter Feature ↗
Saturday' 13-Mar-2021

TOFFEE-DataCenter :: Optimized ISP backbone networks for countries with slowest Internet Speed ↗
Saturday' 13-Mar-2021

First TOFFEE Code Release ↗
Saturday' 13-Mar-2021
I started working on the new TOFFEE project (which is the fork of my earlier TrafficSqueezer open-source project) starting from 1st January 2016 onwards. Ever since I was busy in research and altering certain old features so that it is more minimal than TrafficSqueezer, a more focused agenda, deliver refined code and a broader vision. I have lined up more things to follow in the upcoming months. I want to focus about all aspects of WAN communication technologies not just on core WAN Optimization research and technology.

TOFFEE-DataCenter a TOFFEE variant for Data Center applications ↗
Saturday' 13-Mar-2021



Featured Educational Video:
在YouTube上观看 - [8613//1] x254 Kernel Init Code without Kernel Module - Kernel Programming Tip #linode ↗

TOFFEE-Mocha WAN Emulation software development - Update: 17-June-2016 ↗
Saturday' 13-Mar-2021
Now I supported and finished complete GUI support of these parameters so that you can configure, store, reboot and the same will restore upon reboot. Besides I complete the TOFFEE-Mocha Big-Picture page. The Big picture is an interface where you can find all the configuration (or settings) of the TOFFEE-Mocha. This is almost similar to CISCO device show all command but in graphical representation. Sometimes a network admin can also print the Big Picture page and paste it near to the device to refer its settings.

Live demo - Data Transfer - High bandwidth to Low bandwidth ↗
Saturday' 13-Mar-2021
I always wanted to do some real experiments and research on packet flow patterns from High-bandwidth to Low-bandwidth networks via networking devices. This is something can be analyzed via capturing Network stack buffer data and other parameters, bench-marking, and so on. But eventually the data-transfer nature and other aspects is often contaminated due to the underlying OS and the way Network stack is implemented. So to understand the nature of packet flow from Higher to Lower bandwidth and vice-versa such as Lower to higher bandwidth, I thought I experiment with various tools and things which physically we can observe this phenomena.

TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server ↗
Saturday' 13-Mar-2021

Timelapse Screen Capture of TOFFEE-DataCenter Network Acceleration - with new RRDtool graph support ↗
Saturday' 13-Mar-2021
Timelapse Screen Capture of TOFFEE-DataCenter Network Acceleration - with new RRDtool graph support




WAN Optimization - Animated demo of Packet Optimization in TOFFEE-DataCenter ↗
Saturday' 13-Mar-2021



Research :: Optimization of network data (WAN Optimization) at various levels:
Network File level network data WAN Optimization


Learn Linux Systems Software and Kernel Programming:
Linux, Kernel, Networking and Systems-Software online classes


Hardware Compression and Decompression Accelerator Cards:
TOFFEE Architecture with Compression and Decompression Accelerator Card [CDN]


TOFFEE-DataCenter on a Dell Server - Intel Xeon E5645 CPU:
TOFFEE-DataCenter screenshots on a Dual CPU - Intel(R) Xeon(R) CPU E5645 @ 2.40GHz - Dell Server