Public or Private? IPv6 must lead the way.

July 1st, 2009

Should servers have public IP addresses, private IP addresses, or a mix of both?

I decided to blog this interesting topic that was brought up by a friend some time ago. How do you manage servers on the cloud? A simple decision such as using either public or private IP addresses could end in a disaster if not well managed.

For the past decade, the use of private IP addresses have been increasingly popular as public IP addresses in IPv4 are running out. It has also become a common security requirement to have servers in a “private” subnet sitting behind a firewall.

That sounds pretty OK for maybe 5, 10, even up till 50 servers. But what happens when you have 1000 servers?

Sure, you have VPNs from California to your headquarters in New York, and another VPN from your branch office in Singapore and Malaysia to a regional HQ in Hong Kong, and then a huge VPN from NY to Hong Kong carrying all trans-atlantic traffic. Oh, we’ll also need some monitoring systems in Hong Kong to monitor those in the SEA region, and another bunch in NY for USA. We’ll also need to get some servers in Germany to monitor our public services because we have quite a bit of customers there, and it costs too much for us to put a Point of Presence (POP) in Europe.

As your network grows, the VPN mess grows, so does monitoring and management. You have private IP addresses assigned by all sorts of systems integrators all over the world, some use 10.0.0.0/8, some use 172.16.0.0/12, some 192.168.0.0/16.

One day the Singapore office calls up. They can’t hook up to a server California. Oh where did that 10.23.55.0/24 route go?

Let’s face it. VPNs are a mess. They carry IP in a tunnel, encrypted or not, in an existing IP payload. Nevermind the overhead, but that also means routing is done TWICE. Why pay thousands on one, no, TWO (for redundancy, heh) Cisco routers to handle routing for all that VPN traffic within your internal networks when the job of getting the packet across the globe has already been done by a huge router sitting in the ISP?

Why even pay thousands for one, no, I beg your pardon, TWO firewalls with lots of RAM to hold NAT state tables for your public-facing servers?

Costs aside, these additional equipments also contribute to environmental factors such as power consumption.

So if you are a new startup venturing into the “cloud”, make a conscious decision to have all servers run public IP address. When time comes for management, monitoring, or even an IPv6 migration, you will be on the right path.

On a final note, IPv6 needs more support, especially from the government; imagine the day we could all throw out that Linksys sitting in our bedroom and have a public IP address on each computer. No more NAT, no more port forwarding, no more DMZ bullshit. Finally, UDP could realize its full potential. Cut the overheads from VPNs; seriously, somebody should do a research paper on how much encryped VPN payload could be saved by IPv6.

THIS ARTICLE IS PARTIALLY COMPLETE, I WILL CONTINUE TO EDIT IT…

P2P is the Future

May 5th, 2009

P2P technology is everywhere. From data to video - almost any data medium can be delivered via P2P. With 10 gigabit ethernet becoming commonplace in ISPs, there’s no stopping P2P from becoming the next big thing on the Internet.

What I forsee in the near future:
* ISPs no longer maintain large server farms for caches and e-mails
* Our computers automatically participates in a large P2P network sharing compute, memory and storage for a single application (e.g. e-mail)
* Our home appliances (game consoles, TV) runs P2P
* IPv6 will start to prevail with the need for public IP addresses

On Linux RAID and LVM

March 29th, 2009

In an earlier blog entry on how we evaluated various virtualization technologies, I also wrote about using Linux Software RAID (md) instead of FAKERAID/HOSTRAID.

RAID as most know it is a technology that allows the grouping for multiple physical hard drives into one logical drive for either redundancy, performance or both. But the technology is not without caveats.

Read the rest of this entry »

The Cost of High Availablity

March 28th, 2009

So here I am once again sitting in a meeting room of an ISP with some 4 or 5 executives, salesguys , product guys and a bunch of other engineers discussing how we should set up HA. The entire project’s network was drawn up on a white board and three engineers stood by the sides. They were pointing at every link and node in the diagram and asking, “is this HA?”

You’d be surprised how long these discussions can take. It went on for about two hours and one dude finally broke the tension and stood up, and we thought he was headed for the washroom but he said instead, “what’s the point of all these? With all these costs, will the service even sell?”

He hit the nail. The room was quiet for a moment.

Read the rest of this entry »

The Crisis of Credit Visualized

March 24th, 2009

Non-tech related, but affects everybody. This is a great video explaining the credit crisis. If you can’t see it, go here.


The Crisis of Credit Visualized from Jonathan Jarvis on Vimeo.

VMware ESX 3i, VMware Server 2.0, Citrix XenServer or Sun xVM VirtualBox?

March 18th, 2009

With our growing customer base and usage, Securlogic just purchased another Sun Fire X2100. The shipment arrived on Monday and I have been running around town trying to loan a USB keyboard and struggling to get the box to boot off a USB disk. ESX 3i simply refuses to boot so I got it running with a copy of CentOS 5 (LiveCD) using the Fedora Live USB Creator. Lesson learnt - keep a USB keyboard or a USB to PS/2 converter near you and don’t buy a server without a DVD drive.

Meanwhile, the virtualization infrastructure is due for an upgrade (we’re still on VMware Server 1.x). I’m evaluating VMware ESX 3i, VMware Server 2.0 (on CentOS 5.2), Citrix XenServer and Sun xVM VirtualBox and I’ll just drop a few quick pointers for those who are going though the same process as I am.

Read the rest of this entry »

Recycling The Internet’s Bandwidth

March 3rd, 2009

I was chatting with a guest from US the other day and he brought up an interesting point. In many countries like Singapore, the Internet is the only common household utility that charges a flat fee and we could use as much as we wanted. Pretty much all around the globe people still pay a unit price for power, water, gas, TV and phone.

So what makes the Internet different?

Read the rest of this entry »