23
Jul
I had a chat with Joe Stump to talk about SimpleGeo, Cassandra, and Digg. Joe also talks about why the cloud is cheaper, even when you get to a bigger scale.
Show Notes
- SimpleGeo is a cloud service for location based stuff, similar to Twilio or Sendgrid.
- The idea for SimpleGeo came out of a location game. Real time background location services push 4mb/sec of data for 500k users
- Joe thinks overall Amazon web services is cheaper because of reserved instances and the hidden cost of personnel to spec hardware and contracts for bare metal servers
- SimpleGeo is using Cassandra for database backend, hadoop and hbase, scribe, python and tornado, rabbitMQ, and django
- SimpleGeo indexes 1,500 to 3,000 points a minute
- StickyBits uses SimpleGeo, Joe uses it for a travel log with pictures of where he has been
- SimpleGeo offers a marketplace, which allows you to share your GeoData if you want
- Cassandra node clusters are scarily simple to setup
- Cassandra offers a “rack” aware setup, to ensure copies of data go into different racks. SimpleGeo bastardized that to make it AWS Availability Zone aware
- Twitter is using Cassandra now
- Digg was a traditional LAMP stack with a big SOLR/Lucene setup
- Digg made heavy use of Gearman
- Digg has switched to using Cassandra and Thrift
- Joe is digging SQS and S3, he really loves it
