http://arstechnica.com/science/news/2009/02/aaas-60tb-of-behavioral-data-the-everquest-2-server-logs.ars
Is going around all kinds of sites; I came across that article by way of Slashdot, Damion Schubert came across it on Massively, etc.
How do you process 60TB of data? I'd argue that the right approach is to spread the data out across many machines, and split the processing into a number of tasks to map it to the questions you're trying to answer. Then you'd probably need to reduce the results from the cluster into a single set of data, storing intermediate results in a giant key/value store. Which is to say, use Hadoop.
I wonder what Sony is using? I wonder what the guys in academia will be using?
Wednesday, February 11. 2009
NCsoft
I keep on trying to come up with something to say here about NCsoft and the layoffs. I dunno; I feel like most of what I want to say would break some trust placed in me. What's terrible is that for the most part, I'm not particularly surprised: it's astonishing what the (public) rationales are each time, it catches me off guard who the targets are each time, but that it's happening? Nah.
I hope the best for my friends still there, working on Dungeon Runners and Aion and scattered through out other parts of the company. I hope the ones who got laid off today, the ones who got laid off six months ago and are still looking for work, and the ones in between find jobs soon.
Other than that, I think Scott Jennings says it best: ENOUGH WITH THE GODDAMN LAYOFFS.
I hope the best for my friends still there, working on Dungeon Runners and Aion and scattered through out other parts of the company. I hope the ones who got laid off today, the ones who got laid off six months ago and are still looking for work, and the ones in between find jobs soon.
Other than that, I think Scott Jennings says it best: ENOUGH WITH THE GODDAMN LAYOFFS.
(Page 1 of 1, totaling 2 entries)
