Seen that? – Seen that? – Seen that? – Seen that? – KFS at Quantcast
Seen that? – Seen that? – Seen that? – KFS at Quantcast Googlestack
Seen that? – Seen that? – KFS at Quantcast at Googlestack Seen that? – KFS at Quantcast at [...] Read More
KFS at Quantcast Googlestack
With people claiming Quantcast is using Hadoop, and not giving a credit to the KFS it is necessary to give more details about the story, and not so surprisingly, the details are available instantly, and here they are (these details refer to Quantcast KFS deployment)
Two deployments:
- 130 node cluster hosting log data
– ~2M files; 70TB of data; WORM system
– Metaserver uses ~2GB RAM
– ~1TB of data copied in during [...] Read More