Ingesting call-home data — learnings from the trenches

Aug 10, 2014

At Glassbeam, we deal with terabytes of data daily. Our SCALAR platform ingests and parses many files in real time. (The files arrive asynchronously and fast!) These files are then picked up for parsing in the order in which they arrive. For such a demanding requirement, we had to design a system which should not only be concurrent and asynchronous but also scalable.