Trade-offs with Data Lakes

Data warehouse; data mart; data lake; data hub. All of these are variations of similar concepts trying to solve a variation of the same problem: When you have massive amounts of data, what do you do when your operational data store has reached its limits. We’ll first walk through an example using market data.

Market data

A market tick is pretty simple; it’s the latest price of a security. Normally you produce one of these every time ‘something’ changes.