Data warehouse; data mart; data lake; data hub. All of these are variations of similar concepts trying to solve a variation of the same problem: When you have massive amounts of data, what do you do when your operational data store has reached its limits. We’ll first walk through an example using market data.
A market tick is pretty simple; it’s the latest price of a security. Normally you produce one of these every time ‘something’ changes.