https://www.siddharthjain.dev/tags/designing-data-intensive-applications/Recent content in designing data-intensive applications on Siddharth JainHugo -- gohugo.ioSat, 24 Oct 2020 19:29:58 -0700https://www.siddharthjain.dev/posts/2020/designing-data-intensive-applications-sstables-lsm-trees-b-trees/Sat, 24 Oct 2020 19:29:58 -0700https://www.siddharthjain.dev/posts/2020/designing-data-intensive-applications-sstables-lsm-trees-b-trees/An LSM-Tree is at the heart of storage engines that are based on the principle of merging and compacting sorted files. Such storage engines are typically called LSM storage engines.https://www.siddharthjain.dev/posts/2020/designing-data-intensive-applications-hash-indexes/Sat, 17 Oct 2020 11:32:24 -0700https://www.siddharthjain.dev/posts/2020/designing-data-intensive-applications-hash-indexes/Many databases internally use a <em>log</em> which is an append-only sequence of records. These are <em>log-structured</em> databases. Hash indexes are used to index key-value data, and may be used to power log-structured databases.https://www.siddharthjain.dev/posts/2020/designing-data-intensive-applications-reliability-scalability-maintainability/Fri, 02 Oct 2020 19:18:33 -0700https://www.siddharthjain.dev/posts/2020/designing-data-intensive-applications-reliability-scalability-maintainability/A data-intensive application is one for which raw CPU power is rarely a limiting factor — it has bigger concerns over the amount of data, complexity of data and the speed at which the data is changing.