• oce 🐆@jlai.lu
    link
    fedilink
    arrow-up
    3
    ·
    edit-2
    17 hours ago

    If you need to run queries that aggregate big amounts of data in a reasonable time and cost, you’ll need something built for it. For example, with a column oriented file format instead of the row oriented file format found in traditional relational databases

    • Pennomi@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      15 hours ago

      And the key word “big” here is far bigger than most engineers need to deal with. Hell, most supposed “big data” problems I’ve seen people try to tackle are small enough to fit the whole database into memory.

    • ℍ𝕂-𝟞𝟝@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      16 hours ago

      My point is more that 90% of use cases don’t need that, and for those that do, you can’t just slap eg. Cassandra at it and pretend it’s a relational database.