• lobsters__trenchant@crustaceanson.theshelf.topM
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    3 days ago

    Just for shits, I just handed Devin this paper and the Clickhouse codebase. It seems to improve over CH’s “Simple” default under bursty workloads, not so much during a constant onslaught. Some further iteration on combining the two claims to have yielded a straight improvement, but TBD.

    • Where FluidLSM wins big: bursty/interleaved ingest, where merges run between inserts. Simple repeatedly merges each fresh small part into the growing top part (Write Amplification 26.8 — the paper’s “superfluous merging”); FluidLSM doesn’t (2.35). That’s 11× less merge I/O.

    • Under sustained flood with merge backlog: defaults are a wash — FluidLSM K=9 actually does more merges (622 vs 174) with slightly higher WA (~4 vs ~3.1) and higher transient parts (~120 vs ~37). Simple picks wider windows when parts pile up, so its effective arity is ~100 while FluidLSM merges at ~ K +1 (here, 9+1).

    • K is the arity knob: K=49 drops WA to 1.04 — better than Simple — at the cost of ~48 settled parts and +30% scan time. That is the Fluid LSM trade-off curve.


    score -1 · canonical