-
Notifications
You must be signed in to change notification settings - Fork 381
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
- Status: Open.#6278 In apache/datafusion-comet;
- Status: Open.#6264 In apache/datafusion-comet;
The native memory usage log understates untracked memory while a pool is overcommitted
area:memoryMemory pools, reservations, OOM handlingMemory pools, reservations, OOM handlingbugSomething isn't workingSomething isn't workingStatus: Open.#6260 In apache/datafusion-comet;spark.comet.shuffle.jvm.batchSize=0 hangs a task, and an unknown spark.comet.exec.memoryPool fails every task
area:memoryMemory pools, reservations, OOM handlingMemory pools, reservations, OOM handlingarea:shuffleShuffle (JVM and native)Shuffle (JVM and native)bugSomething isn't workingSomething isn't workingStatus: Open.#6259 In apache/datafusion-comet;Hash-based JVM columnar shuffle reports its output as disk spill instead of bytes written
area:shuffleShuffle (JVM and native)Shuffle (JVM and native)bugSomething isn't workingSomething isn't workingStatus: Open.#6258 In apache/datafusion-comet;CometTaskMemoryManager logs a warning and a memory dump every time a native reservation is refused
area:memoryMemory pools, reservations, OOM handlingMemory pools, reservations, OOM handlingenhancementNew feature or requestNew feature or requestStatus: Open.#6257 In apache/datafusion-comet;JVM columnar shuffle fails with ArrayIndexOutOfBoundsException when spark.shuffle.checksum.enabled=false
area:shuffleShuffle (JVM and native)Shuffle (JVM and native)bugSomething isn't workingSomething isn't workingStatus: Open.#6256 In apache/datafusion-comet;With several native plans in one task, the non-zero memory usage warning comes from the wrong plan
area:memoryMemory pools, reservations, OOM handlingMemory pools, reservations, OOM handlingbugSomething isn't workingSomething isn't workingStatus: Open.#6255 In apache/datafusion-comet;A native final aggregate that has spilled can fail the task during its replay
area:aggregationHash aggregates, aggregate expressionsHash aggregates, aggregate expressionsarea:memoryMemory pools, reservations, OOM handlingMemory pools, reservations, OOM handlingbugSomething isn't workingSomething isn't workingStatus: Open.#6254 In apache/datafusion-comet;Native window operators reserve no memory for the batches they buffer
area:memoryMemory pools, reservations, OOM handlingMemory pools, reservations, OOM handlingbugSomething isn't workingSomething isn't workingStatus: Open.#6253 In apache/datafusion-comet;Grouped integer SUM doesn't count its per-group state in the aggregate's memory reservation
area:aggregationHash aggregates, aggregate expressionsHash aggregates, aggregate expressionsarea:memoryMemory pools, reservations, OOM handlingMemory pools, reservations, OOM handlingbugSomething isn't workingSomething isn't workingStatus: Open.#6252 In apache/datafusion-comet;arrays_zip with two same-named inputs fails with "ArrowArray struct has 2 children (expected 1)"
bugSomething isn't workingSomething isn't workingStatus: Open.#6251 In apache/datafusion-comet;