sanitation@lemmy.today to Programmer Humor@programming.dev · 2 个月前New compression techniquelemmy.todayimagemessage-square163linkfedilinkarrow-up11.24Kfile-text
arrow-up11.24KimageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 2 个月前message-square163linkfedilinkfile-text
minus-squareSorryQuick@lemmy.calinkfedilinkarrow-up4·2 个月前Saves input tokens and uses more output because of OCR, and output is priced way higher.
minus-squareRooster326@programming.devlinkfedilinkarrow-up3·2 个月前It’s an accounting trick. It uses a different budget…
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·edit-22 个月前Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
Saves input tokens and uses more output because of OCR, and output is priced way higher.
It’s an accounting trick. It uses a different budget…
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol