SchwertImStein ( SchwertImStein@lemmy.dbzer0.com ) to Programmer Humor@programming.devEnglish · 2 years agomuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comimagemessage-square87linkfedilinkarrow-up1560
arrow-up1560imagemuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comSchwertImStein ( SchwertImStein@lemmy.dbzer0.com ) to Programmer Humor@programming.devEnglish · 2 years agomessage-square87linkfedilink
minus-squareeasily3667 ( easily3667@lemmus.org ) linkfedilinkEnglisharrow-up100·edit-21 year agodeleted by creator
minus-squaremorrowind ( morrowind@lemmy.ml ) linkfedilinkarrow-up40·2 years agoSqlite can easily handle millions of rows. Don’t sell it short
minus-squareThe_Decryptor ( The_Decryptor@aussie.zone ) linkfedilinkEnglisharrow-up7·2 years agoHow about a 6.4TB sqlite database? https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
minus-squaremorrowind ( morrowind@lemmy.ml ) linkfedilinkarrow-up6·2 years agoShould be enough to hold 60k rows
minus-squareKorhaka ( Korhaka@sopuli.xyz ) linkfedilinkEnglisharrow-up3·2 years agoI have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
minus-squareeasily3667 ( easily3667@lemmus.org ) linkfedilinkEnglisharrow-up1·edit-21 year agodeleted by creator
minus-squareHotzilla ( Hotzilla@sopuli.xyz ) linkfedilinkarrow-up4·2 years ago60k is single json file
deleted by creator
Sqlite can easily handle millions of rows. Don’t sell it short
How about a 6.4TB sqlite database?
https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
Should be enough to hold 60k rows
I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
deleted by creator
60k is single json file