Working with very large data sets
by alph4byt33 - Thursday February 8, 2024 at 07:11 AM
Elite User

Posts: 124
Threads: 7
Joined: Feb 2024
Reputation: 0

#1
02-08-2024, 07:11 AM (This post was last modified: 02-08-2024, 07:41 AM by alph4byt33.)
What would be the best approach to working with a 100GB+ .sql database file? I want to convert it all into a JSON file which I do fine using sqldump2json but it just ends up crashing my VM. The next idea was to use split on the file but that would cause formatting issues on the last line of one file and the start of the next file.

Any advice?

Edit: looks like split will be the workaround for now
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Community for sharing information on French data breaches suicid 1 293 03-27-2026, 03:56 PM
Last Post: macaroni
  Turk working in Pentagon stole US classified information reflex 9 866 02-06-2026, 04:45 PM
Last Post: hellohihi
  Interesting story ... but is the data out there metzelplix 4 394 02-06-2026, 02:54 PM
Last Post: metzelplix
  edr (emergency data request) closed 1 243 01-31-2026, 07:01 PM
Last Post: lucy
  Is the site whatsapp.com working? 7pFT54FFdO 4 161 01-28-2026, 09:03 AM
Last Post: exxxiko



 Users browsing this thread: 1 Guest(s)