i have windows 2012
32GB RAM
I7 CPU Prossesor
1TB SSHD
i have .txt files of wordlists in lines the txt files start from 2GB to 50GB
what kind of tools or program can work in that large size/lines
to combine all files to 1 file .txt
then work in that 1 file .txt which can be 100GB after all combined/merged
to remove duplicates lines with CauseSinstive and don't crash or freeze or lag ?
i know i asked a question look like that but i didn't get anything simple to
help me i don't understand so much in the cmd codes people use
so if possible someone tell me about a program can really do that without a problem or a cmd way with easy explain for beginner
like what i need to do by steps and how to do
so at the end i need something don't crash my pc or be very slow
i have tryied emeditor so far can't work in 10GB file and its got starting super slow
please help me
Best Answer
The best tool to manage huge txt wordlist for Windows is: Unified List Manager (ULM)
ULM
You can sort, merge, split, remove duplicates and many other useful stuff.