Where to find a large 2 million rows txt file

Where can i download a large dataset in txt file format to import in Excel for testing.  Idealy it should be more than 2 million rows.
LVL 6
FloraAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Shimshey RosenbergSysAdminCommented:
Lee W, MVPTechnology and Business Process AdvisorCommented:
You could just create one with a vbscript (or powershell, or possibly even batch) and a loop
Shaun VermaakTechnical SpecialistCommented:
This comes to mind. Password list with 1,493,677,782 lines
https://crackstation.net/buy-crackstation-wordlist-password-cracking-dictionary.htm
SolarWinds® VoIP and Network Quality Manager(VNQM)

WAN and VoIP monitoring tools that can help with troubleshooting via an intuitive web interface. Review quality of service data, including jitter, latency, packet loss, and MOS. Troubleshoot call performance and correlate call issues with WAN performance for Cisco and Avaya calls

AlanConsultantCommented:
Hi Flora,

You probably already know this, but if importing to an Excel worksheet, the limit is about 1m rows.

You can split into multiple worksheets, or load into a VBA array, or read it in one line at a time - lots of other options, but if you want to place it into a single worksheet there is that limit.


Alan.
FloraAuthor Commented:
Lee,

How can that be done?  I have no clue, can you please help?
FloraAuthor Commented:
Thanks Alan.

Yes, I know that. but i need that for another purpose. for powerquery
FloraAuthor Commented:
Thanks Shaun but that link you shared, takes me to torrent.

i do not have torrent and i am scared of using torrent.  is there any other way to donwload it without use of torrent?
Scott Fell, EE MVEDeveloper & EE ModeratorCommented:
There are sites like https://www.generatedata.com/ but only allow 100 at a time. For a small fee you can purchase a million. https://www.briandunning.com/sample-data/.

If it were me, I would create a script that can generate random for random lengths from min to max and repeat 2 million times which is what Lee suggested already.
Lee W, MVPTechnology and Business Process AdvisorCommented:
On my computer, this took about 25 minutes for 1 million rows.

Save to a batch file - junkdata.cmd for example:
@echo off
setlocal enabledelayedexpansion
For /l %%a in (1,1,1000000) do (
	echo Col1, !random!, col3, !random!, col5, !random!, col7, !random!, col9, !date!, col11, !time! >>testfile
)
Endlocal

Open in new window

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Shaun VermaakTechnical SpecialistCommented:
i do not have torrent and i am scared of using torrent.  is there any other way to donwload it without use of torrent?
Really why? It is a method of distributing files, even Linux distros use it. All you need is uTorrent
www.utorrent.com/
AlanConsultantCommented:
Hi Flora,

I agree with Shaun - torrents are just a more efficient way of moving files around than a direct (HTTP) download.

Probably less risky in many respects, if you can see many people acting as seeds, since it is generally unlikely that loads of people will be involved if the file is malicious - something you can never know with a direct download.

For large files it is much more efficient and reliable.


Alan.
FloraAuthor Commented:
Thank you very much Lee, This was really Amazing!

what programming language did you use in your code?
Lee W, MVPTechnology and Business Process AdvisorCommented:
That's just a batch script using a for loop.
FloraAuthor Commented:
Thanks. is there any reference or website that teaches this script?
Lee W, MVPTechnology and Business Process AdvisorCommented:
from the command prompt, type

for /?

For example, you can also ping an entire network subnet using the for command

for /l %a in (1,1,254) do @ping -n 1 -w 100 192.168.1.%a | find /i "reply"

In short, the above uses the for command as a number sequence to start with the number 1, increase by 1, and end at 254.  Then it runs ("does") a ping command.  Finally the output of the ping command is directed to the find command (rather than the screen) using the | character and it looks for all lines with the word "reply" in it (the /i says to ignore case so "Reply" and "reply" is the same).

One of my favorite web sites for batch scripting is http://www.robvanderwoude.com (See Scripting languages at left).  I also like www.ss64.com for reference (it's like an enhanced command /? display only with some added comments and examples).
FloraAuthor Commented:
Many Thanks Lee!
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Databases

From novice to tech pro — start learning today.