[BATCH] Scrape your roms on your PC - fastscraper

[slakka]

Just tried this yesterday, worked very well but had a few problems.

atari5200 and supergrafx had no successful scrapes. ROMs are from No-Intro set.

FBA had almost no successful scrapes, only 154 out of 4156 worked, that number should have been several hundred right? Or should it be almost all of them?

I thought maybe the directory name causes it to scrape from different sources so I tried fba, fba_libretro, and mame, same results for all. ROMs are from the set called FBA v0.2.97.38 .

Maybe there is still a problem with mamedb causing so many failures?

[paradadf]

@slakka sselph's scraper doesn't use ScreenScraper as a source for arcade systems and mamedb has been offline for weeks, so your success rate will be very low there.
Wirh this batch, as long as your folders have the words fba, fba_libretro, mame or neogeo, it will be recognized as arcade, with the different options currently available. Even, for example, fbaANYTHING_ELSE will recognize the fba from the beginning.

About atari 5200... I have never scraped that system and have no idea about how full the database is. The no-intro romset for supergrafx is definitely on the database (there are only 5 games). But if you have problems scraping your roms, then double-check the SHA1 of your files with the ones on SS. If they are not the same, and for the new roms to be added, you need either a software called FCRC-Calculator (check the MD5 hash) or the missing.txt from another scraper called Universal XML Scraper (scraper with much more options and recognizes arcadd systems ;)) to be submitted on IRC at #screenzone.
Look for the how to about screenscraper and the tutorials about Universal XML Scraper (short: UXS) on this forum.

[slakka]

@paradadf Ok so I guess arcade scrape is out for now.

I checked a few of the Atari 5200 ROMs, SHA1 values matched those on SS. There's data there, descriptions, box art, etc. and the total number of ROMs from No-Intro's set is the same as the total number of games on SS, 107 games. Maybe my directory name should be different?

Thanks.

[paradadf]

@slakka directory names are only important if you scrape arcade systems. For the rest, you can call your folders whatever you want. The only thing I can think of is that sselph's scraper hashes the unzipped rom, so even if the .zip hash is on the database, the .a56 (or whatever) might not. Those are the ones that need to be added.

[eb2016]

what database/website does it get its data from? I'm keen to have a look.

[paradadf]

@eb2016 all the information is here.
For example:
https://forum.recalbox.com/topic/2594/batch-scrape-your-roms-on-your-pc-fastscraper/9

[eb2016]

Does this have issues at all with Gameboy Advanced? I just ran it on a bunch of systems and it worked fine but it didn't scrape any of my GBA titles.

[paradadf]

Please, read the thread if you want to know how everything work. Just a few messages before I wrote this:
https://forum.recalbox.com/topic/2594/batch-scrape-your-roms-on-your-pc-fastscraper/48
It depends on the data source you choose and if the rom hash is in that database. Like all scrapers, it is always better to use no-intro romsets.

[wggallagher]

@paradadf Can you please explain to me what im doing wrong? Ive downloaded scraper.exe and fastscraper.
Ive put them in a folder called "roms" on my desktop and inside said folder are all the systems with roms that i want to scrap. I click on fast scraper, it starts, asks me "which systems do i want to scrape? All? " i enter "all"
then i append the existing game list. hit enter and nothing happens. What am i doing wrong?

[paradadf]

@wggallagher it is impossible that nothing happened... what does the console says? Do you get the duration? Have you downloaded the correct scraper.exe (64bit version on a 32bit computer)?

[wggallagher]

@paradadf I believe so, I'm running Windows 10. I downloaded the windows386 .zip. should be the right one.

[paradadf]

@wggallagher what does the console says after you press ENTER on the appending questions?

[wggallagher]

@wggallagher 64 bit computer

[wggallagher]

@wggallagher nothing. It just goes off screen. Like it closes

[paradadf]

@wggallagher what happens if you type a specific folder?

[wggallagher]

@paradadf if I run fast scraper as admin, it says I dont have scraper.exe, even though I do, and asks if if like to go to the website to get it

[wggallagher]

@paradadf if I tell it to scrape nes, instead of all, it does the same thing after the append question. But I can just run scraper.exe and it starts downloading pictures into a "images" folder it creates

[paradadf]

@wggallagher have you changed anything inside the batch file? Try downloading it again. I have no idea what is happening. Otherwise, it must be something wirh your computers configuration.

[wggallagher]

@paradadf no, I didn't touch the batch file. I'll try downloading again. I see that it's suppose to produce a images folder and a gameslist.txt. Where do the they go on the memory card, if I get this to work? I know I have to stop emulationstston. I just don't know where to put those 2 new items though when I get them

[paradadf]

@wggallagher They go exactly as the structure you created on your computer (that should be the same as on Recalbox). Next to the roms goes the gamelist.xml and the subdirectory downloaded_images.