[BATCH] Scrape your roms on your PC - fastscraper

[rsn8887]

Well, I was a bit fast now there are problems with N64 scraping. It gives "unknown image format" errors. Worked fine 2 hours ago.

"GDB" scraping works fine, so it is again some problem with "ss" (maybe ss ist just inherently unstable?)

[paradadf]

I just think they are having dns problems lately. Personally, I'd rather wait until it is working again (usually just a matter of hours) instead of using other sources. No other database can compete with SS in that sense. And gdb is definitely not more stable

[faxesystem]

I have the following problem. When setting 3dboxart as prefered cover art it get's downloaded when scraping for a single system. When I choose all 3dboxart gets scraped for gba but not for any other system. For all other console systems the 2dboxart gets downloaded. Can anyone confirm this?

Greetings,

Faxe

[paradadf]

@faxesystem have you changed consoleImg=-console_img= to "3b" (mameImg=-mame_img="3b" for neogeo)?
Only ScreenScraper retrieves 3d boxes, so you better don't change the source. And important... use .png for 3d boxes, otherwise you'll get a black background.

[DavidinCT]

I tried this and so far getting no where.... I have maybe 500 roms... The Emulationstation folder is in the user path (c:)but, the roms are located on another drive(g:), so it's kind of broken up trying to keep the ROMS off the drive. With this the system works perfectly fine (config files are set right). I dropped this batch file in the root of the rom folder.

The only problem when I run this, I just get a message of
Error: The system was unable to find the specified registry key or value, Cant get the PS's language. English will be used.
And a blinking _

it's been sitting there for over an hour like this, never asked me to do anything. Am I doing something wrong ? Or should I be doing something different for my setup ?

[paradadf]

@DavidinCT what do you mean by "the emulationstation folder"?
What is your OS's language?
What windows version do you have?

[DavidinCT]

@paradadf

Windows 7 x64

The install is at C:\users<user name>.emulationstation

In the config file, I set the roms and emulators to point to a G:\Emulationstation.Emulationstation

So, emulators and roms are not on the OS drive. Like this it does not work (as images and XML files are on the drive). I copied the ROMS over to the drive (as a temp thing)

I ended up downloading your one that points to screenscraper.fr and it seems to be working, I think. It's giving an error that API not available to NON-MEMBERS. The site is in French and I cant figure it out to setup an account.

I could not find a direct download on
https://github.com/paradadf/recaltools/tree/master/fastscraper

So, I copied the text and created a batch file, pasted it in...maybe some errors (I viewed as raw).

Sigh....

[paradadf]

@DavidinCT you have flags on the left corner of the site in order to change the language of screenscraper.

Anyway, I don't understand. You installed EmulationStation for Windows? Why? Are you a recalbox user? Or what do you intent to do?

(Yes, you can copy the raw code into an empty txt file and change its extension to bat. If you did it wrong, the script won't even start properly. I would say it is pretty evident if everything is right)

[DavidinCT]

@paradadf I have a Home theater PC that I am using this on, It's based on Windows 7 because it's for TV watching as well (Windows Media Center). So I needed Emulation Station for Windows. Scraping has been a headache so if this works I wanted to use it. And the PC I am using is FAR more powerfull than a Pi is, as it's designed to be able to play 4K video.

I don't know, I set to raw, copy to a txt file and drop in the root of the rom folder, renamed to bat, it does not work. I tried it 2 times

I dropped one that you linked directly above and it seems to work. but, it does not allow me to set my LOGON info for that site.

I hope I am not missing anything by not setting the logon info.

[paradadf]

@DavidinCT ok, well... lets try to help you with that new info

Creating the batch isn't difficult. Just be sure to copy the raw content of the file in github. Always use the latest version of the batch. The console will turn cyan if you did it right.

About the windows version of ES... I don't know where the gamelists goes. Maybe you'll need to modify the paths if the don't belong next to the roms itself like on recalbox.
About your direct access and links or something, I suppose that could be a problem. So in the worst case, scrape directly the real folder and modify your gamelist.xml afterwards.

So... what is the problem again?

[DavidinCT]

@paradadf Yes, I know a batch file is not too hard. With out looking over it everything in the file, I am not sure. I have one that DOES run that I cant log into but, it is creating XML and images so, what ever on this one...as long as it works, right ?

I've been playing with this for a few hours now. I figured out the folder layout in Windows, and there is a

\downloaded_images
and
\gamelists

Folders with sub folders named for each system and deleing these folders, and re-running ES, they get re-created on the drive, so now I know what ones mean anything.

I copied my 20gb of roms on to the drive (correct folder layout) for this test, so I can rule things out.

When I run the fastscraper, I see it creates a gamelist.XML and a downloaded_images folder in the rom folder. So I have just copying them into the correct folder as they are laid out (overwriting the old XML file).

Problem is once I open Emulation Station, No changes show in there. Even after a reboot.

I figured the Meta data on ES would be the EASY part...in fact it's been the hardest part. Over a week working with itand 1/2 my games don't have meta data.

I was very excited to see another meta data option....just wish it was working for me

[paradadf]

@DavidinCT you should open the xml files and check the paths to the images are right.

Wich version of fastscraper do you have? As I said before, always use the last one.

[DavidinCT]

@paradadf 4.10.2016 is the one that works...17.02.2017 does not work (something I have to play with)

[paradadf]

@DavidinCT waaay to old!

Right click here and download it as file:
https://raw.githubusercontent.com/paradadf/recaltools/master/fastscraper/fastscraper.bat

[DavidinCT]

@paradadf It gets to ...

G:\EmulationStation.emulationstation\roms>reg Query "HKLM\Hardware\Description
System\CentralProcessor\0" | find /I "x86" 1>nul && set arch=386 || set a
rch=amd64

And just hangs....

[paradadf]

@DavidinCT weird... it must be because you use a nuc or something similar.

Can you open the command prompt and give the output of:

reg Query "HKLM\Hardware\Description System\CentralProcessor\0"

In the mean time, you can erase that part and just use:
set arch=386
Or whatever platform your pc is.

[DavidinCT]

@paradadf

Under a command line...
reg Query "HKLM\Hardware\Description System\CentralProcessor\0"
ERROR: The system was unable to find the specified registry key or value.

Manually checking that key Closest you get to AMD64 is "Intel64 Family 6 Model 60 Stepping 3"

[paradadf]

@DavidinCT hmmm... these new computers have weird registry entries XD
Try using the 386 arch as I said. Any 64 bit OS would run 32 bits apps, so no problems.

[DavidinCT]

@paradadf Think I found out what PART of my problem was....

I was using notepad...and word wrap was on... when saving it modified the file and caused errors (have not done that in years), Notepad++ only going forward... this gets me backwards tho...

Running as an Admin....
ERROR: The system was unable to find the specified registry key or value.
Can't get OS's language. English will be used.

from this point it just hangs here. Is there anything that needs to be enabled for this script to work ?

This is a HTPC, this is a very stripped down feature machine, only setup for media viewing. That I wanted to use some of it's horsepower for some classic gaming (funny it runs Wii and WiiU games fine too..LOL)

Thanks again for your help, I could understand if you were done at this point...

[paradadf]

@DavidinCT the registry entry the script isn't finding tells what arch (32 or 64 bit) your OS has, so it knows which version of the scraper to downlod. Just erase that prt of the code and let:
set arch=386

That should solve the problem.