[BATCH] Scrape your roms on your PC - fastscraper

[paradadf]

@fullskull tu instalacion de windows debe ser minima y le faltaran algunos datos del registro. De todas formas deberia ponerse en ingles y funcionar sin problemas.

[fullskull]

@paradadf si lo hago desde macintosh, ¿crees que me podria ir mejor? tambien tengo linux ubuntu pero no se como hacer para ejecutarlo desde ahi.

[paradadf]

@fullskull si utilizas la version bash, funciona desde mac y linux. En la carpeta de github te dice como hacerlo. Primero le das permisos de escritura con chmod y luego lo ejecutas.
De todas formas, siempre y cuando tengas powershell instalado en tu version de windows, podes utilizar esa version sin problemas.

[fullskull]

@paradadf ,men, no doy con ello, no se como arrancarlo desde mac y es que en el enlace de descarga tampoco dan mucha instrucción, tal vez si, pero quizá para los mas entendidos. Quizá un tutoría con el paso a paso de como hacerlo funcionar estaría bastante bien. Luego no se porque, al darme por vencido con el fast scraper e intentado probar el universal XML scraper y aunque me ha descargado todo los snapshots, me sigue mostrando la ruta de los juegos como una lista, sin añadir su foto correspondiente.

[paradadf]

@fullskull no tengo una mac o sea que no podria indicarte exactamente como abrir una terminal en la carpeta que desees, pero voy a intentar mostrar paso a paso como hacerlo en windows ni bien tenga tiempo. (Pero estoy muy ocupado actualmente y puede que me tome un tiempo hacerlo)

[fullskull]

@paradadf Nada tranki, se agradece tu esfuerzo y dedicacion en haras de los usuarios mas novatos de recalbox (yo me incluyo) Tu cuando puedas. Gracias.

[fullskull]

Una pregunta paradadf, en el universalXMLscraper, veo que me hace el "scrapeo" pero, cuando termina, creo que solo descarga las imagenes pero el "gamelist.xml" no lo edita, quiero decir, creo que el problema que estoy teniendo es que el programa solo me descarga las imagenes pero no modifica ese archivo para hacer constar a RECALBOX de que ese sistema las tiene. ¿Hay algun apartado donde se le diga al "universalXMLscraper" que lo modifique tambien? Gracias.

[paradadf]

@fullskull mejor busca el hilo del uxs en español o ingles para hablar al respecto, pero el problema que mencionas se da cuando no detenes emulationstation antes de hacer el scrape. Cerciorarte visualmente que realmente ES este detenido antes de scrapear. Podes forzarlo con un teclado presionando F4.

[Pablo Macaluso]

Genial probando... mejor que el USX ... Ya que nunca me funciono

[saulob]

I tried the bat yesterday. It worked. It's fast! That was amazing.

I copied the new gamelist file (replaced the old one) and the downloaded_images folder. Replaced everything. When I tried it on recalbox nothing was changed. Everything was the old one, including the images. What's wrong?

I restarted it, and same thing. I executed the 'update game list' and still the same. What I'm doing wrong?

Thanks

Edit: Sorry for the late reply. I will try stoping the emulationstation before trying again. Thanks

[paradadf]

@saulob yes, ES must be stopped before trying to modify the gamelist.xml

[saulob]

@paradadf thanks. I did and it worked

But what about the game versions? I mean, check the attached image, the tmnt game has differences but it's all the same name. How can It showing the right version?

like: Game title (World 4 players) , Game title (2 players version) , something like that

[paradadf]

@saulob for console games, I believe by default the batch shows all extras in the game's name. With arcade roms, if you are having the behaviour showed in the picture, try opening the batch an changing the flags for that. Everything should be explained there.

[saulob]

@paradadf It's kinda hard.Found nothing about the names.

I fixed using another scrap, mamescraper. Worked good on the names, perfect everything detailed.

[elvis56nl]

I recently started started using emulationstation and recalbox on the pi 3 and fastscraper seems to be the best scraping option by far. I had some trouble getting fastscraper to work because of the system language detection but i was able to remove that part from the script and now all seems to be fine.

I was thinking of this feature that could be useful I think: Besides the current function of adding -image and -marquee download all available images for a rom and add descriptors to the filenames accordingly. For instance something like this:

Aladdin (USA)-title.png
Aladdin (USA)-ingame.png
Aladdin (USA)-boxfront.png
Aladdin (USA)-boxback.png
Aladdin (USA)-box3d.png
Aladdin (USA)-cart.png
Aladdin (USA)-marquee.png
Aladdin (USA)-wheel.png
Aladdin (USA)-flyer.png
Aladdin (USA)-mix2.png
Aladdin (USA)-mix3.png
Aladdin (USA)-mix4.png
Would something like this be possible or does it have to be added to the scraper itself?

[paradadf]

@elvis56nl

Would something like this be possible or does it have to be added to the scraper itself?

That's something sselph would need to add to his scraper.

[elvis56nl]

@paradadf
With some creative thinking i was able to make the script do what I had in mind. I decided I wanted my images in subfolders without suffixes as this makes the roms and media work in both emulation station and attract mode easily.

I ended up making several batchfiles: fastscraper_box2d.bat, fastscraper_box3d.bat, fastscraper_snap.bat, fastscraper_mix3.bat which all downloaded the specified image type into subfolders. After running all 4 batch files I end up with all available images in the romdir sorted into the subfolders box2d, box3d, mix3, snap and video. I feel this is the best way to store roms and media files as it is self contained and can easily be moved from one installation to another.

[paradadf]

@elvis56nl good you found the script useful.
Anyway, currently you can't download every single media type from screenscraper with sselph's scraper, as you wanted.

[elvis56nl]

Messing around with the batch file I came across something strange, when console image type is set to mix3 and on running the script you select all it downloads the 2d cover images. When selecting a specific system when running the script it downloads the mix3 images correctly.

I'm not sure if this is because of something I changed in the script as I can't run any of the fastscraper scripts released in the last 8 months or so unmodified. I always get an error on detecting system language.

[paradadf]

@elvis56nl the script isn't guilty of that... it happens when I scrape too, sometimes.

About the language recognition... you could force it by placing the right parameter in the right place. Otherwise I'd need some logs to see where the problem is.