[SOFT] Universal XML Scraper - Windows Scraper for your Recalbox

[paradadf]

if it isn't a problem from the ipv4 side, and even more if mame works... then the "problem" is on your side. weird rom names that aren't on the database perhaps?

[screech]

@tubarao2007 I think like @paradadf,
@Tick-Lpsk problem is very specific du to is geolacalisation.

If it works for Mame it should work for everythings...

Your snes problem is certainly du to your Rom. Can you give me one or two name of your Rom ?

[tubarao2007]

Yes, I found the problem.... The name of files is not exactly from screenscraper...
ex.: mine is A.S.P. - Air Strike Patrol (USA).zip --> SS is A.S.P. Air Strike Patrol (USA).zip

Any suggestion to fix it????... I renamed in bath rename software 80%. but some files need more attention..

[screech]

No real sollution if your Rom haven't neither the good name or the good CRC....

You can look for No-Intro Romset they are pretty good and all of them are referenced

[tubarao2007]

Thats ok... I got the No-Intro e all is good. Thanks a lot...
One more question: I have a lot of clones rom in mame and snes. There is a software to find and delete duplicate roms?

[screech]

Look at my signature

Clean your Romset with Universal ROM Cleaner

[ogroto]

Hi screech, your tool is amazing brother, keep it up the good work!
Just some constructive criticism:
The tool takes a lot of time , at least when i scrap 700 roms or so.
Also i couldn't scrap roms that were already scraped from the oficial recalbox scraper, i don't know why,but it just skips them and does not download anything at all. If you fix this then this could be a heaven app
regards

[screech]

Hi @ogroto

I'm working on a Version 2 Much more optimised and stable (with new XML component)
So I hope it become faster than this version

For your problem, if you want to "rescrape" the game already scraped by recalbox inner scraper, 2 solutions :

• In Edit/Config menu choose "New XML File"
• Or simply delete your old gamelist.xml on your recalbox.

[ogroto]

Hello! i think i have already done both things. And still it does not download them. Both are 700+ roms snes and megadrive.

[screech]

Have you deleted Image in download_image directory too ?
If a picture exist, it didn't download it again to spare some time

[ogroto]

@screech Yes i deleted both, gamelist.xml in megadrive roms folder and also the complete download_image directory. I'm scraping rigth now will tell you soon how it goes. Thanks.
Edit: So, after 90 mins, the scraper only downloaded 3 images, which are the latest roms i added to the list. It created the xmls but only 3 images downloaded.
Edit2: ok so i think i found the issue, the scraper seems to not like .zip roms, at least for megadrive and snes. I use them compressed because i use a small sd 16gb card, and when it tries to scrap them zipped it doesn't work, but if i uncompress some rom the program works ok
Edit3: Ok so, there was a problem with my roms, half of them are not any of the correct CRCs that are listed in screenscraper.fr, which is really odd and also makes me redownload but found the issue. By the way, the software works a lot faster if you do everything in your pc HDD and then transfer the files manually to the Raspberry Pi. Screenscraper.fr takes a lot of time to load for me (i'm from Argentina) so maybe that is why also the app is slow. It is taking time but looking great so far! I'm really happy thanks again

[Tick Lpsk]

another question screech
when i scrape Neo Geo game (neogeo folder)
it end up scrape game as MAME (as shown on software )
and it's scrape just screenshot , no cartridge images
but when i rename folder to Neo-Geo then scrape
the program ask me what type of profile
then i choose Neo Geo AES
then it's work fine everything is include in one image
the question is why neogeo folder is now work foe neo geo game?
thanks

[supernature2k]

Hi @Tick-Lpsk , it is because the neogeo roms ARE mame games!
As screech's soft check the db based on hash, it find the hashes in mame games.
To sum up, you have the MVS version of games, not AES.

A workaround for this is to go to Edit>Settings and then Advanced at the bottom right.
From that advanced settings screen, set RechSYS value to 0. That way, UXS will always ask for the system. Tell the soft it's AES and here you go!

EDIT: In fact you also need to change the RechAPI in the same screen. Set it to 3|1|2.

[screech]

That's it ^^

thanks @supernature2k

[Tick Lpsk]

@supernature2k wow!!!!
that's work man!
thank you supernature2k
also screech for great program

[daviduco]

Last night i scraped snes succesfully, i'm trying to scrape it now and it fails.

I can't scrape anything, it scrapes 600 roms in 2 minutes. Has anything changed? I've tried another 9 systems with exact same result.

[22:11:02] - Recuperation des informations des systemes
[22:11:03] - Fichier d'informations non valide
[22:11:03] - Selection du systeme
[22:11:03] - Recuperation des Profil
[22:11:03] - Recuperation des champs du profil
[22:11:03] - Nombre de roms trouvees : 547
[22:11:03] - Creation des parametres pour le Mix
[22:11:03] - ---------------------------------------------------------------------------------------
[22:11:03] - Calcul des Hash en : 0.24s
[22:11:03] - Recuperation des informations de la Rom no 1 (CRC + SYSTEM)
[22:11:04] - ()Rom non trouve : 90 Minutes - European Prime Goal (Europe).sfc (Hash : 1AD61BD0)
[22:11:04] - Fin de l'ecriture des informations de la Rom no 1 en 0.551s
[22:11:04] - ---------------------------------------------------------------------------------------
[22:11:04] - Calcul des Hash en : 0.24s
[22:11:04] - ()Rom non trouve : Aaahh!!! Real Monsters (Europe).sfc (Hash : 946313FB)
[22:11:04] - Fin de l'ecriture des informations de la Rom no 2 en 0.299s
[22:11:04] - ---------------------------------------------------------------------------------------
[22:11:04] - Calcul des Hash en : 0.14s
[22:11:04] - ()Rom non trouve : ACME Animation Factory (Europe).sfc (Hash : AAD3A72D)
[22:11:04] - Fin de l'ecriture des informations de la Rom no 3 en 0.19s
[22:11:04] - ---------------------------------------------------------------------------------------
[22:11:04] - Calcul des Hash en : 0.14s
[22:11:04] - ()Rom non trouve : ActRaiser (Europe).sfc (Hash : 09097B2B)
[22:11:04] - Fin de l'ecriture des informations de la Rom no 4 en 0.19s
[22:11:04] - ---------------------------------------------------------------------------------------
[22:11:05] - Calcul des Hash en : 0.22s
[22:11:05] - (*)Rom non trouve : Actraiser 2 (Europe) (En,Fr,De).sfc (Hash : 630E16A1)
[22:11:05] - Fin de l'ecriture des informations de la Rom no 5 en 0.272s
[22:11:05] - ---------------------------------------------------------------------------------------
[22:11:05] - Calcul des Hash en : 0.24s
[22:11:05] - ---------------------------------------------------------------------------------------
[22:11:05] - Debut de fusion des fichiers
[22:11:05] - Bilan

[22:11:05] - Scrape Annule
[22:11:05] - Roms trouvees :0 / 5
[22:11:05] - Roms ajoutes :0 / 5
[22:11:05] - Temps moyen par Rom :0.3s
[22:11:05] - Temps Total :0h 0m 2s

[screech]

Sorry. The server provider have problem. It will came back tomorrow.

[thanosazlin]

just used it , works great. but, i only picked up 9 out of 206 N64 games? my .z64 files all have the name of the game no other special characters or extra text like (USA) or (U) [!] in the name of the roms. just wondering what might be causing them to not get picked up?

example of one of the roms in the _nintendo 64_missing.txt file

1080 Snowboarding.z64 08FE81C7 16 777 216 07:33.00 2004-03-28 FA27089C425DBAB99F19245C5C997613

[paradadf]

@thanosazlin please, read the forum:
https://forum.recalbox.com/topic/3842/how-to-screenscraper

There you have the explanation why you fon't get roms scraped. Just a hint: the filename must be exact as the one in the database (without extension), when the CRC hash doesn't match.

This is the thread for the version 2 btw:
https://forum.recalbox.com/topic/4690/soft-universal-xml-scraper-v2

[azvarel]

Suggestion for UXS implementation: when the internet connection fails, instead of redoing the scraper starting again, downloading the images where it left off and then being able to mount the gamelist.xml

My connection is 35mbps and the scrapper download is very slow, 40 scrapers for example here gives an estimate of 54 minutes 42 seconds.