[SOFT] Universal XML Scraper V2

[Weedfried]

@Takylmor si ça peux te rassurer tu n'es pas un cas isolé. J'éprouve moi aussi des difficultés à scraper depuis hier. Mais ça marchait bien avant, je vais donc attendre patiemment que tout rentre dans l'ordre.

@screech Bon boulot en tous cas. Jusqu'à présent je scrapais en ssh, mais récemment les résultats de Neo Geo n'étaient plus les même (captures d'écran au lieu de visuels des jaquettes auxquels on m'avait habitué). Pour les autres systèmes rien n'a changé, ça ne concerne que FBA Libretro et Neo Geo. Je vais donc attendre que ton soft soit de nouveau sur pieds.

[Takylmor]

@Weedfried C'est même pas le fait de scraper qui bloque, c'est l'installation du soft qui plante.
Mais je me doute que je ne suis pas le seul dans ce cas, par contre je suis le seul à venir embêter @screech

[n1md4]

@screech said in [SOFT] Universal XML Scraper V2:

@n1md4 2h for 600 Rom is pretty long... Have you a Screenscraper Account ? try this (and put your ID/Password in the general option)

@Screech Just waiting for my submissions to be validated ...

[n1md4]

Also, I'm having trouble scraping ScummVM games. I've set the correct <shortname>.scummvm in each folder, but UXS just seems to fail. Can you let me know the setup that works?

Another thing, I've a bunch of SNES titles that are not found, but are present on ScreenScraper. What can I do to fix this?

[paradadf]

@n1md4 for ScummVM creating an empty .scummvm file is not enough. You need to add the long name inside. Check this out:
https://forum.recalbox.com/topic/3832/filelist-scrapping-scummvm/

About your SNES roms see:
https://forum.recalbox.com/topic/3842/how-to-screenscraper
(Point 14 is relevant in your case)

[n1md4]

@paradadf

for ScummVM creating an empty .scummvm file is not enough. You need to add the long name inside. Check this out:
https://forum.recalbox.com/topic/3832/filelist-scrapping-scummvm/

Yes, I've done that, sorry. Like this longname/shortname.scummvm I've used the built-in scraper, and it works - so that's something, but I would like it to work with UXS too, to give a uniform look.

About your SNES roms see:
https://forum.recalbox.com/topic/3842/how-to-screenscraper
(Point 14 is relevant in your case)

Ah ha, was going to ask what to do with all the "missing_rom" files I've created

Thanks!

[paradadf]

@n1md4 read the link about ScummVM again. You didn't get what I wrote. The longname must be written in plain text inside the shortname.scummvm file. All those files can be downloaded from that link, so you don't need to bother.

[n1md4]

Aaaaah! Thanks for your persistence

[n1md4]

Still not working, here is exactly what I've done:

ScummVM setup:

i) created a directory for each title
ii) copy game data into each accordingly
iii) create a file with the shortname and .scummvm extension
iv) the content of each .scummvm file has the longname as content

UXS setup:

i) create a profile for Recalbox v4 ScummVM MIX
ii) ensure SSH is set, and ROM paths are correct
iii) choose 1 game or all to scrape

Still this is failing, log creation has failed so can't read that either.

Also, upon a successful scrape, where should there be gamelist.xml and download_pictures ?

[paradadf]

@n1md4 can you give me an example? Just to test, I'm scraping the whole batch of .scummvm files from the link I posted before and they are scraping perfectly. Isn't your game on that list? If so, you can compare its content with whatever you have been trying to use. If it isn't there... check the database to see if you game exist.

The gamelist.xml and download_images folder will be inside your scummvm folder.

[n1md4]

@paradadf

cat /recalbox/share/roms/scummvm/Beneath\ a\ Steel\ Sky/sky.scummvm
Beneath a Steel Sky

cat /recalbox/share/roms/scummvm/Beneath\ a\ Steel\ Sky/_ScummVM_missing.txt
Beneath a Steel Sky 12:26.00 2016-08-27

[paradadf]

@n1md4 there is a bug with that profile. If you use the Recalboxv4(Mix), it will get scraped.

[Ramstatlon]

@Weedfried said in [SOFT] Universal XML Scraper V2:

@Takylmor si ça peux te rassurer tu n'es pas un cas isolé. J'éprouve moi aussi des difficultés à scraper depuis hier. Mais ça marchait bien avant, je vais donc attendre patiemment que tout rentre dans l'ordre.

Tu as toujours ces meme problemes? Impossible de lancer UXML ce week end, la ca marche mais la plupart des img reviennent toutes noires avec la plupart des mix. Pas mieux sur le digimirror.
Ca marche mieux avec les mix plus simple comme le 2img

[screech]

Hi, the new 2.1.0.5 just come out.

A lot's of change :

• Corrected :

° Better stability on downloaded images (Some never download :S and miss in the MIX)

• Added :

° Dynamique Handle to API server, now I can force the server to ask (for the futur when we have a fallback server or country based server )
° Lot's of new Picto media (Nb of player, Notes, Classification, Editor, Developer, Genre) -> Beta it can change soon.
° Added 3 news MIX Template for Bigshot Theme with these new picto (1 is directly on local, the 2 other are on the repository, you can download them directly from UXS)

• WARNING Added things that can "broke" you existing MIX Template

° You need to put the full Xpath to the Source_Value node (exemple : Game need to start by 'Data/jeu/' and System by 'Data/systeme [id="%IDSYSTEM%"]')
° The CENTER/LEFT/RIGHT/UP/DOWN function in Target_TopLeftX, Target_TopLeftY (and other) now take the "origin" point of the picture (default are TopLeft corner of the Picture)
° You can now use Target_OriginPicX and Target_OriginPicY to fixe the origin point of the picture. So now to center a picture you need to put :

• <Target_TopLeftX>CENTER</Target_TopLeftX>
• <Target_OriginPicX>CENTER</Target_OriginPicX>
• <Target_TopLeftY>CENTER</Target_TopLeftY>
• <Target_OriginPicY>CENTER</Target_OriginPicY>

(The Origin point of the picture will be the center, and we center this origin point to the final picture)

This is exemple of the New MIX for BigShot Template :

[Weedfried]

@Ramstatlon bonjour. J'ai du essayer vendredi dernier. Pas de soucis avec FBA Libretro, pas plus qu'avec la N64 mais toujours rien avec la GBA. Je testerais la mise a jour en fin de semaine.

[cotedeporc]

@screech

Est-il possible de modifier la couleur des logos?

[screech]

c'est à dire ?
Le fond bleu ?
bien sur ^^ regarde dans le mix, tu as un fichier bluesquare.png
Les picto sont monochrome sur fond transparent
(bientot, quand on aura trouvé un graphiste ^^ on fera des picto couleurs ^^)

[cotedeporc]

Ce n'est pas le fond, mais plutôt ce qui est en noir.
Comment pourrais-je faire pour afficher le logo du développeur en blanc?

L'API ScreenScraper le permet-il?

[screech]

En blanc non ce n'est pas possible...

Actuellement sont récupérable 2 types de logos :

Monochrome :

Couleur :

à voir si un jour j'ajoute une fonction de "matrice" pour modifier les couleurs à la volée ><

[azvarel]

@screech

I would like to understand why UXS does not save the screenshots correctly in some roms, example image.

The name of the roms is identical to the screenscraper.fr, after many attempts the image of the game The Immortal appeared, but the others I could not

My roms are named on no-intro.org which in turn are identical to the relation of screenscraper.fr

Any solution?