[SOFT] Skraper

[BiZzAr721]

I originally was using Universal XML scraper until I came across Skraper beta (through screenscraper). I used it to supplement UXML, but I finally decided to make the switch to Skraper. Main reason is it scraped more reliable. I would be missing random boxart with UXML for example. I am impressed with the customizability, and the progress Skraper is making. Looking forward to DOS scraping!

Is there a thread dedicated Skraper forum for user contributed mix profiles (or Skraper in general)? I haven't been able to locate any except the small handful that's included with Skraper. I was trying to make one but I was having a very hard time not seeing the changes in real time, and I figured there must be some creative mixes out there.

[PlayingKarrde]

Hi there, really enjoying this scraper but I have a couple of requests. The first is allowing us to specify a custom gamelist node since it selects 'none' for anything that it doesn't recognise (which is nearly everything).

The other would be to add support for Pegasus Frontend. The details of this frontend's metadata can be found here: http://pegasus-frontend.org/docs/user-guide/meta-assets/

Thanks and keep up the great work!

[serpi]

While I like Skraper, how can I make it recognice a rom it didn't catch by itself?

I have, for example, in psx a rom "Tempest X3.pbp" and "Tempest X3" is also the name on screenscraper.fr, but Skraper doesn't get it.

Can I select this somehow manually?

Sadly, the inbuild scraper on retrobox latest beta (pi 3b+) is broken, so I cannot use this for individual scraping.

[BiZzAr721]

@serpi Look to see what rom file Screenscraper has listed and rename a copy of the file to that name (eg: I have some exoDOS disk art named according to the screenscraper rom name - I literally used an advanced renamer to change the extension from .png to .dos and was able to scrape 2,000 MS-DOS games)

EDIT: this thread is not very active. Is there a more active thread related to Skraper? I would really like to check out some custom mixes!

[voljega]

@bizzar721 I don't think Skraper is actively maintained anymore or at least its dev doesn't visit the recalbox forum

[abunille]

@serpi

Your example is not correct

The "Gamename" is Tempest X3, thats correct.
But the matching "Romnames/Filenames" are different.
Go to screenscraper Homepage, log in and search for the Tempest X3 Game.
Click on it and look in the "ROMs/ISOs" field.
You will find for example:

• Tempest X3 (USA)
• Tempest X3 (Europe)
• Tempest X3 (USA) [SLUS-00283]

And on Skraper Soft:
look in the "Miscellaneous" section that your "Database matching method" is not only "CRC".

@BiZzAr721
Maybe a better way is to join the IRC or Discord from Screenscraper

[serpi]

@abunille

Ah, now I see!

I've never noticed that "ROMs/ISOs" field, now it makes sense, at least some kind of.

And I have already set the matching mode in Skraper to filename only, so CRC should not be a problem.

Many thanks, that should do the trick.

[abunille]

@serpi

With pleasure

[lmerckx]

@Bkg2k A big thanks for this tool. Very useful and, for me, the best scaper to use with Recalbox !

I just made a small correction in the mix "ArcadeMoon":
In ArcadeMoon.xml and ArcadeMoonPlus.xml, the first point of Vertical presentation (Portrait) should be 84,167.

[Bkg2k]

@lmerckx Thanks, I'll fix it

[lmerckx]

Another strange behaviour:
The arcade game "1941 - Counter attack" is not recognized by Skraper.
The system is FBA libretro, the ROM name is 1941.zip and the MD5 is C4FFF5A2D094D663ECCA7D307067B63D, which is referenced in ScreenScraper.

Is there something wrong with numbers as name ?

(sorry if I'm in wrong place for the post)

Edit: The only error I've got in log is this one. But I'm not sure it is the cause of the problem.
For information, it is my only game which is not scraped ...

[2019-01-04 20:30:06.073] EXCEPTION   : Unexpected character encountered while parsing value: <. Path '', line 0, position 0. : 
[2019-01-04 20:30:06.080] STACK TRACE :    à Newtonsoft.Json.JsonTextReader.Pa&ast;&ast;eValue()
   à Newtonsoft.Json.JsonTextReader.Read()
   à Newtonsoft.Json.JsonReader.ReadForType(JsonContract contract, Boolean hasConverter)
   à Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReader reader, Type objectType, Boolean checkAdditionalContent)
   à Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReader reader, Type objectType)
   à Newtonsoft.Json.JsonConvert.DeserializeObject(String value, Type type, JsonSerializerSettings settings)
   à Newtonsoft.Json.JsonConvert.DeserializeObject[T](String value, JsonSerializerSettings settings)
   à Newtonsoft.Json.JsonConvert.DeserializeObject[T](String value)
   à SkraperLibrary2.ScreenScraper.ScreenScraperApi.GetObjectsExt[T](String method, Dictionary`2 ext, Int32 systemid, Hashes hashes) : 
```

[lmerckx]

Apparently, the problem for 1941 disappear as it came !
Thank you !

And, for information, I created a custom mix for Skraper which is (or should be) the same than the Recalbox Mix 1 of ScreenScraper.
For me, it gives better results if all resources (screenshot, wheel, box) are not in same language/cover/...

If interested, you can download it here: https://www.proximuscloud.be/web/app/share/invite/kfzfLCeKdh

[Bkg2k]

@lmerckx I can include it in the next release if you're ok

[Bkg2k]

Beta 8 (or Rc1, or even first final release) is approaching quickly.

Until then, here are link to latest semi-private betas:
https://www.skraper.net/download/beta/SkraperUI_Beta7.4.2.x86.7z
https://www.skraper.net/download/beta/SkraperUI_Beta7.4.2.x64.7z

[lmerckx]

@Bkg2k No problem, I share it to be used.

[haveac00kie]

Hi!
Didn't know this app until you talked about it during RecalBox live event tonight...
Just tried it! Amazing!
Thanks so much Bkg2k

[lhari84]

@bkg2k Hi, is there any option to scrape (skrape) only games that haven't any metadata yet?

Example:
Skraper is finished but some games have not been detected. So I want to do another run for missing games ONLY with changed program settings.

In Emulationstation Scraper this setting exists, unfortunately could not find it in Skraper.

Thanks!

[abunille]

@lhari84

Hi, try the "update" option:

[lhari84]

@abunille Seems to work, thanks. Now I have another problem:
No matter what I change (tried all regions, etc.), Skraper will not find some games at all. It's only a few, so it would be no problem at all adding metadata in gamelist.xml for those manually, BUT:
I'd like to have same picture style for all games (screenshot + system,...) and it seems it's not possible to download the png-files at screenscraper.fr directly, even not with registered account and even though these graphics seem to exist there for missing games! Any ideas?

[abunille]

@lhari84

Ok, then the CRC and Filename of your roms seems not to be in the Database from ScreenScraper.
2 options:

1. • You can just rename your files like one which is in the Database of ScreenScraper.
     (Go to ScreenScraper Homepage, log in and search for one of your games.
     Click on it and look in the ROMs/ISOs field. Here are all filenames listed, which exist in the Database.)
     And on Skraper Soft:
     look in the "Miscellaneous" section that your "Database matching method" is not only "CRC". Use the crc, then filename option.
2. • Or, after Scraping you will find a "blablabla missing.xml" file (dont know the right name right now) in your Folder. With these Informations you can go to ScreenScraper Discord/IRC, and ask if they will include in the Database. I dont know the source quality of your roms.

And for future Problems:
Maybe a direct contact on ScreenScraper Discord/IRC is the better option