Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [SOFT] Universal XML Scraper - Scrappez vos roms depuis Windows (Scrape your roms from Windows)

    Community projects
    [soft] universal xml scraper scrappez
    73
    656
    481531
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • voljega
      voljega Banned last edited by

      @Screech j'ai jamais essayé mais est ce que ton scraper gère les sous répertoires ds un réertoire de roms ? (Genre snes/shootemup snes/rpg etc)

      1 Reply Last reply Reply Quote 0
      • screech
        screech last edited by screech

        Malheureusement non... Pas pour le moment...

        En fait j'ai bloqué la récursivité parce que ça fait des trucs bizarre ^^

        Je dois pouvoir faire quelques modif pour que ça fonctionne, il faudrait que je me re-penche sur le sujet 😉

        Clean your Romset with Universal ROM Cleaner
        Scrape your Romset with Universal XML Scraper

        1 Reply Last reply Reply Quote 0
        • supernature2k
          supernature2k last edited by

          Ok @screech, Ce que je voudrait ajouter en 1er ce sont des images PSX provenant d'un site anciennement listé par mr bot irc.

          Pi powered NES | Gameboy HD | RecalStation | RecalDrive
          Upvote messages if it has been useful ;)

          1 Reply Last reply Reply Quote 0
          • screech
            screech last edited by

            @Supernature2k c'est que ça doit être du fiable ^^ Donc vas y surtout que c'est léger sur psi 😉

            Clean your Romset with Universal ROM Cleaner
            Scrape your Romset with Universal XML Scraper

            1 Reply Last reply Reply Quote 0
            • supernature2k
              supernature2k last edited by

              @screech, en fait la plupart des roms PSX sur ce site sont en .cue+.bin Du coup je fourni quoi à marble?

              Pi powered NES | Gameboy HD | RecalStation | RecalDrive
              Upvote messages if it has been useful ;)

              1 Reply Last reply Reply Quote 0
              • screech
                screech last edited by

                Les 2 ^^

                Clean your Romset with Universal ROM Cleaner
                Scrape your Romset with Universal XML Scraper

                1 Reply Last reply Reply Quote 0
                • screech
                  screech last edited by

                  Nouvelle version : V1.3.0.11

                  Correction du bug avec le message d'erreur en cas de TimeOut ^^ ça ne devrait plus le refaire 😉

                  Clean your Romset with Universal ROM Cleaner
                  Scrape your Romset with Universal XML Scraper

                  1 Reply Last reply Reply Quote 0
                  • Nachtgarm
                    Nachtgarm last edited by Nachtgarm

                    Hey @screech. First of all: AWESOME Tool! Thank you!

                    I just downloaded the latest version of it and ran into an error, while trying to scrape SNES (EU Only) games in a local dir. So I was not scraping directly to my Pi. I got the following error after it actually scraped the first few games and downloaded the images (Recalbox V4 Mix)

                    0_1469225538473_Error.png

                    Any Idea, what this might've caused? I'm using 1.3.0.10 64bit

                    EDIT: I tried the latest one just now (1.3.0.10, 64bit) which seems to be working fine, except the SSH commands are not working for me.
                    EDIT 2: With the latest version it has found all my SNES Games on my PI, downloaded all the images, but only every few are displayed in ES... any idea why this is happening? (There are only 60+ games on there)

                    1 Reply Last reply Reply Quote 0
                    • screech
                      screech last edited by

                      Hello @Nachtgarm

                      First of all, the last version is the 1.3.0.11
                      And this version fixe this error message (due to a TimeOut on Screenscraper)

                      For SSH fonction, It work (at last on my Recalbox ^^) had you change some password ?
                      If so, you can edit the SSH config in the UXS-config.ini file :

                      [CONNEXION]
                      Menu_SSH = 1
                      Plink_root = root
                      Plink_mdp = recalboxroot
                      Plink_IP = RECALBOX

                      For your SNES Scrape, if the SSH commands doesn't work had you kill Emulationstation manually ?
                      If not, that's why. Be sur emulationstation is killed before scrape (you have a black screen on your recalbox when it's done 😉 )

                      Let me know if there is other problem 😉 I'll try to help you as much as I can.

                      Clean your Romset with Universal ROM Cleaner
                      Scrape your Romset with Universal XML Scraper

                      Nachtgarm 1 Reply Last reply Reply Quote 1
                      • PumpKHeaD
                        PumpKHeaD last edited by

                        Great job @screech, thank's for share this.
                        I have three questions...

                        I can remove "-image" in the images files in Universal XML Scraper menus, UXS-config.ini or another place?

                        You think about create a checkbox, menu... to add "<image>./image/game.png</image>" in XML when don't find nothing in screenscraper.fr? To us put a image manually.

                        Would you be interested in a Universal XML Scraper translation in Portuguese too?
                        https://www.dropbox.com/s/y4cr2vwwi7mudsd/UXS-PORTUGUESE.XML

                        1 Reply Last reply Reply Quote 1
                        • screech
                          screech last edited by

                          Hello @PumpKHeaD

                          Thank you very much for the translation !!!

                          This is the new v1.3.0.12
                          With portuguese language ^^

                          Concerning the missing image I'm not sur I understand your ask :S

                          If you want "in XML" file "./downloaded_images/game.png" when no image where found it's easy.

                          Juste Add :

                          $ELEMENT_12 = 'image|value|./downloaded_images/game.png|variable'

                          just after

                          $ELEMENT_10 = 'image|path:image|medias/media_screenshot|path:image'
                          $ELEMENT_11 = 'image|path:image|medias/media_boxs/media_boxs2d/media_box2d_%%|path:image'

                          Don't forget to increment the following ELEMENT (12 become 13, 13 become 14 and so on til the end of the profile)

                          With this, you can have a unique image for every missing one.

                          If you want Adding in XML "./downloaded_images/xxx.png" where xxx.png is the name of the game. I need to check what I can do 😉 (but it's not impossible, I just need a little more time to see how to do it 😉 )

                          At last, for now it's impossible to remove the "-image" postfix to the file name. I need this for multiple image option (like if you want screenshot and 2DBox you can make a profile where there is "-screenshot" and "-2DBox" in the same directory.)

                          But I can give you an easy way to do it fast 😉

                          Use a soft like xnview to mass rename your file (replace "-image." with "." in the filename)
                          And with notepad or other text editor, do the same (replace "-image." with ".") in your gamelist.xml

                          And voila ^^

                          Clean your Romset with Universal ROM Cleaner
                          Scrape your Romset with Universal XML Scraper

                          1 Reply Last reply Reply Quote 0
                          • Nachtgarm
                            Nachtgarm @screech last edited by

                            @screech Thanks for the fast reply. So yes, all is working now as it should. I forgot, that I renamed my PI so of course I had to change the .ini as well.

                            Is the error I posted above the time-out error you are speaking of? Does not sound like one, but anyway... it has not reappeared after using 1.3.0.11.

                            What do you think about a German Translation? Do you want me to help with that? Further I'd like to post your tool in the German Section as well, with a German Tutorial, if are ok, with it.

                            1 Reply Last reply Reply Quote 0
                            • screech
                              screech last edited by

                              The error you posted is an error because in case of Timeout I'll try to show the real error code. And it's not working and crash the soft ^^
                              So now (in last version), in case of timeout you just have a message ^^ no error code so no problem ^^

                              I'll be happy with a german translation ^^ (But I don't speak a word of german :p) Feel free to translate it and to post a Tuto in german section ^^

                              (I'll add the translate when you send it to me ^^)

                              Many thanks for your support.

                              Clean your Romset with Universal ROM Cleaner
                              Scrape your Romset with Universal XML Scraper

                              Nachtgarm 1 Reply Last reply Reply Quote 0
                              • Nachtgarm
                                Nachtgarm @screech last edited by

                                @screech Here you go. I created a PR for German.

                                1 Reply Last reply Reply Quote 1
                                • screech
                                  screech last edited by

                                  Tadaaa !!!

                                  Now in German : V1.3.0.13

                                  Thank you very much @Nachtgarm

                                  Clean your Romset with Universal ROM Cleaner
                                  Scrape your Romset with Universal XML Scraper

                                  Nachtgarm 2 Replies Last reply Reply Quote 1
                                  • Nachtgarm
                                    Nachtgarm @screech last edited by

                                    @screech Awesome!
                                    Thanks for the quick merge. I'll add a German Tutorial soon to the subforum.

                                    1 Reply Last reply Reply Quote 1
                                    • PumpKHeaD
                                      PumpKHeaD last edited by

                                      Wow it was very fast! Thanks @screech.

                                      Was just that =]
                                      "If you want Adding in XML "./downloaded_images/xxx.png" where xxx.png is the name of the game."

                                      And I can download only 3D box arts? I change UXS-config.ini in Recalbox v4:
                                      $ELEMENT_10 = 'image|path:image|medias/media_screenshot|path:image' to $ELEMENT_10 = 'image|path:image|medias/media_boxs/media_boxs3d|path:image' but it did not work.

                                      1 Reply Last reply Reply Quote 0
                                      • screech
                                        screech last edited by

                                        Dont forget the _%% at the end. But yes it's that 😉

                                        And I Will see for the modification 😉

                                        Clean your Romset with Universal ROM Cleaner
                                        Scrape your Romset with Universal XML Scraper

                                        1 Reply Last reply Reply Quote 0
                                        • PumpKHeaD
                                          PumpKHeaD last edited by

                                          Yes work with _%%! Thanks again :]

                                          But now a have that problem, with all versions.
                                          0_1469325996954_upload-6ba00e2c-234a-4f80-8393-b6320bc5b646

                                          1 Reply Last reply Reply Quote 0
                                          • screech
                                            screech last edited by

                                            strange ?? when ?
                                            Can you send me the end of you rlog and your UXS-config.inin ?

                                            I will check Why

                                            Clean your Romset with Universal ROM Cleaner
                                            Scrape your Romset with Universal XML Scraper

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            85
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com