Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [SOFT] Universal XML Scraper - Windows Scraper for your Recalbox

    Recalbox General
    [soft] universal xml scraper windows
    19
    61
    56726
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • screech
      screech last edited by

      Ok, so I really don't understand why it doesn't work :S

      http://www.screenscraper.fr/gameinfos.php?gameid=18624

      The game exist, not your CRC but the name is good.

      Normally UXS must find it.
      Try this

      Download the last version
      delete all directory and file in UXS dir and put the new EXE
      Try to launch UXS in Admin (optionnal)
      Choose your language
      Choose your profile
      Say "Yes" to autoconf
      Choose NES in the Edit/auto configuration Menu
      Kill Emulationstation in the SSH menu
      Clic on the Arrow to scrape.

      Clean your Romset with Universal ROM Cleaner
      Scrape your Romset with Universal XML Scraper

      1 Reply Last reply Reply Quote 0
      • Tick Lpsk
        Tick Lpsk last edited by Tick Lpsk

        still no luck 😞
        but i mess around with config with this config
        0_1471258982551_2016-08-15 (4).png
        and the result is different
        0_1471258999673_2016-08-15 (3).png

        still no image in downloaded_images
        0_1471259219963_2016-08-15 (5).png

        but hey, its ok
        thank you to make a great software πŸ™‚

        1 Reply Last reply Reply Quote 0
        • screech
          screech last edited by

          Really really strange...

          Can you pastebin you log file ?

          Clean your Romset with Universal ROM Cleaner
          Scrape your Romset with Universal XML Scraper

          1 Reply Last reply Reply Quote 0
          • Tick Lpsk
            Tick Lpsk last edited by

            http://pastebin.com/p3BHhQqm

            1 Reply Last reply Reply Quote 0
            • Tick Lpsk
              Tick Lpsk last edited by

              i found possible problem
              but im not sure it is
              when i access your link
              http://www.screenscraper.fr/gameinfos.php?gameid=18624

              its said
              Vous devez vous connectez avec une adresse IP v4 visible !

              i google translated
              its mean
              You must log in with an IPv4 address visible!

              is it anything to do with my internet provider?

              or i block anything
              or this site block my IP

              :S :S

              1 Reply Last reply Reply Quote 0
              • screech
                screech last edited by screech

                Arg !! Yes !! IP V4 is a necessity and no anonymous tools.

                Sorry it's a Screenscraper restriction for security.

                Can't you try with a standard connection ?

                If you have an IP V6, you can try, MarbleMad just add it to Screenscraper.

                Clean your Romset with Universal ROM Cleaner
                Scrape your Romset with Universal XML Scraper

                1 Reply Last reply Reply Quote 0
                • Tick Lpsk
                  Tick Lpsk last edited by

                  i cant do anything
                  maybe it's my country (thailand) internet provider that use this protocol (I'm not sure)
                  maybe i have to use proxy server to use your software
                  i'll let you know if it work
                  case closed

                  thank you screech!

                  1 Reply Last reply Reply Quote 0
                  • tubarao2007
                    tubarao2007 last edited by tubarao2007

                    I have exactly same problem and I have ipv4 connection.
                    mame works fine, but SNES never works...
                    No .xml and a missing.txt file created with all my game in directory.

                    1 Reply Last reply Reply Quote 0
                    • paradadf
                      paradadf Staff last edited by

                      if it isn't a problem from the ipv4 side, and even more if mame works... then the "problem" is on your side. weird rom names that aren't on the database perhaps?

                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                      1 Reply Last reply Reply Quote 0
                      • screech
                        screech last edited by

                        @tubarao2007 I think like @paradadf,
                        @Tick-Lpsk problem is very specific du to is geolacalisation.

                        If it works for Mame πŸ˜‰ it should work for everythings...

                        Your snes problem is certainly du to your Rom. Can you give me one or two name of your Rom ?

                        Clean your Romset with Universal ROM Cleaner
                        Scrape your Romset with Universal XML Scraper

                        1 Reply Last reply Reply Quote 0
                        • tubarao2007
                          tubarao2007 last edited by

                          Yes, I found the problem.... The name of files is not exactly from screenscraper...
                          ex.: mine is A.S.P. - Air Strike Patrol (USA).zip --> SS is A.S.P. Air Strike Patrol (USA).zip

                          Any suggestion to fix it????... I renamed in bath rename software 80%. but some files need more attention..

                          1 Reply Last reply Reply Quote 0
                          • screech
                            screech last edited by

                            No real sollution if your Rom haven't neither the good name or the good CRC....

                            You can look for No-Intro Romset πŸ˜‰ they are pretty good and all of them are referenced πŸ˜‰

                            Clean your Romset with Universal ROM Cleaner
                            Scrape your Romset with Universal XML Scraper

                            1 Reply Last reply Reply Quote 0
                            • tubarao2007
                              tubarao2007 last edited by

                              Thats ok... I got the No-Intro e all is good. Thanks a lot...
                              One more question: I have a lot of clones rom in mame and snes. There is a software to find and delete duplicate roms?

                              1 Reply Last reply Reply Quote 0
                              • screech
                                screech last edited by

                                Look at my signature πŸ˜‰

                                Clean your Romset with Universal ROM Cleaner

                                Clean your Romset with Universal ROM Cleaner
                                Scrape your Romset with Universal XML Scraper

                                1 Reply Last reply Reply Quote 0
                                • ogroto
                                  ogroto last edited by

                                  Hi screech, your tool is amazing brother, keep it up the good work!
                                  Just some constructive criticism:
                                  The tool takes a lot of time , at least when i scrap 700 roms or so.
                                  Also i couldn't scrap roms that were already scraped from the oficial recalbox scraper, i don't know why,but it just skips them and does not download anything at all. If you fix this then this could be a heaven app πŸ˜ƒ
                                  regards

                                  1 Reply Last reply Reply Quote 0
                                  • screech
                                    screech last edited by

                                    Hi @ogroto

                                    I'm working on a Version 2 πŸ˜‰ Much more optimised and stable (with new XML component)
                                    So I hope it become faster than this version πŸ˜‰

                                    For your problem, if you want to "rescrape" the game already scraped by recalbox inner scraper, 2 solutions :

                                    • In Edit/Config menu choose "New XML File"
                                    • Or simply delete your old gamelist.xml on your recalbox.

                                    Clean your Romset with Universal ROM Cleaner
                                    Scrape your Romset with Universal XML Scraper

                                    1 Reply Last reply Reply Quote 0
                                    • ogroto
                                      ogroto last edited by

                                      Hello! i think i have already done both things. And still it does not download them. Both are 700+ roms snes and megadrive.

                                      1 Reply Last reply Reply Quote 0
                                      • screech
                                        screech last edited by

                                        Have you deleted Image in download_image directory too ?
                                        If a picture exist, it didn't download it again to spare some time πŸ˜‰

                                        Clean your Romset with Universal ROM Cleaner
                                        Scrape your Romset with Universal XML Scraper

                                        ogroto 1 Reply Last reply Reply Quote 0
                                        • ogroto
                                          ogroto @screech last edited by ogroto

                                          @screech Yes i deleted both, gamelist.xml in megadrive roms folder and also the complete download_image directory. I'm scraping rigth now will tell you soon how it goes. Thanks.
                                          Edit: So, after 90 mins, the scraper only downloaded 3 images, which are the latest roms i added to the list. It created the xmls but only 3 images downloaded.
                                          Edit2: ok so i think i found the issue, the scraper seems to not like .zip roms, at least for megadrive and snes. I use them compressed because i use a small sd 16gb card, and when it tries to scrap them zipped it doesn't work, but if i uncompress some rom the program works ok
                                          Edit3: Ok so, there was a problem with my roms, half of them are not any of the correct CRCs that are listed in screenscraper.fr, which is really odd and also makes me redownload but found the issue. By the way, the software works a lot faster if you do everything in your pc HDD and then transfer the files manually to the Raspberry Pi. Screenscraper.fr takes a lot of time to load for me (i'm from Argentina) so maybe that is why also the app is slow. It is taking time but looking great so far! I'm really happy thanks again

                                          1 Reply Last reply Reply Quote 0
                                          • Tick Lpsk
                                            Tick Lpsk last edited by

                                            another question screech
                                            when i scrape Neo Geo game (neogeo folder)
                                            it end up scrape game as MAME (as shown on software )
                                            and it's scrape just screenshot , no cartridge images
                                            but when i rename folder to Neo-Geo then scrape
                                            the program ask me what type of profile
                                            then i choose Neo Geo AES
                                            then it's work fine everything is include in one image
                                            the question is why neogeo folder is now work foe neo geo game?
                                            thanks

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            82
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright Β© 2021 recalbox.com