Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240622
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • paradadf
      paradadf Staff @airart last edited by

      @airart it is working... you need scraper v.1.2.0 (latest version).

      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

      airart 1 Reply Last reply Reply Quote 0
      • airart
        airart @paradadf last edited by

        @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

        scraper v.1.2.0

        Can U give me a link please , i've already copy raw fastscraper

        paradadf 1 Reply Last reply Reply Quote 0
        • paradadf
          paradadf Staff @airart last edited by

          @airart just delete the scraper.exe you have and launch the batch.

          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

          airart 1 Reply Last reply Reply Quote 0
          • airart
            airart @paradadf last edited by

            @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

            @airart just delete the scraper.exe you have and launch the batch.

            Err processing
            ....xml syntax error on line 1

            paradadf 1 Reply Last reply Reply Quote 0
            • paradadf
              paradadf Staff @airart last edited by

              @airart open the batch file, you probably have something else inside as the actual code.

              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

              airart 1 Reply Last reply Reply Quote 0
              • airart
                airart @paradadf last edited by

                @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                @airart open the batch file, you probably have something else inside as the actual code.
                maybe ..... i have copied raw in existing .bat overwryte all , can you give me a clean .bat ?

                paradadf 1 Reply Last reply Reply Quote 0
                • paradadf
                  paradadf Staff @airart last edited by

                  @airart @kevinnash already gave you the direct link!

                  https://raw.githubusercontent.com/paradadf/recaltools/master/fastscraper/fastscraper.bat

                  right-click on it and and "save link as..."
                  the clean link has always been online for everyone!

                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                  1 Reply Last reply Reply Quote 0
                  • airart
                    airart last edited by

                    alt text

                    not working xml syntax error on line 1

                    paradadf 1 Reply Last reply Reply Quote 0
                    • paradadf
                      paradadf Staff @airart last edited by paradadf

                      @airart what is not working? where do you get that error? what version of sselph's scraper do you have?

                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                      airart 1 Reply Last reply Reply Quote 0
                      • airart
                        airart @paradadf last edited by

                        @paradadf sselph v1.2.0
                        i'm in pc platform not connected to recalbox because at home i have a mac system
                        alt text

                        paradadf 1 Reply Last reply Reply Quote 0
                        • paradadf
                          paradadf Staff @airart last edited by paradadf

                          @airart are you running the batch as administrator? If so, don't do it.
                          What was that about a pc and a mac? I didn't understand.

                          FYI there is a new version for macOS:
                          https://forum.recalbox.com/topic/5745/bash-scrape-your-roms-on-macos-and-linux-fastscraper

                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                          airart 1 Reply Last reply Reply Quote 0
                          • airart
                            airart @paradadf last edited by

                            @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                            @airart are you running the batch as administrator? If so, don't do it.
                            What was that about a pc and a mac? I didn't understand.

                            FYI there is a new version for macOS:
                            https://forum.recalbox.com/topic/5745/bash-scrape-your-roms-on-macos-and-linux-fastscraper

                            I 'm non running as administrator
                            I said that on mac not think there was the possibility

                            paradadf 1 Reply Last reply Reply Quote 0
                            • paradadf
                              paradadf Staff @airart last edited by

                              @airart are you trying to append an existing gamelist?

                              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                              airart 1 Reply Last reply Reply Quote 0
                              • airart
                                airart @paradadf last edited by

                                @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                                @airart are you trying to append an existing gamelist?

                                I asked him to create a new one

                                airart 1 Reply Last reply Reply Quote 0
                                • airart
                                  airart @airart last edited by

                                  @airart said in [BATCH] Scrape your roms on your PC - fastscraper:

                                  @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                                  @airart are you trying to append an existing gamelist?

                                  I asked him to create a new one

                                  The problem may be that they are not connected to recalbox?

                                  paradadf 1 Reply Last reply Reply Quote 0
                                  • paradadf
                                    paradadf Staff @airart last edited by

                                    @airart no, I never scrape over the network, but on my pc. I have no idea what is going on, but I would try to erase the gamelist.xml and download_images folder and scrape again. I still believe you are executing the batch with administrator privilege and thus the error. Look at the title bar... it says "Amministratore".

                                    If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                    airart 1 Reply Last reply Reply Quote 0
                                    • airart
                                      airart @paradadf last edited by

                                      @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                                      I have no idea what is going on, but I would try to erase the gamelist.xml and download_images folder and scrape again. I still believe you are executing the batch with administrator privilege and thus the error. Look at the title bar... it says "Amministratore".

                                      I know , but I do not understand how to do, I did not set the administrative mode

                                      1 Reply Last reply Reply Quote 0
                                      • rsn8887
                                        rsn8887 last edited by paradadf

                                        Worked two days ago, now broken:
                                        ERR: error processing H:\EmuRoms\Recalbox\recalbox\roms\gba\2 Game Pack! - Matchbox Missions - Emergency Response + Air, Land and Sea Rescue (USA).zip: 504 from $s%!(EXTRA string=http://mirror.screenscraper.fr/api/mediaJeu.php?crc=&devid=&devpassword=&jeuid=83014&maxwidth=400&md5=&media=ss&mediaformat=png&sha1=&softname=sselph%2Fscraper&systemeid=12)
                                        panic: runtime error: invalid memory address or nil pointer dereference
                                        [signal 0xc0000005 code=0x0 addr=0x14 pc=0x408fe7]

                                        goroutine 31 [running]:
                                        panic(0x7e9580, 0x1137e030)
                                        /usr/local/go/src/runtime/panic.go:500 +0x331
                                        main.crawlROMs.func2(0x120b29d0, 0x11dcb540, 0x0, 0x120b29c0, 0x1287e0c0, 0x1287e040)
                                        /home/sselph/go/src/github.com/sselph/scraper/scraper.go:295 +0x527
                                        created by main.crawlROMs
                                        /home/sselph/go/src/github.com/sselph/scraper/scraper.go:328 +0xbd7

                                        paradadf 1 Reply Last reply Reply Quote 0
                                        • paradadf
                                          paradadf Staff @rsn8887 last edited by paradadf

                                          @rsn8887 I read on the UXS thread that gba was having problems the last couple of days... Do you still have this problem? Does it happen with any system or only gba?
                                          I've also encounter some single roms which had wrong data on SS and thus "broke" the scraping process.
                                          So please,

                                          • try to scrape gba again
                                          • try scraping any other system to see if you still get an error
                                          • if other systems work and if the problematic rom is one of the first ones, try removing it. (And give me the name)

                                          I'n not on my computer right now, so I can't test.

                                          Update: This is what I had read

                                          https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/issues/142

                                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                          1 Reply Last reply Reply Quote 0
                                          • rsn8887
                                            rsn8887 last edited by

                                            @paradadf
                                            Other systems show the same problem, but some don't. For example gb scraped fine completely through all roms, but gba and n64 didn't. I tried to remove a few roms where the error appears, but then it just happens at a later rom. Judging from that 504 error message, it seems to have something to do with mirror.screenscraper.fr . As I said it all worked perfectly on the weekend a few days ago.

                                            paradadf 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            77
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com