Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240622
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • fullskull
      fullskull @paradadf last edited by

      @paradadf si lo hago desde macintosh, ¿crees que me podria ir mejor? tambien tengo linux ubuntu pero no se como hacer para ejecutarlo desde ahi.

      paradadf 1 Reply Last reply Reply Quote 0
      • paradadf
        paradadf Staff @fullskull last edited by

        @fullskull si utilizas la version bash, funciona desde mac y linux. En la carpeta de github te dice como hacerlo. Primero le das permisos de escritura con chmod y luego lo ejecutas.
        De todas formas, siempre y cuando tengas powershell instalado en tu version de windows, podes utilizar esa version sin problemas.

        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

        fullskull 1 Reply Last reply Reply Quote 0
        • fullskull
          fullskull @paradadf last edited by

          @paradadf ,men, no doy con ello, no se como arrancarlo desde mac y es que en el enlace de descarga tampoco dan mucha instrucción, tal vez si, pero quizá para los mas entendidos. Quizá un tutoría con el paso a paso de como hacerlo funcionar estaría bastante bien. Luego no se porque, al darme por vencido con el fast scraper e intentado probar el universal XML scraper y aunque me ha descargado todo los snapshots, me sigue mostrando la ruta de los juegos como una lista, sin añadir su foto correspondiente.

          paradadf 1 Reply Last reply Reply Quote 0
          • paradadf
            paradadf Staff @fullskull last edited by

            @fullskull no tengo una mac o sea que no podria indicarte exactamente como abrir una terminal en la carpeta que desees, pero voy a intentar mostrar paso a paso como hacerlo en windows ni bien tenga tiempo. (Pero estoy muy ocupado actualmente y puede que me tome un tiempo hacerlo)

            If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

            fullskull 1 Reply Last reply Reply Quote 0
            • fullskull
              fullskull @paradadf last edited by

              @paradadf Nada tranki, se agradece tu esfuerzo y dedicacion en haras de los usuarios mas novatos de recalbox (yo me incluyo) Tu cuando puedas. Gracias.

              1 Reply Last reply Reply Quote 0
              • fullskull
                fullskull last edited by

                Una pregunta paradadf, en el universalXMLscraper, veo que me hace el "scrapeo" pero, cuando termina, creo que solo descarga las imagenes pero el "gamelist.xml" no lo edita, quiero decir, creo que el problema que estoy teniendo es que el programa solo me descarga las imagenes pero no modifica ese archivo para hacer constar a RECALBOX de que ese sistema las tiene. ¿Hay algun apartado donde se le diga al "universalXMLscraper" que lo modifique tambien? Gracias.

                paradadf 1 Reply Last reply Reply Quote 0
                • paradadf
                  paradadf Staff @fullskull last edited by

                  @fullskull mejor busca el hilo del uxs en español o ingles para hablar al respecto, pero el problema que mencionas se da cuando no detenes emulationstation antes de hacer el scrape. Cerciorarte visualmente que realmente ES este detenido antes de scrapear. Podes forzarlo con un teclado presionando F4.

                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                  1 Reply Last reply Reply Quote 0
                  • Pablo Macaluso
                    Pablo Macaluso last edited by

                    Genial probando... mejor que el USX ... Ya que nunca me funciono

                    1 Reply Last reply Reply Quote -1
                    • saulob
                      saulob last edited by saulob

                      I tried the bat yesterday. It worked. It's fast! That was amazing.

                      I copied the new gamelist file (replaced the old one) and the downloaded_images folder. Replaced everything. When I tried it on recalbox nothing was changed. Everything was the old one, including the images. What's wrong?

                      I restarted it, and same thing. I executed the 'update game list' and still the same. What I'm doing wrong?

                      Thanks 🙂

                      Edit: Sorry for the late reply. I will try stoping the emulationstation before trying again. Thanks

                      paradadf 1 Reply Last reply Reply Quote 0
                      • paradadf
                        paradadf Staff @saulob last edited by

                        @saulob yes, ES must be stopped before trying to modify the gamelist.xml

                        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                        saulob 1 Reply Last reply Reply Quote 0
                        • saulob
                          saulob @paradadf last edited by

                          @paradadf thanks. I did and it worked 😉

                          But what about the game versions? I mean, check the attached image, the tmnt game has differences but it's all the same name. How can It showing the right version?

                          like: Game title (World 4 players) , Game title (2 players version) , something like that

                          alt text

                          paradadf 1 Reply Last reply Reply Quote 0
                          • paradadf
                            paradadf Staff @saulob last edited by

                            @saulob for console games, I believe by default the batch shows all extras in the game's name. With arcade roms, if you are having the behaviour showed in the picture, try opening the batch an changing the flags for that. Everything should be explained there.

                            If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                            saulob 1 Reply Last reply Reply Quote 0
                            • saulob
                              saulob @paradadf last edited by

                              @paradadf It's kinda hard.Found nothing about the names.

                              I fixed using another scrap, mamescraper. Worked good on the names, perfect everything detailed.

                              1 Reply Last reply Reply Quote 0
                              • elvis56nl
                                elvis56nl last edited by elvis56nl

                                I recently started started using emulationstation and recalbox on the pi 3 and fastscraper seems to be the best scraping option by far. I had some trouble getting fastscraper to work because of the system language detection but i was able to remove that part from the script and now all seems to be fine.

                                I was thinking of this feature that could be useful I think: Besides the current function of adding -image and -marquee download all available images for a rom and add descriptors to the filenames accordingly. For instance something like this:

                                Aladdin (USA)-title.png
                                Aladdin (USA)-ingame.png
                                Aladdin (USA)-boxfront.png
                                Aladdin (USA)-boxback.png
                                Aladdin (USA)-box3d.png
                                Aladdin (USA)-cart.png
                                Aladdin (USA)-marquee.png
                                Aladdin (USA)-wheel.png
                                Aladdin (USA)-flyer.png
                                Aladdin (USA)-mix2.png
                                Aladdin (USA)-mix3.png
                                Aladdin (USA)-mix4.png
                                Would something like this be possible or does it have to be added to the scraper itself?

                                paradadf 1 Reply Last reply Reply Quote 0
                                • paradadf
                                  paradadf Staff @elvis56nl last edited by

                                  @elvis56nl

                                  Would something like this be possible or does it have to be added to the scraper itself?

                                  That's something sselph would need to add to his scraper.

                                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                  elvis56nl 1 Reply Last reply Reply Quote 0
                                  • elvis56nl
                                    elvis56nl @paradadf last edited by

                                    @paradadf
                                    With some creative thinking i was able to make the script do what I had in mind. I decided I wanted my images in subfolders without suffixes as this makes the roms and media work in both emulation station and attract mode easily.

                                    I ended up making several batchfiles: fastscraper_box2d.bat, fastscraper_box3d.bat, fastscraper_snap.bat, fastscraper_mix3.bat which all downloaded the specified image type into subfolders. After running all 4 batch files I end up with all available images in the romdir sorted into the subfolders box2d, box3d, mix3, snap and video. I feel this is the best way to store roms and media files as it is self contained and can easily be moved from one installation to another.

                                    paradadf 1 Reply Last reply Reply Quote 0
                                    • paradadf
                                      paradadf Staff @elvis56nl last edited by

                                      @elvis56nl good you found the script useful.
                                      Anyway, currently you can't download every single media type from screenscraper with sselph's scraper, as you wanted.

                                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                      1 Reply Last reply Reply Quote 0
                                      • elvis56nl
                                        elvis56nl last edited by

                                        Messing around with the batch file I came across something strange, when console image type is set to mix3 and on running the script you select all it downloads the 2d cover images. When selecting a specific system when running the script it downloads the mix3 images correctly.

                                        I'm not sure if this is because of something I changed in the script as I can't run any of the fastscraper scripts released in the last 8 months or so unmodified. I always get an error on detecting system language.

                                        paradadf 1 Reply Last reply Reply Quote 0
                                        • paradadf
                                          paradadf Staff @elvis56nl last edited by

                                          @elvis56nl the script isn't guilty of that... it happens when I scrape too, sometimes.

                                          About the language recognition... you could force it by placing the right parameter in the right place. Otherwise I'd need some logs to see where the problem is.

                                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                          1 Reply Last reply Reply Quote 0
                                          • Anonpebbles
                                            Anonpebbles last edited by

                                            Hello, this is a minor issue but I'm currently trying to scrape my dreamcast games, however it doesnt seem to recognise the "dreamcast" folder. I have tried renaming it to dc, segadreamcast and dreamcast but no results. This text file appears in the folder after attempting scraping:
                                            Game,Error,Hash,Extra dreamcast\scraper.exe,hash not found,,

                                            Any help would be greatly appreciated! Thanks fellas

                                            Rpi 3 wew

                                            paradadf 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            79
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com