Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [TUTO] Scraper ses ROMs depuis ... sa recalbox, en shell ! also in english

    Community projects
    scrape scraping
    37
    109
    64470
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • benoit-lamarque
      benoit-lamarque last edited by

      salut à tous merci pour cet outil par contre j'y arrive pas pour ngpc merci d'avance

      1 Reply Last reply Reply Quote 0
      • jorgemms
        jorgemms last edited by

        ok, it works, but the problem is that gamelists are made but the images??? where i can take it to put it in the downloaded_images folder and make it work??

        1 Reply Last reply Reply Quote 0
        • guy57
          guy57 last edited by

          Ben moi, ça n'as pas marché, il a fait 1 heure de ligne de commande mais aucun résultat sous recalbox, du coup, passage en manuel 😞

          1 Reply Last reply Reply Quote 0
          • Substring
            Substring last edited by

            ngpc n'est pas dans la liste des systèmes connus pour scraper

            Former dev - Please reply with @substring so that i am notified when you answer me
            Ex dev - Merci de me répondre en utilisant @substring pour que je sois notifé

            1 Reply Last reply Reply Quote 0
            • calle81
              calle81 last edited by

              Hi, I cant get this to work. Have a rpi3 with v4 beta 2. Clean install and lots of no intro rom sets. I run the scraper. eg ./fullscrape.sh sega32x but all i get is an empy xml file containing this: <?xml version="1.0"?> <gameList />   and no pictures are download. No error messages while running the script. Please help

              1 Reply Last reply Reply Quote 0
              • obilolo
                obilolo last edited by

                Bonjour, Merci pour cet outil ! Sur la 4.0.0 beta 2 ça a très bien marché. J'ai laissé tourné la nuit donc je ne sais pas combien de temps ça a pris et je n'ai pas tout vérifié mais pour ce que j'ai testé (et sur les plateformes supportées), tout était bon. Vraiment pratique !

                1 Reply Last reply Reply Quote 0
                • ?
                  Guest last edited by

                  As I've said before, thanks for this great scraper and especially because of the quick port for RBv4, but is there any way to make the scraper strip game names of things like "(Europe)", "(Europe) (En,Fr,De,Es,It)", etc? "Just" like the ES scraper does? That would be killer!

                  1 Reply Last reply Reply Quote 0
                  • swisstoni
                    swisstoni last edited by

                    Ive got a Raspberry Pi 3  with V4 beta 2 and im having the same problem as calle81 no images and an empty XML file also no errors whilst running, has anyone managed to get this working on a Pi3?

                    1 Reply Last reply Reply Quote 0
                    • Substring
                      Substring last edited by

                      @swisstoni it does work on pi3. Have you used the 4.0.0 link on the wget ? @nachtgarm the scrapper is not a name stripper 😉 Renaming is beyond its scope

                      Former dev - Please reply with @substring so that i am notified when you answer me
                      Ex dev - Merci de me répondre en utilisant @substring pour que je sois notifé

                      1 Reply Last reply Reply Quote 0
                      • chamilonster
                        chamilonster last edited by

                        HI, when i scrape my games, and restart the recalbox some systems are empty again.... i have well scrape nes, snes and mastersystem, but if i scrape n64 (for exaple) it will be ok until i reset recalbox... why? the same whit favorites... i save nes a snes in and no problem , but no with n64 (for example)... i think take all the files, restart an put the files again...

                        1 Reply Last reply Reply Quote 0
                        • ?
                          Guest last edited by

                          @Subs: You're right, but I thought, that it might be possbile to have it like ES does and only use the DB Names after scraping, but instead in uses the filenames. That is not a problem, or a complaint, but was just an idea for a possible enhancement of the scraper 😉 As said before. Kudos for the scraper 🙂

                          1 Reply Last reply Reply Quote 0
                          • chamilonster
                            chamilonster last edited by

                            i found my problem, it was my gamelist.xml... it is clean inside and have to say at lease: <?xml version="1.0"?> <gameList>

                            1 Reply Last reply Reply Quote 0
                            • abioneperhobby
                              abioneperhobby last edited by

                              THANKS for this avesome Project from Italy ^_^ I suggest to

                              • edit english translation of the tutorial adding pi3 script. only in the french version the pi3 version of the scraper is reported.
                              • write was is scraper created for : at the beginning i thinked that scraper will automatically download every roms for me 🙂

                              thanks.

                              1 Reply Last reply Reply Quote 0
                              • s-kargo
                                s-kargo last edited by

                                Salut à tous. j'ai tenté d'utiliser cette astuce pour scraper mes jeux, mais ça ne donne rien. Ma config : pi3 Méthode : je passe par putty en ssh pour faire les manip de scrapp Comment je procède : Je copie mes jeux dans le pi avec le partage de connexion. je me connecte au pi via putty. Je lance les commande wget https://raw.githubusercontent.com/substring/fullscrape/4.0.0/fullscrape.sh -O fullscrape.sh puis chmod u+x ./fullscrape.sh et ensuite je lui dis de scrapper uniquement les jeux contenu dans le dossier supernes avec la commande : ./fullscrape.sh snes et voilà ce que j'ai d'afficher : «# ./fullscrape.sh snes +++ Downloading and unzipping scraper ... ARCH = rpi2 -> the scraper (v1.0.10) will run on 4 core(s) - Downloading from ht tps://github.com/sselph/scraper/releases/download/v1.0.10/scraper_rpi2.zip Archive: /tmp/scraper_rpi2.zip inflating: scraper +++ Shutting down EmulationStation to avoid ES rewriting the gamelist.xml files ... Waiting for emulationstation (pid 268) to shutdown ..--- zx81 not set for scrapi ng according to commandline --- megadrive not set for scraping according to commandline --- scummvm not set for scraping according to commandline --- prboom not set for scraping according to commandline --- amstradcpc not set for scraping according to commandline --- gamegear not set for scraping according to commandline --- mame not set for scraping according to commandline --- gw not set for scraping according to commandline --- atari2600 not set for scraping according to commandline --- moonlight not set for scraping according to commandline --- vectrex not set for scraping according to commandline --- zxspectrum not set for scraping according to commandline --- nes not set for scraping according to commandline --- fba_libretro not set for scraping according to commandline --- pcengine not set for scraping according to commandline --- sega32x not set for scraping according to commandline --- o2em not set for scraping according to commandline --- atari7800 not set for scraping according to commandline --- mastersystem not set for scraping according to commandline --- fba not set for scraping according to commandline --- wswan not set for scraping according to commandline --- atarist not set for scraping according to commandline --- ngp not set for scraping according to commandline --- fds not set for scraping according to commandline --- psx not set for scraping according to commandline --- virtualboy not set for scraping according to commandline +++ Scraping snes 2016/04/05 20:21:39 INFO: Checking for new hash.csv. 2016/04/05 20:21:39 INFO: hash.csv "5db5b721700b9c87ec273a7820f917ce" up to date . It appears that thegamesdb.net isn't up. If you are sure it is use -skip_check t o bypass this error. --- n64 not set for scraping according to commandline --- lynx not set for scraping according to commandline --- gba not set for scraping according to commandline --- segacd not set for scraping according to commandline --- sg1000 not set for scraping according to commandline --- gb not set for scraping according to commandline --- cavestory not set for scraping according to commandline --- neogeo not set for scraping according to commandline --- msx not set for scraping according to commandline --- gbc not set for scraping according to commandline --- lutro not set for scraping according to commandline +++ Restarting ES ... # lvl0: System "favorites" is missing name, path, extension, or command! sh: warning: setlocale: LC_ALL: cannot change locale (fr_FR.UTF-8) /bin/bash: warning: setlocale: LC_ALL: cannot change locale (fr_FR.UTF-8) # » et il ne ce passe rien. et je n'ai rien de changer dans le dossier snes 😞 Cela fait 3 jours que je suis sur le problème, et je n'arrive à rien. J'espère que des personnes pourront m'aider. Merci d'avance.

                                1 Reply Last reply Reply Quote 0
                                • rockaddicted
                                  rockaddicted last edited by

                                  Hello le site thegamesdb.net sur lequel se base les scrapeurs est down... Il faut donc attendre que ce dernier soit remis en ligne.

                                  Recalbox V4.1.0 - RPI3 OC - Xbox360 wireless
                                  Wiki ENG : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(EN)
                                  Wiki FR : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(FR)

                                  Don't forget to upvote messages if it has been useful ;)

                                  1 Reply Last reply Reply Quote 0
                                  • s-kargo
                                    s-kargo last edited by

                                    comme par hasard xD. est il possible de changer de scraper avec cette méthode? en utilisant comme source screen scrapper. ?

                                    1 Reply Last reply Reply Quote 0
                                    • rockaddicted
                                      rockaddicted last edited by

                                      avec ce scraper, non. Mais tu peux utiliser le scraper de screech qui lui se base sur screenscraper http://blog.recalbox.com/forums/topic/soft-universal-xml-scraper-scrappez-vos-roms-en-fr/

                                      Recalbox V4.1.0 - RPI3 OC - Xbox360 wireless
                                      Wiki ENG : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(EN)
                                      Wiki FR : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(FR)

                                      Don't forget to upvote messages if it has been useful ;)

                                      1 Reply Last reply Reply Quote 0
                                      • gaetan-colombier
                                        gaetan-colombier last edited by

                                        Hello, j'ai testé le script mais thegamesdb est toujours down, ça arrive souvent ? Merci pour le boulot en tout cas 🙂

                                        1 Reply Last reply Reply Quote 0
                                        • pedro
                                          pedro last edited by

                                          Hi, I used this method to scrap mame and the terminal on mac shows this: +++ Restarting ES ... # lvl0:     System "favorites" is missing name, path, extension, or command! sh: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8) /bin/bash: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8) What I'm doing wrong? Thanks

                                          1 Reply Last reply Reply Quote 0
                                          • pedro
                                            pedro last edited by

                                            Hi, This method is working for me now; "wget https://raw.githubusercontent.com/substring/fullscrape/4.0.0/fullscrape.sh && chmod u+x ./fullscrape.sh Then ./fullscrape.sh or ./fullscrape.sh systemname you can also do -u to only update art you do not have ./fullscrape.sh -u snes would update any art for snes you do not" But at the end still says; "+++ Restarting ES … # lvl0:     System “favorites” is missing name, path, extension, or command! sh: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8) /bin/bash: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8)"

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            81
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com