Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [TUTO] Scraper ses ROMs depuis ... sa recalbox, en shell ! also in english

    Community projects
    scrape scraping
    37
    109
    64468
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • chamilonster
      chamilonster last edited by

      HI, when i scrape my games, and restart the recalbox some systems are empty again.... i have well scrape nes, snes and mastersystem, but if i scrape n64 (for exaple) it will be ok until i reset recalbox... why? the same whit favorites... i save nes a snes in and no problem , but no with n64 (for example)... i think take all the files, restart an put the files again...

      1 Reply Last reply Reply Quote 0
      • ?
        Guest last edited by

        @Subs: You're right, but I thought, that it might be possbile to have it like ES does and only use the DB Names after scraping, but instead in uses the filenames. That is not a problem, or a complaint, but was just an idea for a possible enhancement of the scraper 😉 As said before. Kudos for the scraper 🙂

        1 Reply Last reply Reply Quote 0
        • chamilonster
          chamilonster last edited by

          i found my problem, it was my gamelist.xml... it is clean inside and have to say at lease: <?xml version="1.0"?> <gameList>

          1 Reply Last reply Reply Quote 0
          • abioneperhobby
            abioneperhobby last edited by

            THANKS for this avesome Project from Italy ^_^ I suggest to

            • edit english translation of the tutorial adding pi3 script. only in the french version the pi3 version of the scraper is reported.
            • write was is scraper created for : at the beginning i thinked that scraper will automatically download every roms for me 🙂

            thanks.

            1 Reply Last reply Reply Quote 0
            • s-kargo
              s-kargo last edited by

              Salut à tous. j'ai tenté d'utiliser cette astuce pour scraper mes jeux, mais ça ne donne rien. Ma config : pi3 Méthode : je passe par putty en ssh pour faire les manip de scrapp Comment je procède : Je copie mes jeux dans le pi avec le partage de connexion. je me connecte au pi via putty. Je lance les commande wget https://raw.githubusercontent.com/substring/fullscrape/4.0.0/fullscrape.sh -O fullscrape.sh puis chmod u+x ./fullscrape.sh et ensuite je lui dis de scrapper uniquement les jeux contenu dans le dossier supernes avec la commande : ./fullscrape.sh snes et voilà ce que j'ai d'afficher : «# ./fullscrape.sh snes +++ Downloading and unzipping scraper ... ARCH = rpi2 -> the scraper (v1.0.10) will run on 4 core(s) - Downloading from ht tps://github.com/sselph/scraper/releases/download/v1.0.10/scraper_rpi2.zip Archive: /tmp/scraper_rpi2.zip inflating: scraper +++ Shutting down EmulationStation to avoid ES rewriting the gamelist.xml files ... Waiting for emulationstation (pid 268) to shutdown ..--- zx81 not set for scrapi ng according to commandline --- megadrive not set for scraping according to commandline --- scummvm not set for scraping according to commandline --- prboom not set for scraping according to commandline --- amstradcpc not set for scraping according to commandline --- gamegear not set for scraping according to commandline --- mame not set for scraping according to commandline --- gw not set for scraping according to commandline --- atari2600 not set for scraping according to commandline --- moonlight not set for scraping according to commandline --- vectrex not set for scraping according to commandline --- zxspectrum not set for scraping according to commandline --- nes not set for scraping according to commandline --- fba_libretro not set for scraping according to commandline --- pcengine not set for scraping according to commandline --- sega32x not set for scraping according to commandline --- o2em not set for scraping according to commandline --- atari7800 not set for scraping according to commandline --- mastersystem not set for scraping according to commandline --- fba not set for scraping according to commandline --- wswan not set for scraping according to commandline --- atarist not set for scraping according to commandline --- ngp not set for scraping according to commandline --- fds not set for scraping according to commandline --- psx not set for scraping according to commandline --- virtualboy not set for scraping according to commandline +++ Scraping snes 2016/04/05 20:21:39 INFO: Checking for new hash.csv. 2016/04/05 20:21:39 INFO: hash.csv "5db5b721700b9c87ec273a7820f917ce" up to date . It appears that thegamesdb.net isn't up. If you are sure it is use -skip_check t o bypass this error. --- n64 not set for scraping according to commandline --- lynx not set for scraping according to commandline --- gba not set for scraping according to commandline --- segacd not set for scraping according to commandline --- sg1000 not set for scraping according to commandline --- gb not set for scraping according to commandline --- cavestory not set for scraping according to commandline --- neogeo not set for scraping according to commandline --- msx not set for scraping according to commandline --- gbc not set for scraping according to commandline --- lutro not set for scraping according to commandline +++ Restarting ES ... # lvl0: System "favorites" is missing name, path, extension, or command! sh: warning: setlocale: LC_ALL: cannot change locale (fr_FR.UTF-8) /bin/bash: warning: setlocale: LC_ALL: cannot change locale (fr_FR.UTF-8) # » et il ne ce passe rien. et je n'ai rien de changer dans le dossier snes 😞 Cela fait 3 jours que je suis sur le problème, et je n'arrive à rien. J'espère que des personnes pourront m'aider. Merci d'avance.

              1 Reply Last reply Reply Quote 0
              • rockaddicted
                rockaddicted last edited by

                Hello le site thegamesdb.net sur lequel se base les scrapeurs est down... Il faut donc attendre que ce dernier soit remis en ligne.

                Recalbox V4.1.0 - RPI3 OC - Xbox360 wireless
                Wiki ENG : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(EN)
                Wiki FR : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(FR)

                Don't forget to upvote messages if it has been useful ;)

                1 Reply Last reply Reply Quote 0
                • s-kargo
                  s-kargo last edited by

                  comme par hasard xD. est il possible de changer de scraper avec cette méthode? en utilisant comme source screen scrapper. ?

                  1 Reply Last reply Reply Quote 0
                  • rockaddicted
                    rockaddicted last edited by

                    avec ce scraper, non. Mais tu peux utiliser le scraper de screech qui lui se base sur screenscraper http://blog.recalbox.com/forums/topic/soft-universal-xml-scraper-scrappez-vos-roms-en-fr/

                    Recalbox V4.1.0 - RPI3 OC - Xbox360 wireless
                    Wiki ENG : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(EN)
                    Wiki FR : https://github.com/recalbox/recalbox-os/wiki/Mini-How-To-(FR)

                    Don't forget to upvote messages if it has been useful ;)

                    1 Reply Last reply Reply Quote 0
                    • gaetan-colombier
                      gaetan-colombier last edited by

                      Hello, j'ai testé le script mais thegamesdb est toujours down, ça arrive souvent ? Merci pour le boulot en tout cas 🙂

                      1 Reply Last reply Reply Quote 0
                      • pedro
                        pedro last edited by

                        Hi, I used this method to scrap mame and the terminal on mac shows this: +++ Restarting ES ... # lvl0:     System "favorites" is missing name, path, extension, or command! sh: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8) /bin/bash: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8) What I'm doing wrong? Thanks

                        1 Reply Last reply Reply Quote 0
                        • pedro
                          pedro last edited by

                          Hi, This method is working for me now; "wget https://raw.githubusercontent.com/substring/fullscrape/4.0.0/fullscrape.sh && chmod u+x ./fullscrape.sh Then ./fullscrape.sh or ./fullscrape.sh systemname you can also do -u to only update art you do not have ./fullscrape.sh -u snes would update any art for snes you do not" But at the end still says; "+++ Restarting ES … # lvl0:     System “favorites” is missing name, path, extension, or command! sh: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8) /bin/bash: warning: setlocale: LC_ALL: cannot change locale (es_ES.UTF-8)"

                          1 Reply Last reply Reply Quote 0
                          • nosh2
                            nosh2 Banned last edited by

                            J'ai rajouter le scrapping d'autres systèmes. La Nintendo Virtualboy (environ 90% du fullset reconnue 17/22) et celui de la SG1000 (environ 50% en étant optimiste) peuvent être rajouter. Maintenant je comprend pas pourquoi la Fanicom Disk System (FDS sur TheGameDB), l'Odyssey2 (Odyssey2 sur TheGameDB) et d'autres n'ont pas fonctionner. Pour l'odyssey2, peut être un problème avec le nom du dossier ?

                            1 Reply Last reply Reply Quote 0
                            • gattinogerry
                              gattinogerry last edited by

                              prejudice , and you can do the manual scraper downloading the screenshhot of mame ?

                              1 Reply Last reply Reply Quote 0
                              • enriqu3
                                enriqu3 last edited by

                                Bonjour,

                                Pour tester ça j'ai voulu essayé de scraper la Gameboy.

                                Après avoir installé de wget, j'ai tapé

                                bash ./fullscrap.sh -u gb

                                et j'obtiens

                                No such file or directory

                                vous avez une piste ?

                                1 Reply Last reply Reply Quote 0
                                • Substring
                                  Substring last edited by

                                  Il te manque un e à fullscrape.sh

                                  Former dev - Please reply with @substring so that i am notified when you answer me
                                  Ex dev - Merci de me répondre en utilisant @substring pour que je sois notifé

                                  1 Reply Last reply Reply Quote 0
                                  • screech
                                    screech last edited by

                                    Sinon tu peux essayer Universal XML Scraper 😉

                                    Clean your Romset with Universal ROM Cleaner
                                    Scrape your Romset with Universal XML Scraper

                                    1 Reply Last reply Reply Quote 0
                                    • enriqu3
                                      enriqu3 last edited by

                                      @screech said in [TUTO] Scraper ses ROMs depuis ... sa recalbox, en shell ! also in english:

                                      Sinon tu peux essayer Universal XML Scraper 😉

                                      Je suis sous mac 😉 dommage ...

                                      J'ai donc essayé de scrapper la snes (pour tester)
                                      en tapant :

                                      bash ./fullscrape.sh -u snes

                                      il m'a indiqué qu'il ne trouvait pas le dossier /share/system/.emulationstation/gamelist/snes/gamelist.xml

                                      Ensuite il a passé en revue toute mes roms snes et évidement ça n'a donné aucun résultat.

                                      Le truc c'est que en effet moi non plus je ne trouve pas de dossier .emulationstation dans mon dossier share/system !!!! où est-il ? c'est pas normal ça !

                                      1 Reply Last reply Reply Quote 0
                                      • acris
                                        acris last edited by acris

                                        Bonsoir
                                        .emulationstation est un dossier caché il faut autoriser l affichage des fichiers cachés sur ton macOS
                                        assures toi d avoir pris le bon script pour ecalbox 4.0.0 car j ai pas l impression,
                                        sous recalbox 4 les images et fichiers sont stockés dans le dossier des roms

                                        il faut utiliser ce lien : https://raw.githubusercontent.com/substring/fullscrape/4.0.0/fullscrape.sh

                                        1 Reply Last reply Reply Quote 0
                                        • enriqu3
                                          enriqu3 last edited by

                                          Acris,

                                          Merci pour cette réponse , en effet je n'avais pas le bon fichier fullscrape.sh, merci pour ton lien 😉

                                          Le scrap fonctionne parfaitement !

                                          Bonne soirée

                                          1 Reply Last reply Reply Quote 0
                                          • dassoun
                                            dassoun last edited by

                                            Bonjour,
                                            J'ai employé la méthode hier, et pour un romset mame, ça dégrossit bien le truc!
                                            En revanche, il n'a récupéré aucune image, c'est normal?

                                            Pour discuter, échanger sur la réalisation d'Arcade Box:
                                            https://www.facebook.com/ArcadeBoxCergy/

                                            Substring 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            83
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com