If you are actively using my Rocksmith+ Songs database in any way, but feel your region is unreliable, missing, or not updated often enough, you can help out.
The more people assisting in the scraping, from more places, the better the data gets. I have prepared this by preparing a docker container that will execute the scrape. The container is actively maintained as features are added, or changes in the API done, so that we can harvest data in the most efficient way.
I assume you have installed docker on your system, this will not be a tutorial in how to install docker or what you can do with docker. If you are familiar with how docker works and how to set it up on your system, just pull the latest image from ghcr.io/skippern/rsplus-scraper:latest . I would recommend scheduling the job, preferably daily, but any schedule that fits you better is also apriciated.
I myself have added the following to /etc/crontab on my Ubuntu linux:
You can also have an instance run continuous with docker compose using the following docker-compose.yaml-file. Save it anywhere and run docker compose up -d from the location where you saved it. I also do run an instance in this way.
Ensure you check the box to use wsl in the installer
Ensure docker cli is available, docker --version
Pull the image, docker pull ghcr.io/skippern/rsplus-scraper:latest
Run the image in a container, docker run -d ghcr.io/skippern/rsplus-scraper:latest
From here, you can run docker ps and see the container is up and runnning.
Running Docker on Windows10
I have had feedback that the Windows 11 instruction might work on Windows 10, I have not been able to replecate that in Windows 10. At current time I havn’t been able to get docker working in Windows 10.
Running Docker on Mac
Before starting you need to download two things, Docker Desktop for Mac, and MacPorts (you could probably do a similar approach with HomeBrew, but I am familiar with MacPorts). After installing Docker Dektop and MacPorts, run the following commands in a terminal:
sudo port selfupdate
sudo port install docker
Now you need to open Docker Desktop, you only need it for the docker demon. You will be asked several questions during the first start. You DO NOT need to register an account with Docker Hub, the following commands will work without login:
sudo docker pull ghcr.io/skippern/rsplus-scraper:latest
sudo docker run -d ghcr.io/skippern/rsplus-scraper:latest
Updating the Docker image
This description should be the same cross platforms. If the docker image does not renew by itself, run the following commands. This will remove the current image and pull a new docker image from the hub before running it: