Huge Update To Ad List That The Pi-hole Uses

[UPDATE]: Phil shared an adList.conf from February 2015, which you can download and put onto your Pi if you already overwrote it with the big list mentioned in this post.  From your Pi, you can run this command:

sudo curl -s -o /etc/dnsmasq.d/adList.conf https://dl.dropboxusercontent.com/u/16366947/Files/adList-2015-02.conf

The mahakala ad list just had a huge update, which pushes the compiled list of domains to over 900K entries, which unfortunately makes the Pi-hole perform poorly (but there is a fix).  See the output of the gravity script below (it looks a little different because of some changes I made in the development branch).

Getting adaway.org list...
Getting adblock.gjtech.net list...
Getting adblock.mahakala.is list...
Getting hosts-file.net list...
Getting www.malwaredomainlist.com list...
Getting pgl.yoyo.org list...
Getting someonewhocares.org list...
Getting winhelp2002.mvps.org list...
** Aggregating list of domains...
** Blacklisting 2 domain(s)...
** Whitelisting 15 domain(s)...
** 975358 domains being pulled in by gravity...
** 920553 unique domains trapped in the event horizon.

Too Many Entries Makes The Pi-hole Perform Poorly

The Raspberry Pi has a hard time parsing such a huge list and the performance really takes a hit, which makes Web browsing very slow.  If you happen to have an adList.conf  from before the update, I would like to have it. Contact me if you do.  But for now, you will probably want to hold off on running the gravity script.

The Fix

If you already ran the script and have the huge list, you can comment out the line containing the mahakala domain and then run the script again.  The list will be smaller than before, and will not work quite as well.

Hosts Format

Alternatively, it has been said that using a hosts file format, will improve the performance, but I haven’t tested this yet…

Continuing Development

I just blog on the side and write scripts like the Pi-hole and mostly do it for fun.  But if you want to contribute something to the project, feel free using the buttons below.




Donate Bitcoins

I will be implementing things like:

8 Replies to “Huge Update To Ad List That The Pi-hole Uses”

      1. And thank YOU! I have had fun using your creation, appreciate the follow-up you do on it and the response you give to people who post about it! I hope you enjoy developing it as much as we enjoy you sharing it with us!

        1. I do have a lot of fun with it. It’s satisfying that other people enjoy it, too! The biggest issue I am working on now is performance with that last huge update to the list. You can check out my other branches of the project, which are already working better.

          1. Everyone should be careful running the above “sudo curl…” code snippet. It will overwrite your previous adList.conf with one redirecting ad domains to “192.168.1.68” (presumably the IP of Phil’s raspi).
            If that doesn’t happen to be your raspi’s IP, performance will be degraded when hosts try to query a non-existant IP, or try routing to a non-existant subnet. If you want to use it, you should run a sed command to change the ip to whatever you are using first.

          2. Oops. Nice job catching that. Thanks…I will be fixing the file soon, but in the meantime, you can run this command:

            curl -s https://dl.dropboxusercontent.com/u/16366947/Files/adList-2015-02.conf | sed 's/192.168.1.68/127.0.0.1/g' > /etc/dnsmasq.d/asdList.conf

            or if you already downloaded it:

            sed 's/192.168.1.68/127.0.0.1/g' /etc/dnsmasq.d/adList.conf > /tmp/adList.fixed
            sudo mv /tmp/adList.fixed /etc/dnsmasq.d/adList.conf

          3. The link in the post is fixed now and points to 127.0.0.1 instead of 192.168.1.68. Thanks for catching that!

            I also received a donation, which inspired me to do some more work. I have the new Pi-hole working pretty well with the new 900,000 entries. I just need to write up a post on it and then push the changes to Github. Keep an eye out in the coming weeks. Thanks.

Leave a Reply