echo "Include /etc/cherokee/catch-all.conf">>/etc/cherokee/cherokee.conf

Dnsmasq runs under a different user/group by default and will fail to read those files if read permissions are not set properly. It will not give any warning either and will ignore the whole nice setup.

\\

chmod 644 /etc/banner_add_hosts
chmod 644 /etc/banner_add_hosts.manual

echo "">/etc/banner_add_hosts

Create an empty file in which you can add some adservers yourself if you want to:\\

Dnsmasq runs under a different user/group by default and will fail to read those files if read permissions are not set properly. It will not give any warning either and will ignore the whole nice setup.
Set the permissions to allow dnsmasq to read those files:
chmod 644 /etc/banner_add_hosts chmod 644 /etc/banner_add_hosts.manual

1. not sure if we need this for dnsmasq

reloadcmd='/etc/init.d/dnsmasq restart'

1. restart dnsmasq (probably not needed)

$reloadcmd

'>/etc/dnsmasq.conf

There are a lot more flags that can be defined in dnsmasq.conf, but I ignore them all for my simple DNS server.

The first and last one should point to the new slug now.

Now add the (empty) image in the right place. You can either create it yourself, or download it like I did:

mkdir -p /usr/local/bin

Since openslug appears to use DHCP to get its ip address, I had to check my DHCP table (or ping to 192.168.1.255) to see where it went. It got 192.168.1.103 in my case, you might get a different address. I believe that if you start up your slug without a DHCP server in your network (or without the network cable attached) it will get 192.168.1.77.

From there I hit the Administration/Upgrade tab and uploaded new firmware, openslug-3.10-beta.bin this time. After that just wait.... beep! and it is alive.

Since openslug appears to use DHCP to get its ip address, I had to check my DHCP table (or ping to 192.168.1.255) to see where it went. It got 192.168.1.103 in my case, you might get a different address. I believe that if you start up your slug without a DNCP server in your network (or without the network cable attached) it will get 192.168.1.77.

Since openslug appears to use DHCP to get its ip address, I had to check my DHCP table (or ping to 192.168.1.255) to see where it went. It got 192.168.1.103 in my case, you might get a different address. I believe that if you start up your slug without a DNCP server in your network (or without the networkcable attached) it will get 192.168.1.77.

ARGS="-b"

Note: I had some trouble getting both dns and cherokee to start up automatically. It might have to do something with both getting S20/K20 scripts in the rc?.d directories. I changed one to become S21/K21 links. Seems to work now.

Now reboot the slug and see it catch the ads!
Check to see if all wanted processes are running using ps.

 [=

ipkg update

Here is the script (don't start with empty line):

 [=

1. !/bin/sh

 [=

ipkg install cherokee

 [=

mkdir -p /var/www/images

Replace the first 5 lines with (don't start with empty line):

 [=

1. !/bin/sh

 [=

[= turnup init

[=turnup init

[=ipkg update

[=#!/bin/sh

[=ipkg install cherokee

[=mkdir -p /var/www/images

[=#!/bin/sh

 [=#!/bin/sh

First I unwrapped a new box, to get my new NSLU2 out of it. I just received my new Slug today, the third one.
Of course, setting up OpenSlug was easy from the webinterface: turn slug on, attach my notebook and browse to http://192.168.1.77. \\

(:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

 
mkdir -p /var/www/images
wget -O /var/www/images/pixel.gif http://www.loremipsum.net/pixelgif/pics/pixel.gif

(:tableend:)

Of course, this script needs to be executable:\\

test it by using
dig doubleclick.com
dig cnn.com
nslookup cnn.com\\

Set up DNS

Retrieve the list of ad servers

1. short script that downloads a list of ad servers for use with
2. squid to block ads.
4. details on configuring squid itself can be found here:
6. http://pgl.yoyo.org/adservers/#withsquid
8. - originally by Stephen Patterson <steve@lexx.uklinux.net>
9. - butchered by Peter Lowe <pgl@yoyo.org>
10. - altered by Jelle Alten (hotmailaddres:jpalten) to suit his needs on OpenSlug

1. set things

1. the ipaddress where we want to send the requests to, instead of the bannerservers

addcatcherip='172.16.16.60'

1. the args to add to the request to the yoyo server, to tell it that we want
2. a hosts file and that we want to redirect to the addcatcher

listurlargs="hostformat=hosts&showintro=1&mimetype=plaintext&useip=$addcatcherip"

1. URL of the ad server list to download

listurl="http://pgl.yoyo.org/adservers/serverlist.php?$listurlargs"

1. location of the list of ad servers used by dnsmasq

targetfile='/etc/banner_add_hosts'

1. location of a file where hostnames not listed can be added

extrasfile='/etc/banner_add_hosts.manual'

1. command to reload squid - change according to your system
2. not used for dnsmasq

1. reloadcmd='/etc/init.d/squid reload'
2. temp file to use

tmpfile="/tmp/.adlist.$$"

1. command to fetch the list (alternatives commented out)

fetchcmd="/usr/bin/wget -q -O $tmpfile $listurl"

1. do things

echo "" echo "fetch: $fetchcmd" echo ""

1. get a fresh list of ad server addresses for dnsmasq to refuse

$fetchcmd

1. add the extras

[ -f "$extrasfile" ] && cat $extrasfile >> $tmpfile

1. check the temp file exists OK before overwriting the existing list

if [ ! -s $tmpfile ] then

	echo "temp file '$tmpfile' either doesn't exist or is empty; quitting"
	exit

fi

1. sort and filter out duplicates

sort $tmpfile > $targetfile

1. clean up

rm $tmpfile

1. restart dnsmasq? (probably not needed)
2. $reloadcmd

Of course, this script needs to be executable: chmod 700 /usr/local/bin/update_bannerhosts

Now run the script and see if it works. You have to adjust the DHCP server to send DNS requests to this new DNS server. You might need to renew your IP or reconnect your client to setup dhcp to point dns to this host. test it by using dig doubleclick.com dig cnn.com nslookup cnn.com nslookup doubleclick.com

It should point to the new slug now.

Auto-update the list

Now we have the script run automatically every 4 hours, using cron:
ipkg install cron

Edit the cront tab using
crontab -e

and add the line
0 0,4,8,12,16,18,20 * * * /usr/local/bin/update_bannerhosts

Install Cherokee webserver

(:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

 
ipkg install cherokee

echo "Include /etc/cherokee/catch-all.conf">>cherokee.conf

echo '
# rewrite all requests to serve /images/pixel.gif                                            
# with the original request as argument behind a "?"                                         
Request ".*" {                                                                               
    Handler redir {                                                                          
        Show Rewrite "/images/pixel.gif?"                                                         
    }                                                                                        
}                                                                                            

# this request will only return a file                                                       
# since it is lower than the request above, it will be handled 
# with higer priority
Request "/images/pixel.gif.*" {                                                              
        Handler file                                                                         
}                                                                                            

' > /etc/cherokee/catch-all.conf

(:tableend:)

Now add the (empty) image in the right place. You can either create it yourself, or download it like I did:
mkdir -p /var/www/images wget -O /var/www/images/pixel.gif http://www.loremipsum.net/pixelgif/pics/pixel.gif

You can start Cherokee by entering
cherokee

But you probably want to autostart Cherokee at boot time. To do so, borrow the start up script from dnsmasq:
cp /etc/init.d/dnsmasq /etc/init.d/cherokee
vi /etc/init.d/cherokee
Replace the first 5 lines with: (:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

 
#!/bin/sh
DAEMON=/usr/sbin/cherokee                                                                    
NAME=cherokee                                                                                
DESC="Cherokee webserver"                                                                    
ARGS="-C /etc/cherokee/cherokee-/etc/cherokee/cherokee-catch-all.conf"                       

(:tableend:)

Now reboot the slug and see it catch the ads!

1. I set up a dns server, using dnsmasq, to redirect all requests to ad servers (like doubleclick) to a local server
2. I set up a cron script to update the list of ad servers every four hours
3. I set up a Cherokee webserver to handle all requests and return a one by one transparent gif pixel

To get OpenSlug going, I went into the server using ssh:

turnup init

umount /dev/sda1 mkfs.ext3 /dev/sda1

turnup memstick -i /dev/sda1

reboot

date [MMDDhhmm?[[CC]YY]

I used 172.16.16.60 for this server, you can pick your own address. All directions below use this ip address for dns server and for the catch-all webserver.

Also create the usr/local/bin directory to put our local scripts in:\\

Now create a script that will fetch the list of adservers:\\

Now we have the script run automatically every 4 hours, using cron:\\

Edit the cront tab using\\

and add the line \\

Now add the (empty) image in the right place. You can either create it yourself, or download it like I did:
mkdir -p /var/www/images wget -O /var/www/images/pixel.gif http://www.loremipsum.net/pixelgif/pics/pixel.gif

You can start Cherokee by entering
cherokee

But you probably want to autostart Cherokee at boot time. To do so, borrow the start up script from dnsmasq:
cp /etc/init.d/dnsmasq /etc/init.d/cherokee
vi /etc/init.d/cherokee
Replace the first 5 lines with: (:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

 [=

=] (:tableend:)

To install the autostart script, do:
update-rc.d cherokee defaults

Now reboot the slug and see it catch the ads!

Create an empty file in which you can add some adservers yourself if you want to:\\

Also create the usr/local/bin directory to put our local scripts:\\

update_bannerhosts.txt Δ

As you can see, I use 172.16.16.60 for this server. All things after this will use this ip address as dns server and for the catch-all webserver.

Set up DNS server

I use dnsmasq as DNS server, but I don't care about it's DHCP capabilities, because I already have a DHCP server built in my router. The DHCP server will send the clients the specs of DNS servers to use, starting with this new one. Here is how I setup the DNS server:

1. add my own servers to the hosts file

1. make a very simple /etc/dnsmasq:

TODO: add the script here

Of course, this script needs to be executable: chmod 700 /usr/local/bin/update_bannerhosts

Now run the script and see if it works. You have to adjust the DHCP server to send DNS requests to this new DNS server. You might need to renew your IP or reconnect your client to

dig doubleclick.com dig cnn.com nslookup cnn.com nslookup doubleclick.com

It should point to the new slug now.

Now we have the script run automatically every 4 hours, using cron:

ipkg install cron Edit the cront tab using crontab -e

and add the line 0 0,4,8,12,16,18,20 * * * /usr/local/bin/update_bannerhosts

(:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

 [=

=] (:tableend:)

under construction

ssh root@192.168.1.103

1. date [MMDDhhmm?[[CC]YY]

(:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

 [=

echo "172.16.16.123 myfileserver" >> /etc/hosts

strict-order domain=mydomain.local

=] (:tableend:)

set the domainname: mydomain.local

Create an empty file in which you can add some adservers yourself if you want to: echo "">/etc/banner_add_hosts.manual

Also create the usr/local/bin directory to put our local scripts: mkdir -p /usr/local/bin'

Now create a script that will fetch the list of adservers:

/usr/local/bin/update_bannerhosts

(:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

(:tableend:)

(:table border=0 width=100% bgcolor=#eeeeff:) (:cell:)

 [=

=] (:tableend:)

ssh root@192.168.1.103

To get OpenSlug going, I used:

 [=

ssh root@192.168.1.103

1. turnup init

Host name [LKG7118F6?]: catcher Domain name [workgroup]: mydomain.local Boot protocol (dhcp|static) [dhcp]: static IP address [192.168.1.77]: 172.16.16.60 IP netmask [255.255.255.0]: IP gateway []: 172.16.16.44 First DNS server []: 195.121.1.34 Second DNS server []: 194.109.6.66 Third DNS server []: 194.109.9.99

1. umount /dev/sda1
2. mkfs.ext3 /dev/sda1
3. turnup memstick -i /dev/sda1
4. reboot

date [MMDDhhmm?[[CC]YY]

scratch::

ipkg update

ipkg install dnsmasq

echo "172.31.101.11 elaine" >> /etc/hosts

echo "172.31.101.10 cosmo" >> /etc/hosts

/etc/dnsmasq:

echo ' domain-needed bogus-priv strict-order addn-hosts=/etc/banner_add_hosts '>/etc/dnsmasq

uncomment strict-order uncomment addn-hosts=/etc/banner_add_hosts uncomment expand-hosts set the domainname: domain=lotenjelle.local comment dhcp-range (don't want to do dhcp, just dns)

echo "">/etc/banner_add_hosts.manual

mkdir -p /usr/local/bin cd /usr/local/bin wget -O update_bannerhosts http://172.16.16.48/update_bannerhosts.txt

1. echo "/usr/bin/wget -O /etc/banner_add_hosts 'http://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=1&startdate%5Bday%5D=&startdate%5Bmonth%5D=&startdate%5Byear%5D=&mimetype=plaintext&useip=172.31.101.11'" >> /usr/local/bin/update_bannerhosts
2. echo "cat /etc/banner_add_hosts.manual >> /etc/banner_add_hosts" >> /usr/local/bin/update_bannerhosts

chmod 700 /usr/local/bin/update_bannerhosts

setup dhcp to point dns to this host. test it by using

	dig doubleclick.com
	dig cnn.com
	nslookup cnn.com
	nslookup doubleclick.com

ipkg install cron

crontab -e 0 0,4,8,12,16,18,20 * * * /usr/local/bin/update_bannerhosts

ipkg install cherokee cp /etc/cherokee/cherokee.conf /etc/cherokee/cherokee-catch-all.conf

echo "Include /etc/cherokee/catch-all.conf">>cherokee.conf

echo '

1. rewrite all requests to serve /images/pixel.gif
2. with the original request as argument behind a "?"

Request ".*" {

    Handler redir {                                                                          
        Show Rewrite "/images/pixel.gif?"                                                         
    }                                                                                        

}

1. this request will only return a file
2. since it is lower than the request above, it will be handled first

Request "/images/pixel.gif.*" {

        Handler file                                                                         

}

' > /etc/cherokee/catch-all.conf

cherokee -C /etc/cherokee/cherokee-catch-all.conf

TODO: autostart cherokee add images/dummy.jpg

mkdir -p /var/www/images

update-rc.d scriptnaam start 4 stop 6

cp /etc/init.d/dnsmasq /etc/init.d/cherokee vi /etc/init.d/cherokee

replace the first 5 lines with:

1. !/bin/sh

DAEMON=/usr/sbin/cherokee NAME=cherokee DESC="Cherokee webserver" ARGS="-C /etc/cherokee/cherokee-/etc/cherokee/cherokee-catch-all.conf"

update-rc.d cherokee defaults

Fire up OpenSlug

First I unwrapped a new box, to get my new NSLU2 out of it. I just received my new Slug today, the third one. Of course, setting up OpenSlug was easy from the webinterface: turn slug on, attach my notebook and browse to http://192.168.1.77. From there I hit the Administration/Upgrade tqb and uploaded new firmware, openslug-3.10-beta.bin this time. After that just wait.... beep! and it is alive. Since openslug appears to use DHCP to get its ip address, I had to check my DHCP table (or ping to 192.168.1.255) to see where it went. It got 192.168.1.103 in my case, you might get a different address.

Purpose

I wanted to not see those annoying flashing ad images on webpages, and also reduce internet bandwidth by not downloading those images. Not for me or others in my network.

Overview

What I did was the following:

1. I set up a dns server, using dnsmasq, to redirect all request to ad servers (like doubleclick) to a local webserver
2. I set up a cron script to update the list of ad servers
3. I set up a cherokee webserver to handle all requests and return an one by one transparent gif pixel

Details