Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

I recommend these settings in file /etc/squid/squid.conf for optimal caching. You can place these settings at the top of the config file.

Code Block
# 10G Cache
cache_dir ufs /var/spool/squid 10000 16 256
# Cache large files
maximum_object_size 512000 KB

...

1.) Check the CentOS mirror sites page for a single site that would be best for a mirror site for youis in your area. Also consider reliability of the company or institution providing the mirror. Do some investigation on speed of the download speeds from the site.

2.) Test the mirror's cache settings for that site are set properly.

For a squid server : localhost
CentOS mirror site : http://mirrors.rit.edu/centos

You would run this command twice :

Code Block

time http_proxy=http://localhost:3128 \
  wget -S http://mirrors.rit.edu/centos/5.5/os/i386/repodata/repomd.xml 2>&1 \
  | grep X-Cache

...

3.) Follow steps 1 and 2 again to select a good fedora mirror fedora mirror list. You'll need to do this even if you're not planning for build on Fedora because the build system will require you to specify a fedora mirror url.
Example:

Code Block

time http_proxy=http://localhost:3128 \
  wget -S http://ftp.linux.ncsu.edu/pub/fedora/linux/releases/14/Fedora/i386/os/repodata/repomd.xml  2>&1 \
  | grep X-Cache

Building with a download proxy

...

You should verify caching is working by your second build by looking for the string TCP_MEM_HIT in /var/log/squid/access.log.

Clearing squid's cache.

If you switch mirror sites or you suspect the caching is causing build issues, you'll want to clear squid's cache.

...

There is no easy way to clear a portion of the cache, but this set of commands will clear all of squid's cache.

Code Block

service squid stop
rm -rf /var/spool/squid/*
service squid start

Advanced: Using your download proxy for testing installations

You can also use your

...

download proxy server to install systems faster

...

.

...

To use the proxy, edit /etc/yum.conf and add the setting proxy=http://your-squid-server:3128 to the [main] section.

Next you'll want to edit as many of the repository files as you can to use a fixed location for downloading. To do this, comment out the lines starting with mirrorlist= and uncomment out lines #baseurl. To automate editing of repos files to use base urls instead or mirror lists, this command should work.
sed -i -e 's/^mirrorlist/#mirrorlist/g' -e 's/^#baseurl/baseurl/g' /etc/yum.repos.d/*.repo

...