[HOT POOLLING]Apakah Youtube Error Lagi ?

Diskusi tentang Ubuntu Server baik webserver, database server, samba server dan service lainnya serta jaringan menggunakan Sistem Operasi Ubuntu.
User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Re: [HOT POOLLING]Apakah Youtube Error Lagi ?

Post by q_p » 26 Mar 2013, 05:24

@Asusrog
Minta skringsut nya mas dan kalau ada link aslinya mas :)
@Juldian Tan
Sementara itu dulu lah, biar tidak OOT


User avatar
asusrog
Posts: 14
Joined: 16 Mar 2013, 04:14
Location: tangerang

Post by asusrog » 26 Mar 2013, 06:49



User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 08:11

@Asusrog
Saya ikuti link yang anda, dan hasilnya =

[img]http://s20.postimg.org/jxv70p10t/marun_miss.png[/img]

[img]http://s20.postimg.org/9miu819bh/marun_HIT.png[/img]

:D


User avatar
asusrog
Posts: 14
Joined: 16 Mar 2013, 04:14
Location: tangerang

Post by asusrog » 26 Mar 2013, 08:45

wew.....mungkin beda tempat kali nie heheheheh,,,,,,,kalo boleh tau ???
storeurl_rewrite_children ?
storeurl_rewrite_concurrency ?

Berapa.....mungkin bisa dicoba,,,, :D
kalo punya ane

storeurl_rewrite_children 15
storeurl_rewrite_concurrency 100


User avatar
asusrog
Posts: 14
Joined: 16 Mar 2013, 04:14
Location: tangerang

Post by asusrog » 26 Mar 2013, 09:11

heheheheheheh dah berhasil brother......berkat ss yg lu kasih w bisa belajar n mengerti,,,,,,,,,,,heheheeh :D :D :D dari 127.0.0.1
localhost......heheheheeheh thanx brother sekarang dah ga error lagi...........


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 09:13

asusrog wrote:wew.....mungkin beda tempat kali nie heheheheh,,,,,,,kalo boleh tau ???
storeurl_rewrite_children ?
storeurl_rewrite_concurrency ?

Berapa.....mungkin bisa dicoba,,,, :D
kalo punya ane

storeurl_rewrite_children 15
storeurl_rewrite_concurrency 100
Apa anda sudah mengikuti yang di pejwan ? Caranya relatif mudah kok, ganti storeurl.pl anda (dengan yang baru. storeurl.pl yang baru ada di pajwan) kemudian ikuti langkah2-nya u/ upil ulang.

Kalau yang nilainya 15 dan 100 itu, saya pakainya kecil2 saja
storeurl_rewrite_children 5
storeurl_rewrite_concurrency 10
:)


User avatar
hidden_net
Posts: 20
Joined: 20 Mar 2013, 00:27

Post by hidden_net » 26 Mar 2013, 09:58

/var/log/squid/referer.log ko ga ada di foldernya


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 10:07

hidden_net wrote:/var/log/squid/referer.log ko ga ada di foldernya
Saya belum mengerti cara kerja referer mas. Tapi referer.log itu kan file yang berisi cacatan aktifitas referer. Kalau belum ada aktifitas ya belum ada yang perlu dicatat. Jalankan saja dulu squid-nya, yang penting tujuan kita men-cache youtube tercapai dan ada HIT. Soal nanti referer mencatat atau tdk ke dalam log-nya, itu perkara lain dan menurut saya asal itu tdk mempengaruhi kinerja squid maka tdk perlu dikuatir-kan.
CMIIW
:)


User avatar
FirmanIdiotique
Posts: 18
Joined: 13 Mar 2013, 13:00
Location: Cikarang, Bekasi
Contact:

Post by FirmanIdiotique » 26 Mar 2013, 11:27

Selamat siang mas
Boleh digelar squid.conf sama yang lain nya ga mas??
:D
baru liat access log yg ada DEFAULT_PARENT nya...
access log pnya saya kok ga ada DEFAULT_PARENT nya ya?

skalian tanya mas,,,
untuk Mesin Proxy itu sendiri apakah membutuhkan koneksi internet atau tidak?
masih bingung, soalnya ada yg menyebutkan dns_nameservers yg di resolv.conf pakai 127.0.0.1 aja

maaf klau OOT...

Thank's


User avatar
safar
Posts: 5
Joined: 26 Mar 2013, 12:32
Location: Banda Aceh
Contact:

Post by safar » 26 Mar 2013, 12:37

salam...
saya uga begitu masalahnya saya install squid di clearos...

bagaimana ya cara mengatasinya...

Image

setelah sebulan pake squid

Squid Cache: Version 2.7.STABLE9
configure options: '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/sbin' '--sbindir=/usr/sbin' '--libexecdir=/usr/lib/squid' '--sysconfdir=/etc/squid' '--localstatedir=/var/spool/squid' '--datadir=/usr/share/squid' '--enable-async-io=24' '--with-aufs-threads=24' '--with-pthreads' '--enable-storeio=aufs' '--enable-linux-netfilter' '--enable-arp-acl' '--enable-epoll' '--enable-removal-policies=heap' '--with-aio' '--with-dl' '--enable-snmp' '--enable-htcp' '--enable-cache-digests' '--disable-unlinkd' '--enable-large-cache-files' '--with-large-files' '--enable-err-languages=English' '--enable-follow-x-forwarded-for' '--enable-delay-pools' '--enable-default-err-language=English' '--with-maxfd=65536' 'CFLAGS=-march=core2 -O2 -pipe'


kenapa ya squid saya.... ???
menurut sesepuh dimananya salah...???

tu gambar saat user akses youtube.... (Khusus Youtube) masalahnya
kalo situs laen aman2 aja...


Ini squid.conf punya saya

Ini storeurl.pl punya saya


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 26 Mar 2013, 16:12

salam knal senior mastah semua, bgus penjelasanny, nanti akan saya cba (muter2 di google, eh ketemuny dsni solusiny) :D


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 16:24

encore2012 wrote:Selamat siang mas
Boleh digelar squid.conf sama yang lain nya ga mas??
:D
baru liat access log yg ada DEFAULT_PARENT nya...
access log pnya saya kok ga ada DEFAULT_PARENT nya ya?

skalian tanya mas,,,
untuk Mesin Proxy itu sendiri apakah membutuhkan koneksi internet atau tidak?
masih bingung, soalnya ada yg menyebutkan dns_nameservers yg di resolv.conf pakai 127.0.0.1 aja

maaf klau OOT...

Thank's
1. Sebelum ini kan mesin proxy anda berjalan normal dan bisa men-cache youtube. Artinya squid.conf anda sudah benar konfigurasinya. Untuk menyesuaikan dengan kondisi terbaru saat ini, anda cuma perlu menambahkan sebaris kode "referer_log /var/log/squid/referer.log". Semua sudah terangkum di pejwan mas.
2. DEFAULT_PARENT muncul dalam log kalau anda menghubungkan mesin proxy anda ke mesin proxy yang lain, melalui parent-sibling.
3. Coba saja mesin proxy anda di-blok koneksi-nya ke internet, apakah berdampak ke klien ? dengan syarat proxy dalam mode transparent.
CMIIW
:)


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 16:39

safar wrote:salam...
saya uga begitu masalahnya saya install squid di clearos...
bagaimana ya cara mengatasinya...
setelah sebulan pake squid

Squid Cache: Version 2.7.STABLE9
configure options: '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/sbin' '--sbindir=/usr/sbin' '--libexecdir=/usr/lib/squid' '--sysconfdir=/etc/squid' '--localstatedir=/var/spool/squid' '--datadir=/usr/share/squid' '--enable-async-io=24' '--with-aufs-threads=24' '--with-pthreads' '--enable-storeio=aufs' '--enable-linux-netfilter' '--enable-arp-acl' '--enable-epoll' '--enable-removal-policies=heap' '--with-aio' '--with-dl' '--enable-snmp' '--enable-htcp' '--enable-cache-digests' '--disable-unlinkd' '--enable-large-cache-files' '--with-large-files' '--enable-err-languages=English' '--enable-follow-x-forwarded-for' '--enable-delay-pools' '--enable-default-err-language=English' '--with-maxfd=65536' 'CFLAGS=-march=core2 -O2 -pipe'


kenapa ya squid saya.... ???
menurut sesepuh dimananya salah...???

tu gambar saat user akses youtube.... (Khusus Youtube) masalahnya
kalo situs laen aman2 aja...


Ini squid.conf punya saya

Ini storeurl.pl punya saya
Output dari cli "squid -v" tidak ada "--enable-referer-log". Recompile squid anda, bagaimana caranya ? Silahkan lihat di pejwan
:D


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 16:48

ubuntumicro wrote:salam knal senior mastah semua, bgus penjelasanny, nanti akan saya cba (muter2 di google, eh ketemuny dsni solusiny) :D
Selamat ngoprek, kita tunggu hasilnya :D


User avatar
safar
Posts: 5
Joined: 26 Mar 2013, 12:32
Location: Banda Aceh
Contact:

Post by safar » 26 Mar 2013, 21:20

pada ubuntu

# cd /home/share_2/arsip/squid/LUSCA_HEAD-r14809
# apt-get install libfile-readbackwards-perl -y

pada clearos 5.2

Image

paling ujung nya kalo di ubuntu kan ada -y
untuk apa tu fungksinya

apakah di clearos dipake uga -y


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 21:32

@safar
Supaya nanti tidak muncul pertanyaan ganda (Y/N), jawab saja duluan di depan dengan menambahkan option '-y'. kalau di centos, saya tdk tahu ya mas. Coba saja di-eksplor dengan menuliskan 'man apt-get' atau 'apt-get --help'
:D


User avatar
mallink
Posts: 86
Joined: 24 Feb 2013, 23:50
Location: makassar
Contact:

Post by mallink » 26 Mar 2013, 21:34

udah bisa engga nge cache mas.?


User avatar
safar
Posts: 5
Joined: 26 Mar 2013, 12:32
Location: Banda Aceh
Contact:

Post by safar » 26 Mar 2013, 21:44

@ mallink

kalo cache emang bisa mas... tp untuk browsing youtube aja yang bermasalh....

kalo mau muncul video yang kita inginkan harus di klik kanan di videonya tros pilih pop out

itu baru nampak video aslinya...


User avatar
sentulmania
Posts: 18
Joined: 26 Mar 2013, 21:42
Location: medan,indonesia

Post by sentulmania » 26 Mar 2013, 21:45

makasih banget buat master2 di linux...akhirnya youtube ku tercache juga
makasih buat kawan2 di forum yg mau berbagi pengetahuan...


User avatar
sentulmania
Posts: 18
Joined: 26 Mar 2013, 21:42
Location: medan,indonesia

Post by sentulmania » 26 Mar 2013, 21:49

terima kasih buat smua nya....
settingan ini berjalan dengan baik....


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 21:57

safar wrote:@ mallink

kalo cache emang bisa mas... tp untuk browsing youtube aja yang bermasalh....

kalo mau muncul video yang kita inginkan harus di klik kanan di videonya tros pilih pop out

itu baru nampak video aslinya...
Barusan saya coba, browsing dengan google, bing, yahoo maupun fitur brows di youtube sendiri, tidak ada masalah kok mas. Ter-cache dan hit. Dan semua mengarah ke video yang benar.
:D


User avatar
safar
Posts: 5
Joined: 26 Mar 2013, 12:32
Location: Banda Aceh
Contact:

Post by safar » 26 Mar 2013, 21:59

aduh.... paket libfile-readbackwards-perl tidak tersedia untuk clearos


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 22:14

safar wrote:aduh.... paket libfile-readbackwards-perl tidak tersedia untuk clearos
Ganti Ubuntu :kuku:


User avatar
Aira
Posts: 70
Joined: 22 Mar 2012, 21:20

Post by Aira » 26 Mar 2013, 22:20

Minta pencerahaannya......
Kenapa ya di saya masih aja padahal sebelumnya ternyata sudah di beri --enable-referer-log sebelum tahu ini di pakai. Apakah pengaruh dengan ACL nya?

[spoiler]acl store_rewrite_list urlpath_regex \/(get_video|video\?v|videoplayback\?id|videoplayback.*id)
acl store_rewrite_list urlpath_regex \/(get_video\?|videodownload\?|videoplayback.*id|watch\?)
acl store_rewrite_list urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)\?
acl store_rewrite_list_domain url_regex ^http:\/\/(([a-z-]+[0-9-]+)|([0-9-]+[a-z-]+))\.[a-z0-9-]*\.[a-z]{2,4}
acl store_rewrite_list_domain url_regex ^http:\/\/([a-zA-Z-]+[0-9-]+)\.[A-Za-z]*\.[A-Za-z]*
acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2}))\.[a-z]*[0-9]?\.[a-z]{3}
acl store_rewrite_list_path urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)$
acl store_rewrite_list_domain_CDN url_regex (cbk|mt|khm|mlt|tbn)[0-9]?.google\.co(m|\.uk|\.id)
acl store_rewrite_list_domain_CDN url_regex photos-[a-z].ak.fbcdn.net
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/([a-z])[0-9]?(\.gstatic\.com|\.wikimapia\.org)
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/[.a-z0-9]*\.photobucket\.com.*\.[a-z]{3}$
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/.*speedtest.*
acl store_rewrite_list_domain_CDN url_regex streamate.doublepimp.com.*\.js\? \.doubleclick\.net.* yieldmanager cpxinteractive quantserve\.com
acl speedtest_allow_url url_regex -i \.speedtest\.net\/ speedtest
acl speedtest_allow_url url_regex ^http:\/\/speedtest\.*
acl speedtest_allow_dom dstdomain .speedtest.net
acl dontrewrite url_regex (get_video|video\?v=|videoplayback\?id|videoplayback.*id).*begin\=[1-9][0-9]* \.php\? \.asp\? \.aspx\? threadless.*\.jpg\?r=
acl getmethod method GET

storeurl_access deny dontrewrite
storeurl_access deny !getmethod

storeurl_access allow store_rewrite_list_domain_CDN
storeurl_access allow store_rewrite_list
storeurl_access allow store_rewrite_list_domain store_rewrite_list_path
storeurl_access allow speedtest_allow_url
storeurl_access allow speedtest_allow_dom
storeurl_access deny all[/spoiler]

Untuk storeurl.pl nya saya ikut di depan...


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 26 Mar 2013, 22:45

done is fix om pragola pati saya ikuti semua tutor anda, Alhamdulillah hasilnya memuaskan , :)


User avatar
safar
Posts: 5
Joined: 26 Mar 2013, 12:32
Location: Banda Aceh
Contact:

Post by safar » 26 Mar 2013, 22:48

jangan sampe segitunya kali lah.... *sedih mode ON


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 23:03

Aira wrote:Minta pencerahaannya......
Kenapa ya di saya masih aja padahal sebelumnya ternyata sudah di beri --enable-referer-log sebelum tahu ini di pakai. Apakah pengaruh dengan ACL nya?

[spoiler]acl store_rewrite_list urlpath_regex \/(get_video|video\?v|videoplayback\?id|videoplayback.*id)
acl store_rewrite_list urlpath_regex \/(get_video\?|videodownload\?|videoplayback.*id|watch\?)
acl store_rewrite_list urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)\?
acl store_rewrite_list_domain url_regex ^http:\/\/(([a-z-]+[0-9-]+)|([0-9-]+[a-z-]+))\.[a-z0-9-]*\.[a-z]{2,4}
acl store_rewrite_list_domain url_regex ^http:\/\/([a-zA-Z-]+[0-9-]+)\.[A-Za-z]*\.[A-Za-z]*
acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2}))\.[a-z]*[0-9]?\.[a-z]{3}
acl store_rewrite_list_path urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)$
acl store_rewrite_list_domain_CDN url_regex (cbk|mt|khm|mlt|tbn)[0-9]?.google\.co(m|\.uk|\.id)
acl store_rewrite_list_domain_CDN url_regex photos-[a-z].ak.fbcdn.net
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/([a-z])[0-9]?(\.gstatic\.com|\.wikimapia\.org)
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/[.a-z0-9]*\.photobucket\.com.*\.[a-z]{3}$
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/.*speedtest.*
acl store_rewrite_list_domain_CDN url_regex streamate.doublepimp.com.*\.js\? \.doubleclick\.net.* yieldmanager cpxinteractive quantserve\.com
acl speedtest_allow_url url_regex -i \.speedtest\.net\/ speedtest
acl speedtest_allow_url url_regex ^http:\/\/speedtest\.*
acl speedtest_allow_dom dstdomain .speedtest.net
acl dontrewrite url_regex (get_video|video\?v=|videoplayback\?id|videoplayback.*id).*begin\=[1-9][0-9]* \.php\? \.asp\? \.aspx\? threadless.*\.jpg\?r=
acl getmethod method GET

storeurl_access deny dontrewrite
storeurl_access deny !getmethod

storeurl_access allow store_rewrite_list_domain_CDN
storeurl_access allow store_rewrite_list
storeurl_access allow store_rewrite_list_domain store_rewrite_list_path
storeurl_access allow speedtest_allow_url
storeurl_access allow speedtest_allow_dom
storeurl_access deny all[/spoiler]

Untuk storeurl.pl nya saya ikut di depan...
Jika sebelum kasus ini muncul, mesin anda bisa men-cache youtube dan HIT, anda tinggal mengganti storeurl.pl dengan yang baru dan memasukkan 'referer_log /var/log/squid/referer.log' ke dalam file squid.conf. Sedangkan install 'libfile-readbackwards-perl' dan langkah recompile tdk perlu anda lakukan, karena '--enable-referer-log' sudah ada dalam configurasi squid saat dulu di install.
BTW, anda tahu '--enable-referer-log' dari output cli 'squid -z' yang anda jalankan kan ya ?


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 23:06

safar wrote:jangan sampe segitunya kali lah.... *sedih mode ON
Yahh mau gimana lagi ? pilihannya hanya dua youtube dengan ubuntu atau clearos tanpa ubuntu.
BTW, di ubuntu ada yang namanya ppa yang menyediakan aplikasi tersendiri diluar repository. Saya tdk tahu bagaimana di ClearOS :D


User avatar
Aira
Posts: 70
Joined: 22 Mar 2012, 21:20

Post by Aira » 26 Mar 2013, 23:22

Pragola_Pati wrote:
Aira wrote:Minta pencerahaannya......
Kenapa ya di saya masih aja padahal sebelumnya ternyata sudah di beri --enable-referer-log sebelum tahu ini di pakai. Apakah pengaruh dengan ACL nya?

[spoiler]acl store_rewrite_list urlpath_regex \/(get_video|video\?v|videoplayback\?id|videoplayback.*id)
acl store_rewrite_list urlpath_regex \/(get_video\?|videodownload\?|videoplayback.*id|watch\?)
acl store_rewrite_list urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)\?
acl store_rewrite_list_domain url_regex ^http:\/\/(([a-z-]+[0-9-]+)|([0-9-]+[a-z-]+))\.[a-z0-9-]*\.[a-z]{2,4}
acl store_rewrite_list_domain url_regex ^http:\/\/([a-zA-Z-]+[0-9-]+)\.[A-Za-z]*\.[A-Za-z]*
acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2}))\.[a-z]*[0-9]?\.[a-z]{3}
acl store_rewrite_list_path urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)$
acl store_rewrite_list_domain_CDN url_regex (cbk|mt|khm|mlt|tbn)[0-9]?.google\.co(m|\.uk|\.id)
acl store_rewrite_list_domain_CDN url_regex photos-[a-z].ak.fbcdn.net
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/([a-z])[0-9]?(\.gstatic\.com|\.wikimapia\.org)
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/[.a-z0-9]*\.photobucket\.com.*\.[a-z]{3}$
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/.*speedtest.*
acl store_rewrite_list_domain_CDN url_regex streamate.doublepimp.com.*\.js\? \.doubleclick\.net.* yieldmanager cpxinteractive quantserve\.com
acl speedtest_allow_url url_regex -i \.speedtest\.net\/ speedtest
acl speedtest_allow_url url_regex ^http:\/\/speedtest\.*
acl speedtest_allow_dom dstdomain .speedtest.net
acl dontrewrite url_regex (get_video|video\?v=|videoplayback\?id|videoplayback.*id).*begin\=[1-9][0-9]* \.php\? \.asp\? \.aspx\? threadless.*\.jpg\?r=
acl getmethod method GET

storeurl_access deny dontrewrite
storeurl_access deny !getmethod

storeurl_access allow store_rewrite_list_domain_CDN
storeurl_access allow store_rewrite_list
storeurl_access allow store_rewrite_list_domain store_rewrite_list_path
storeurl_access allow speedtest_allow_url
storeurl_access allow speedtest_allow_dom
storeurl_access deny all[/spoiler]

Untuk storeurl.pl nya saya ikut di depan...
Jika sebelum kasus ini muncul, mesin anda bisa men-cache youtube dan HIT, anda tinggal mengganti storeurl.pl dengan yang baru dan memasukkan 'referer_log /var/log/squid/referer.log' ke dalam file squid.conf. Sedangkan install 'libfile-readbackwards-perl' dan langkah recompile tdk perlu anda lakukan, karena '--enable-referer-log' sudah ada dalam configurasi squid saat dulu di install.
BTW, anda tahu '--enable-referer-log' dari output cli 'squid -z' yang anda jalankan kan ya ?
Ya mas sebelumnya saya sudah bisa tercache youtube cuman pas kejadian kemarin youtube videonya itu2 aja. Habis itu saya coba tutorial mas di depan youtube video normal (sama dengan judulnya) kadang tidak sama tidak mau ngecache juga...
Menurut Pragola acl yang saya pakai apakah berbeda juga dengan settingan sekarang? Minta pencerahaan dari mas pragola.


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 26 Mar 2013, 23:48

@Aira
Aira
Ya mas sebelumnya saya sudah bisa tercache youtube cuman pas kejadian kemarin youtube videonya itu2 aja. Habis itu saya coba tutorial mas di depan youtube video normal (sama dengan judulnya) kadang tidak sama tidak mau ngecache juga...
Menurut Pragola acl yang saya pakai apakah berbeda juga dengan settingan sekarang? Minta pencerahaan dari mas pragola.
Harusnya dengan acl yang dulu pun bisa mas, karena acl tdk termasuk dalam point yang harus disesuaikan.
BTW, untuk memastikan "--enable-referer-log" ada di installed-configuration squid jalankan CLI 'squid -z'


User avatar
Aira
Posts: 70
Joined: 22 Mar 2012, 21:20

Post by Aira » 26 Mar 2013, 23:54

@Pragola
squid -z
hasilnya =
2013/03/26 23:54:35| Squid is already running! Process ID 2032

squid -v
hasilnya =
Squid Cache: Version 2.7.STABLE9-20110824
configure options: '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/sbin' '--sbindir=/usr/sbin' '--libexecdir=/usr/lib/squid' '--sysconfdir=/etc/squid' '--localstatedir=/var/spool/squid' '--datadir=/usr/share/squid' '--enable-async-io' '--with-pthreads' '--enable-storeio=aufs,coss,null' '--enable-linux-netfilter' '--enable-arp-acl' '--enable-epoll' '--enable-removal-policies=lru,heap' '--enable-snmp' '--enable-delay-pools' '--enable-htcp' '--enable-cache-digests' '--enable-useragent-log' '--enable-follow-x-forwarded-for' '--with-large-files' '--enable-large-cache-files' '--enable-truncate' '--disable-ident-lookups' '--with-maxfd=65536' '--enable-referer-log'

Terimakasih sebelumnya dah bantu...


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 26 Mar 2013, 23:54

untuk link local cache sempurna, untuk vevo ataupun HD internasional g kecahem, apakh memang begitu gan?


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 27 Mar 2013, 00:07

top dah agan , tp untuk vevo sama HD saya belom bsa tercache gan, mohon solusi


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 00:15

@aira
Aira wrote:@Pragola
squid -z
hasilnya =
2013/03/26 23:54:35| Squid is already running! Process ID 2032

squid -v
hasilnya =
Squid Cache: Version 2.7.STABLE9-20110824
configure options: '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/sbin' '--sbindir=/usr/sbin' '--libexecdir=/usr/lib/squid' '--sysconfdir=/etc/squid' '--localstatedir=/var/spool/squid' '--datadir=/usr/share/squid' '--enable-async-io' '--with-pthreads' '--enable-storeio=aufs,coss,null' '--enable-linux-netfilter' '--enable-arp-acl' '--enable-epoll' '--enable-removal-policies=lru,heap' '--enable-snmp' '--enable-delay-pools' '--enable-htcp' '--enable-cache-digests' '--enable-useragent-log' '--enable-follow-x-forwarded-for' '--with-large-files' '--enable-large-cache-files' '--enable-truncate' '--disable-ident-lookups' '--with-maxfd=65536' '--enable-referer-log'

Terimakasih sebelumnya dah bantu...
Iya...ya :confused:
Coba pastikan paket pendukungnya ter-install
# apt-get install libfile-readbackwards-perl

@ubuntumicro
ubuntumicro wrote:top dah agan , tp untuk vevo sama HD saya belom bsa tercache gan, mohon solusi
Sama mas, punya saya juga gitu. Untuk sementara kita terima/sukuri nikmat yang ini dulu lah :D


User avatar
cah_clacap
Posts: 258
Joined: 19 Mar 2013, 23:07
Location: Cilacap
Contact:

Post by cah_clacap » 27 Mar 2013, 00:23

@
Thank's Wat mas Pagola,n smua rekan FUI di sini ....
akhirnya warnet kami dapat menikmati cache youtube juga hari ini ......
cuma tinggal 1 ganjalan lg yg belum tuntas tentang script kemarin yg ...

++++++++++++++++++++++++++++++++++++++++++++++++

dan tambahkan line berikut agar youtube tidak loopback di atas storeurl_access deny dontrewrite yg lainnya

acl dontrewrite url_regex -i c\.youtube\.com\/videoplayback.*redirect_counter=1.*$
acl dontrewrite url_regex -i c\.youtube\.com\/videoplayback.*\&cms_redirect=yes.*$
acl dontrewrite url_regex -i c\.youtube\.com\/videoplayback.*\&ir=1.*$
acl dontrewrite url_regex -i c\.youtube\.com\/videoplayback.*\&rr=12.*$
storeurl_access deny dontrewrite

###################

itu lanjutannya sebenarnya apa????


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 00:34

@Cah Cilacap
Saya tidak tahu mas,
1. Bisa jadi memang begitu jika dilihat dari panjang tiap baris yang berbeda, sama2 diakhiri dollar. Jika pengaruh dari wrapping word pada jendela CLI, panjang baris pasti sama.
2. Jika tidak yakin dengan skenario pertama, hilangkan saja tanda dollar.
BTW, bagaimana untuk mengetahui = "youtube tidak loopback di atas storeurl_access deny dontrewrite yg lainnya ?


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 27 Mar 2013, 00:35

ya Alhamdulillah , forum sebelah udah ada yg berhsil cache vevo ama HDny mas, nmun mrka pke FreeBSD saya kesulitan ngikuti tunnel2nya


User avatar
cah_clacap
Posts: 258
Joined: 19 Mar 2013, 23:07
Location: Cilacap
Contact:

Post by cah_clacap » 27 Mar 2013, 00:36

Kenapa ya videonya Fatin Shidqia Lubis ga ada yg bisa ter-cache???


User avatar
cah_clacap
Posts: 258
Joined: 19 Mar 2013, 23:07
Location: Cilacap
Contact:

Post by cah_clacap » 27 Mar 2013, 00:38

@ Mas Pragola : MASUK AKAL .OK ....

Sy tidak pake script tsb jadinya ,,,tapi tetap HIT

cuma utk Video FAtin belum bisa koh


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 00:38

@ubuntumicro
@cah cilacap
Bisa kasih link-nya mas ?


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 27 Mar 2013, 00:41



User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 00:54

Bukan link forum sebelah itu :D


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 00:59

cah_clacap wrote:@ Mas Pragola : MASUK AKAL .OK ....
Sy tidak pake script tsb jadinya ,,,tapi tetap HIT
cuma utk Video FAtin belum bisa koh
Hit kok mas, nih buktinya =
[img]http://s20.postimg.org/eimgzq9gt/fatin_hit.png[/img]
[img]http://s20.postimg.org/61rk2ju5p/Screen ... _44_02.png[/img]
:D

@ubuntumicro
Link youtube yang anda kasih (VEVO-nya marun) HIT kok mas :)


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 27 Mar 2013, 01:12

oalah link sebelah to mas, hahahaha , maaf gan
https://www.facebook.com/photo.php?fbid ... =1&theater


User avatar
ubuntumicro
Posts: 8
Joined: 26 Mar 2013, 16:10
Location: indonesia

Post by ubuntumicro » 27 Mar 2013, 01:13

wah, berarti ada yg salah dri squid saya, mohon petunjuk mas


User avatar
sekedang
Posts: 8
Joined: 31 Mar 2012, 21:03
Location: aceh
Contact:

Post by sekedang » 27 Mar 2013, 01:41

ALL MASTER HELP ME.

sumpah puyeng tujuh keliling udah dicoba bebarapa x tapi gagal terus, video yg di putar itu2 aja, padahal sebelumnya youtbe lancar jaya.

saya pakek ubuntu 12.4 mengunakan lusca.
agan2 yg baik kalau proxy terlanjur di instal ulang apa yg perlu ditambahkan.

ini tutorial yg saya gunakan pada ubuntu 12:

1. Update :
# sudo apt-get update
# sudo apt-get install squid squidclient squid-cgi
# sudo apt-get install gcc
# sudo apt-get install build-essential
# sudo apt-get install sharutils
# sudo apt-get install ccze
# sudo apt-get install libzip-dev
# sudo apt-get install automake1.9
# sudo apt-get remove squid
# apt-get autoremove

2. Manipulasi Speedtest :
-------------------------

# apt-get install unzip apache2 php5
# cd /var/www
# wget http://c.speedtest.net/mini/mini.zip
# unzip mini.zip

3. Compile :
------------
- Buka WINSCP
- Drag LUSCA_HEAD-r14809.tar.bz2 yg disertakan ke /tmp
- Open in Putty di menu Command WINSCP
- cd /tmp
- tar xvf LUSCA_HEAD-r14942.tar.bz2
- cd LUSCA_HEAD-r14942


4. copy prefik dibawah ini paste ke terminal ubuntu:
---------------------------------------

./configure --prefix=/usr --exec_prefix=/usr --bindir=/usr/sbin --sbindir=/usr/sbin --libexecdir=/usr/lib/squid --sysconfdir=/etc/squid \
--localstatedir=/var/spool/squid --datadir=/usr/share/squid --enable-async-io=24 --with-aufs-threads=24 --with-pthreads --enable-storeio=aufs \
--enable-linux-netfilter --enable-arp-acl --enable-epoll --enable-removal-policies=heap --with-aio --with-dl --enable-snmp \
--enable-delay-pools --enable-htcp --enable-cache-digests --disable-unlinkd --enable-large-cache-files --with-large-files \
--enable-err-languages=English --enable-default-err-language=English --with-maxfd=65536


5. ketik perintah berikut di terminal ubuntu:
-----------------------------------------

# make
# sudo make install

# mkdir -p /var/log/squid/
# chmod 777 /var/log/squid/

# touch /var/log/squid/access.log
# touch /var/log/squid/cache.log
# chown -R proxy:proxy /var/log/squid/*

- paste file squid.conf, storeurl.pl dan rewriter.pl ke dalam folder /etc/squid
- paste file squid kedalam folder /etc/init.d/
- paste file sysctl.conf kedalam folder /etc/
- paste file rc.local kedalam folder /etc/

6. Memberikan permission pada folder cache
-------------------------------------------
# chown proxy:proxy /cache
# chmod 777 /cache
# chown proxy:proxy /etc/squid/storeurl.pl
# chmod 777 /etc/squid/storeurl.pl
# chown proxy:proxy /etc/squid/rewriter.pl
# chmod 777 /etc/squid/rewriter.pl
# chmod 777 /etc/init.d/squid
# chmod 777 /etc/rc.local
# squid -f /etc/squid/squid.conf -z
# sudo /etc/init.d/squid restart

Reboot CPU nya
squid -NDd1

ini Squid yg saya gunakan ;
============= squid.conf =============
acl all src all
acl manager proto cache_object
acl localhost src 127.0.0.1/32
acl to_localhost dst 127.0.0.0/8
acl localnet src 192.168.0.0/16 # RFC1918 possible internal network
acl SSL_ports port 443
acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 1025-65535 # unregistered ports
acl CONNECT method CONNECT
acl purge method PURGE

#CDN Non unknown Extensi
acl store_rewrite_list_domain dstdomain .gstatic.com
acl store_rewrite_list_domain dstdomain .avg.com
acl store_rewrite_list_domain dstdomain .googlevideo.com
acl store_rewrite_list_domain dstdomain .sourceforge.net
acl store_rewrite_list_url url_regex ^http://[a-z]+[0-9]?\.google\.co(m|\.id)
acl store_rewrite_list_url url_regex ^http://[^/]+\.youtube\.com/videoplayback\?
acl store_rewrite_list_url url_regex ^http://(cbk|mt|khm|mlt|tbn)[0-9]?.google\.co(m|\.uk|\.id)
acl store_rewrite_list_url url_regex ^http://([a-z])[0-9]?(\.gstatic\.com|\.wikimapia\.org)
acl store_rewrite_list_url url_regex ^http://rs.*\.rapidshare\.com/
acl store_rewrite_list_url url_regex ^http://205\.196\.12
acl store_rewrite_list_url url_regex ^http://199\.91\.15
acl store_rewrite_list_path urlpath_regex (speedtest|firefox|iav5sx)

acl RW url_regex \/speedtest\/.*\.(jpg|txt|php).*
url_rewrite_access allow RW
url_rewrite_program /etc/squid/rewriter.pl
url_rewrite_children 7
url_rewrite_concurrency 10
redirector_bypass on

acl store_rewrite_list_files url_regex ^http://.*\.(gif|jpeg|jpg|jpe|png|ico|swf|bmp|dib|jfif|pcx|svg|tif|crd|pic|max|dxf|eps)$
acl store_rewrite_list_files url_regex ^http://.*\.(flv|fid|mp4|mp3|avi|mov|wma|wmv|mkv|3gp|rm|ram|m4v|on2)$
acl store_rewrite_list_files url_regex ^http://.*\.(exe|msi|msp|msu|dmg|bin|xpi|iso|mar|psf|cab)$
acl store_rewrite_list_files url_regex ^http://.*\.(gif|jpeg|jpg|jpe|png|ico|swf|bmp|dib|jfif|pcx|svg|tif|crd|pic|max|dxf|eps)\?
acl store_rewrite_list_files url_regex ^http://.*\.(flv|fid|mp4|mp3|avi|mov|wma|wmv|mkv|3gp|rm|ram|m4v|on2)\?
acl store_rewrite_list_files url_regex ^http://.*\.(exe|msi|msp|msu|dmg|bin|xpi|iso|mar|psf|cab)\?

acl dontrewrite url_regex \.(php|asp|aspx|jspx|js|cgi)\?
acl dontrewrite url_regex ^http://redirector.c.youtube.com
acl dontrewrite url_regex ^http://[^/]+\.youtube\.com/(get_video|video|videoplayback|videodownload).*(begin|start)\=[1-9][0-9]*

acl virus url_regex \.(scr|bat|pif|cmd)$
http_access deny virus
acl youtube_range urlpath_regex \/(youtube.*range|videoplayback.*range)
http_access deny youtube_range

http_access allow manager localhost
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports
http_access allow purge localhost
http_access allow localhost
http_access allow localnet
http_access allow all

pid_filename /var/run/squid.pid
visible_hostname proxy
http_port 3128 transparent

#tproxy
cache_effective_user proxy
cache_effective_group proxy
dns_nameservers 8.8.8.8 8.8.4.4

zph_mode tos
zph_local 0x30
zph_sibling 0
zph_parent 0
zph_option 136

cache_mem 6 MB
maximum_object_size_in_memory 32 KB
memory_replacement_policy heap GDSF
cache_replacement_policy heap LFUDA

cache_dir aufs /cache 50000 64 256

minimum_object_size 256 bytes
maximum_object_size 512 MB
cache_swap_low 98
cache_swap_high 99
access_log daemon:/var/log/squid/access.log squid
cache_log /var/log/squid/cache.log
cache_store_log none

acl getmethod method GET
acl snmppublic snmp_community public
snmp_port 3401
snmp_access allow snmppublic all
snmp_access deny all

storeurl_access deny dontrewrite
storeurl_access deny !getmethod
storeurl_access allow store_rewrite_list_url
storeurl_access allow store_rewrite_list_domain
storeurl_access allow store_rewrite_list_files
storeurl_access allow store_rewrite_list_path
storeurl_access deny all
storeurl_rewrite_program /etc/squid/storeurl.pl
storeurl_rewrite_children 1
storeurl_rewrite_concurrency 10
storeurl_bypass on

acl QUERY urlpath_regex \.(ini|ui|lst|inf|pak|ver|patch|md5|cfg|lst|list|log|conf|dbd|db|cfg.iop)$ afs\.dat$
acl QUERY2 url_regex -i (mrtg|include|Loader|xtrap|login|captcha|notice|sources|registration|voucher|partialinfo)
cache deny QUERY
cache deny QUERY2

#Image
refresh_pattern \.(jp(e?g|e|2)|tiff?|bmp|gif|png|pcx|svgpic|max|dxf|ep)$ 5259487 99999999% 5259487 override-expire reload-into-ims ignore-no-cache ignore-private ignore-no-store ignore-auth ignore-must-revalidate store-stale negative-ttl=0
refresh_pattern \.(swf|flv|fid|avi|mov|wm(a|v)|3gp|mp(4|3)|rm|ram|m4v|on2|mar|cab|psf)$ 259200 999999% 5259487 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-auth ignore-must-revalidate store-stale negative-ttl=0

#Youtube
refresh_pattern ^http://[^/]+\.youtube\.com/(get_video|video|videoplayback|videodownload).*(begin|start)\=[1-9][0-9]* 0 0% 0
refresh_pattern ^http://[^/]+\.youtube\.com/(get_video\?|videoplayback\?|videodownload\?) 43200 99999999% 259200 override-expire ignore-reload ignore-must-revalidate ignore-no-cache ignore-no-store ignore-private store-stale negative-ttl=0

#Sensitive files
refresh_pattern \.(sc-|dl-|ex-|mh-|dll|da-|cfg.iop|Xtp)$ 0 10% 50 reload-into-ims
refresh_pattern (update-smadav|updates|patchlist|start|start1|start2|start3)\.txt$ 0 20% 1440 reload-into-ims
refresh_pattern (pointblank|form|reset|ickernew|layout)\.css$ 0 10% 1440 reload-into-ims
refresh_pattern (all.png|dat.asp|patchinfo.xml|iepngfix.htc)$ 0 10% 1440 reload-into-ims
refresh_pattern (game|cookie)\.js$ 0 10% 1440 reload-into-ims
refresh_pattern (autoup|main|autoupgrade|grandchase|FSLauncher|FreeStyle_Setup|grandchase|cabal|i7|UpdaterModifier|FreeStyle|PBLauncher|update|NewLauncher|NewAvalon)\.exe$ 0 50% 1440 reload-into-ims
refresh_pattern (PointBlank.exe|HSUpdate.exe|PBConfig.exe|hon.exe|filelist)\.zip$ 0 50% 1440 reload-into-ims
refresh_pattern -i (livescore.com|goal.com|bobet|bet) 0 50% 60 reload-into-ims

refresh_pattern \.(aspx|asp|php|css|htm|html|js|jsp|xml)$ 20 80% 20160 reload-into-ims
refresh_pattern \.(nzp|iop|kom|nup|mst)$ 43200 99999999% 5259487 override-expire reload-into-ims ignore-no-cache

#Regex spesific
refresh_pattern (gstatic|diggstatic)\.com/.* 43200 999999% 259200 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern (zynga|ninjasaga|mafiawars|cityville|farmville|crowdstar|spilcdn|agame|popcap)\.com/.* 43200 999999% 259200 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern ^http:\/\/images|image|img|pics|openx|thumbs[0-9]\. 43200 999999% 259200 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern ^.*safebrowsing.*google 259200 999999% 259200 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-private ignore-auth ignore-must-revalidate negative-ttl=10080 store-stale
refresh_pattern ^.*(streamate.doublepimp.com.*\.js\?|utm\.gif|ads\?|rmxads\.com|ad\.z5x\.net|bh\.contextweb\.com|bstats\.adbrite\.com|a1\.interclick\.com|ad\.trafficmp\.com|ads\.cubics\.com|ad\.xtendmedia\.com|\.googlesyndication\.com|advertising\.com|yieldmanager|game-advertising\.com|pixel\.quantserve\.com|adperium\.com|doubleclick\.net|adserving\.cpxinteractive\.com|syndication\.com|media.fastclick.net).* 43200 20% 259200 ignore-no-cache ignore-no-store ignore-private override-expire ignore-reload ignore-auth ignore-must-revalidate store-stale negative-ttl=40320 max-stale=1440
refresh_pattern \.(ico|video-stats) 43200 999999% 259200 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-private ignore-auth override-lastmod ignore-must-revalidate negative-ttl=10080 store-stale
refresh_pattern ^http://((cbk|mt|khm|mlt|tbn)[0-9]?)\.google\.co(m|\.uk|\.id) 43200 999999% 259200 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-auth ignore-must-revalidate ignore-no-store negative-ttl=10080 store-stale
refresh_pattern \.speedtest/.* 43200 99999% 259200 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-must-revalidate store-stale negative-ttl=10080
refresh_pattern \.wikimapia\.org\/? 43200 99999% 259200 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-must-revalidate store-stale
refresh_pattern (resize|timthumb|product_thumb|thumb|img|imag(e|es))\.php? 43200 99999999% 5259487 override-expire ignore-reload ignore-no-cache store-stale

refresh_pattern \.(jp(e?g|e|2)|tiff?|bmp|gif|png|pcx|svgpic|max|dxf|ep)\? 259200 99999999% 5259487 override-expire reload-into-ims ignore-no-cache ignore-private ignore-no-store ignore-auth ignore-must-revalidate store-stale negative-ttl=0
refresh_pattern \.(nzp|swf|flv|fid|avi|mov|wm(a|v)|3gp|mp(4|3)|rm|ram|m4v|on2)\? 259200 99999999% 5259487 override-expire ignore-reload ignore-must-revalidate ignore-no-cache ignore-no-store ignore-private store-stale negative-ttl=0
refresh_pattern \.(z(ip|[0-9]{2})|r(ar|[0-9]{2})|jar|bz2|gz|tar|rpm|vpu|vpx) 43200 99999999% 259200 override-expire reload-into-ims ignore-no-cache ignore-private ignore-must-revalidate ignore-no-store store-stale
refresh_pattern \.(mp3|mp4|wav|og(g|a)|flac|midi?|rm|aac|wma|mka|ape) 43200 99999999% 259200 override-expire reload-into-ims ignore-reload ignore-no-cache ignore-private ignore-must-revalidate ignore-no-store store-stale
refresh_pattern \.(exe|msi|msp|msu|dmg|bin|xpi|iso|mar|psf|cab) 43200 99999999% 259200 override-expire ignore-reload ignore-no-cache ignore-private ignore-must-revalidate ignore-no-store store-stale
refresh_pattern \.(mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|wmv|mkv|m\dv|rv|vob|asx|ogm|flv|3gp|on2) 43200 999999% 259200 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-auth ignore-must-revalidate ignore-no-store negative-ttl=0 store-stale
refresh_pattern \.(doc|docx|pdf|ppt|pptx|psd|rtf|xls|xlsx) 43200 99999999% 5259487 override-expire reload-into-ims ignore-no-cache ignore-must-revalidate
refresh_pattern -i (cgi-bin) 0 0% 0
refresh_pattern \.(php|jsp|cgi|asx|asp|aspx|js)\? 0 0% 0
refresh_pattern . 0 50% 259200 store-stale

# Anonymous proxy
#via off
header_access From deny all
header_access Server deny all
header_access Link deny all
#header_access Via deny all
header_access X-Forwarded-For deny all
#httpd_suppress_version_string on

blank_error_pages on
quick_abort_min 0 KB
quick_abort_max 0 KB
quick_abort_pct 100
read_ahead_gap 32536 bytes
negative_ttl 1 second
positive_dns_ttl 12 hours
negative_dns_ttl 1 minute
range_offset_limit 64 KB
acl apache rep_header Server ^Apache
broken_vary_encoding allow apache
vary_ignore_expire on
forwarded_for transparent
cache_vary on
forward_timeout 2 minutes
shutdown_lifetime 5 seconds
cache_mgr Linux
detect_broken_pconn on
redirect_rewrites_host_header off
client_persistent_connections on
server_persistent_connections on
update_headers off
url_rewrite_host_header on
buffered_logs on
memory_pools off
httpd_accel_no_pmtu_disc on
check_hostnames off
max_filedescriptors 8291
tcp_recv_bufsize 0 KB
incoming_rate 20
collapsed_forwarding on
half_closed_clients on
icp_port 0
ipcache_size 10240
ipcache_low 98
ipcache_high 99
maximum_single_addr_tries 2
retry_on_error off
coredump_dir /cache
pipeline_prefetch on
n_aiops_threads 32
client_socksize -1 bytes
load_check_stopen on
load_check_stcreate on
download_fastest_client_speed off
cachemgr_passwd none all


============Storeurl.pl ===========

#!/usr/bin/perl
# $Rev$
# by chudy_fernandez@yahoo.com
# Youtube updates at http://wiki.squid-cache.org/ConfigExamp ... Discussion

$|=1;
while () {
@X = split;
# $X[1] =~ s/&sig=.*//;
$x = $X[0] . " ";
$_ = $X[1];
$u = $X[1];

if ($X[1] =~ /(youtube|google).*videoplayback\?/){
@itag = m/[&?](itag=[0-9]*)/;
@id = m/[&?](id=[^\&]*)/;
@range = m/(&range=[^\&\s]*)/;
print $x . "http://video-srv.youtube.com.SQUIDINTER ... ag@range\n";

#photos-X.ak.fbcdn.net where X a-z
} elsif (m/^http:\/\/photos-[a-z]?(.ak.fbcdn.net.*)/) {
print $x . "http://photos" . $1 . "\n";

#http://hphotos-ash2.fbcdn.net/290503_17 ... 8472_o.jpg
} elsif (m/^http:\/\/photos-ash[1-5]?(.fbcdn.net.*)/) {
print $x . "http://ash.photos" . $1 . "\n";

#photos.ak.fbcdn.net where X i(0-9)
#a5.sphotos.ak.fbcdn.ne
} elsif (m/^http:\/\/[a-z][0-9]?.(photos.ak.fbcdn.net.*)/) {
print $x . "http://cdn.photos" . $1 . "\n";

#BLOGSPOT
} elsif (m/^http:\/\/[1-4].bp.(blogspot.com.*)/) {
print $x . "http://blog-cdn." . $1 . "\n";

#AVAST
} elsif (m/^http:\/\/download[0-9]{3}.(avast.com.*)/) {
print $x . "http://avast-cdn." . $1 . "\n";

#KAV
} elsif (m/^http:\/\/dnl-[0-9]{2}.(geo.kaspersky.com.*)/) {
print $x . "http://kav-cdn." . $1 . "\n";

#AVG
} elsif (m/^http:\/\/update.avg.com/) {
print $x . "http://avg-cdn." . $1 . "\n";

#maps.google.com
} elsif (m/^http:\/\/(cbk|mt|khm|mlt|tbn)[0-9]?(.google\.co(m|\.uk|\.id).*)/) {
print $x . "http://" . $1 . $2 . "\n";

#gstatic and/or wikimapia
} elsif (m/^http:\/\/([a-z])[0-9]?(\.gstatic\.com.*|\.wikimapia\.org.*)/) {
print $x . "http://" . $1 . $2 . "\n";

# compatibility for old cached get_video?video_id
} elsif (m/^http:\/\/([0-9.]{4}|.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com|.*\.tube.tachyon\.net\.id\:99).*?(videoplayback\?id=.*?|video_id=.*?)\&(.*?)/) {
$z = $2; $z =~ s/video_id=/get_video?video_id=/;
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $z . "\n";

# youtube 1024p HD itag=37, 720p HD itag=22
} elsif (m/^http:\/\/([0-9.]{4}|.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com|.*\.tube.tachyon\.net\.id\:99).*?\&(itag=37|itag=22).*?\&(id=[a-zA-Z0-9]*)/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $2 . "&" . $3 . "\n";

# youtube 360p itag=34 ,480p itag=35 and others
} elsif (m/^http:\/\/([0-9.]{4}|.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com|.*\.tube.tachyon\.net\.id\:99).*?\&(itag=[0-9]*).*?\&(id=[a-zA-Z0-9]*)/) {
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/" . $3 . "\n";

} elsif (m/^http:\/\/www\.google-analytics\.com\/__utm\.gif\?.*/) {
print $x . "http://www.google-analytics.com/__utm.gif\n";

#Cache High Latency Ads
} elsif (m/^http:\/\/([a-z0-9.]*)(\.doubleclick\.net|\.quantserve\.com|\.googlesyndication\.com|yieldmanager|cpxinteractive)(.*)/) {
$y = $3;$z = $2;
for ($y) {
s/pixel;.*/pixel/;
s/activity;.*/activity/;
s/(imgad[^&]*).*/\1/;
s/;ord=[?0-9]*//;
s/;&timestamp=[0-9]*//;
s/[&?]correlator=[0-9]*//;
s/&cookie=[^&]*//;
s/&ga_hid=[^&]*//;
s/&ga_vid=[^&]*//;
s/&ga_sid=[^&]*//;
# s/&prev_slotnames=[^&]*//
# s/&u_his=[^&]*//;
s/&dt=[^&]*//;
s/&dtd=[^&]*//;
s/&lmt=[^&]*//;
s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/(&url=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/(&ref=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/(&cookie=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/[;&?]ord=[?0-9]*//;
s/[;&]mpvid=[^&;]*//;
s/&xpc=[^&]*//;
# yieldmanager
s/\?clickTag=[^&]*//;
s/&u=[^&]*//;
s/&slotname=[^&]*//;
s/&page_slots=[^&]*//;
}
print $x . "http://" . $1 . $2 . $y . "\n";

#cache high latency ads
} elsif (m/^http:\/\/(.*?)\/(ads)\?(.*?)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

#cdn, varialble 1st path
} elsif (($u =~ /filehippo|mediafire/) && (m/^http:\/\/(.*?)\.(.*?)\/(.*?)\/(.*)\.([a-zA-Z0-9]{2,3})(\?.*)?/)) {
@y = ($1,$2,$4,$5);
$y[0] =~ s/[a-z]+([0-9]+)?/cdn./;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

} elsif (($u =~ /maxporn/) && (m/^http:\/\/([^\/]*?)\/(.*?)\/([^\/]*?)(\?.*)?$/)) {
print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

#domain/path/.*/path/filename
} elsif (($u =~ /fucktube/) && (m/^http:\/\/(.*?)(\.[^\.\-]*?[^\/]*\/[^\/]*)\/(.*)\/([^\/]*)\/([^\/\?\&]*)\.([^\/\?\&]{3,4})(\?.*?)$/)) {
@y = ($1,$2,$4,$5,$6);
$y[0] =~ s/(([a-zA-Z]+[0-9]+(-[a-zA-Z])?$)|([^\.]*cdn[^\.]*)|([^\.]*cache[^\.]*))/cdn/;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "/" . $y[3] . "." . $y[4] . "\n";

# #4shared audio/video preview
} elsif (($u =~ /4shared/) && (m/^http:\/\/(.*?)\.(.*?)\/(.*?)\/(dlink__2Fdownload_2F([^\/-]+))([a-zA-Z0-9-]+)\/([^\/\?\&]*\.[^\/\?\&]{2,3})(\?.*)?$/)) {
@y = ($1,$2,$3,$4,$7);
$y[0] =~ s/[a-z]+([0-9]+)?/cdn./;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "/" . $y[3] . "/" . $y[4] . "\n";

#indowebster
} elsif (m/^http:\/\/(.*?)(\.jkt\.3d\.x\.indowebster.com)\/(.*?)\/([^\/\?\&]*)\.([^\/\?\&]{2,4})(\?.*?)$/) {
@y = ($1,$2,$4,$5);
$y[0] =~ s/([a-z][0-9][a-z]dlod[\d]{3})|((cache|cdn)[-\d]*)|([a-zA-Z]+-?[0-9]+(-[a-zA-Z]*)?)/cdn/;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

#like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
} elsif (($u =~ /tube8|pornhub|xvideos/) && (m/^http:\/\/(([A-Za-z]+[0-9-.]+)*?(\.[a-z]*)?)\.([a-z]*[0-9]?\.[^\/]{3}\/[a-z]*)(.*?)((\/[a-z]*)?(\/[^\/]*){4}\.[^\/\?]{3,4})(\?.*)?$/)) {
print $x . "http://cdn." . $4 . $6 . "\n";

#for yimg.com video
} elsif (m/^http:\/\/(.*yimg.com)\/\/(.*)\/([^\/\?\&]*\/[^\/\?\&]*\.[^\/\?\&]{3,4})(\?.*)?$/) {
print $x . "http://cdn.yimg.com//" . $3 . "\n";

#for yimg.com doubled
} elsif (m/^http:\/\/(.*?)\.yimg\.com\/(.*?)\.yimg\.com\/(.*?)\?(.*)/) {
print $x . "http://cdn.yimg.com/" . $3 . "\n";

#for yimg.com with &sig=
} elsif (m/^http:\/\/([^\.]*)\.yimg\.com\/(.*)/) {
@y = ($1,$2);
$y[0] =~ s/[a-z]+([0-9]+)?/cdn/;
$y[1] =~ s/&sig=.*//;
print $x . "http://" . $y[0] . ".yimg.com/" . $y[1] . "\n";

#youjizz. We use only domain and filename
} elsif (($u =~ /media[0-9]{1,5}\.youjizz/) && (m/^http:\/\/(.*?)(\.[^\.\-]*?\.[^\/]*)\/(.*)\/([^\/\?\&]*)\.([^\/\?\&]{3,4})(\?.*?)$/)) {
@y = ($1,$2,$4,$5);
$y[0] =~ s/(([a-zA-Z]+[0-9]+(-[a-zA-Z])?$)|([^\.]*cdn[^\.]*)|([^\.]*cache[^\.]*))/cdn/;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

#general purpose for cdn servers. add above your specific servers.
} elsif (m/^http:\/\/([0-9.]*?)\/\/(.*?)\.(.*)\?(.*?)/) {
print $x . "http://squid-cdn-url//" . $2 . "." . $3 . "\n";

#generic http://variable.domain.com/path/filename. "ext" or "exte"
} elsif (m/^http:\/\/(.*?)(\.[^\.\-]*?\..*?)\/([^\?\&\=]*)\.([\w\d]{2,4})\??.*$/) {
@y = ($1,$2,$3,$4);
$y[0] =~ s/([a-z][0-9][a-z]dlod[\d]{3})|((cache|cdn)[-\d]*)|([a-zA-Z]+-?[0-9]+(-[a-zA-Z]*)?)/cdn/;
print $x . "storeurl://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

# all that ends with ;
} elsif (m/^http:\/\/(.*?)\/(.*?)\;(.*)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

} else {
print $x . $X[1] . "\n";
}
}



Catatan :

1. saya sudah mengunakna storeurl.pl yg dianjurkan mas Pragola_Pati, youtube bisa cache tapi video yg dibuka itu2 aja.

please bantuanya.


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 02:12

Coba anda kembali ke pejwan dan simak baik2, insyaallah bisa :D
1. Dalam squid.conf yang anda lampirkan, tdk ada baris referer_log /var/log/squid/referer.log.
2. Apakah anda sudah install libfile-readbackwards-perl
3. Jalankan squid -z, hasilnya pastekan di sini.
BTW, postingan anda di atas sedapat mungkin di edit dan masukkan ke dalam spoiler. Biar tdk kepanjangan dan melebar ke-mana2
:D


User avatar
sekedang
Posts: 8
Joined: 31 Mar 2012, 21:03
Location: aceh
Contact:

Post by sekedang » 27 Mar 2013, 02:23

Mas Pragola :

1. untuk teks " referer_log /var/log/squid/referer.log " kira2 pada baris mana saya letakan pada squid.conf.

2. libfile-readbackwards-perl udah saya instal mas,saya intal setelah perintah diawah ini.
# sudo apt-get update
# sudo apt-get install squid squidclient squid-cgi
# sudo apt-get install gcc
# sudo apt-get install build-essential
# sudo apt-get install sharutils
# sudo apt-get install ccze
# sudo apt-get install libzip-dev
# sudo apt-get install automake1.9
# sudo apt-get remove squid
# apt-get autoremove


mf mas banyak nanyak newbie.


User avatar
rimbun
Posts: 5
Joined: 22 Mar 2013, 02:29
Location: medan
Contact:

Post by rimbun » 27 Mar 2013, 02:30

mas kok punya saya ngga hit ya video nya..bantu mass pra log


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 02:37

1. Masukkan saja dekat2 baris yang ada kata2 log
2. Coba kompil ulang seperti dalam pejwan, dan pada saat selasai tahap "make uninstall" anda masukkan =
./configure --prefix=/usr --exec_prefix=/usr --bindir=/usr/sbin --sbindir=/usr/sbin --libexecdir=/usr/lib/squid --sysconfdir=/etc/squid \
--localstatedir=/var/spool/squid --datadir=/usr/share/squid --enable-async-io=24 --with-aufs-threads=24 --with-pthreads --enable-storeio=aufs \
--enable-Linux-netfilter --enable-arp-acl --enable-epoll --enable-removal-policies=heap --with-aio --with-dl --enable-snmp \
--enable-delay-pools --enable-htcp --enable-cache-digests --disable-unlinkd --enable-large-cache-files --with-large-files \
--enable-err-languages=English --enable-default-err-language=English --with-maxfd=65536 --enable-referer-log

pada tahap ini memang harus disesuaikan dengan kondisi masing2 mas, tidak bisa di gebyah uyah. Yang saya sarankan pada no 2 di atas adalah punya anda sendiri (seperti pada postingan anda di atas pada no.4) tetapi ada tambahan --enable-referer-log.
:D


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 02:51

@rimbun
rimbun wrote:mas kok punya saya ngga hit ya video nya..bantu mass pra log
Jalankan squid -z hasilnya anda kopas di sini
:D


User avatar
Aira
Posts: 70
Joined: 22 Mar 2012, 21:20

Post by Aira » 27 Mar 2013, 03:32

Mas Pragola bukannya klao squid -z itu menandakan bahwa squid kita berjalan atau tidaknya betul ga?
(Boleh dunk mas Pragola lampirkan juga isi squid -z nya biar kita tahu apa isinya)
Alhamdulillah sebagian sudah bisa di cache youtubenya cuman klao ada beberapa video yang masih di putar itu2 juga kenapa ya mas?


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 03:53

@Aira
Ohaya ... sory. ngantuk ...yang betul squid -v. punya saya output-nya ada di pejwan.
:D


User avatar
rimbun
Posts: 5
Joined: 22 Mar 2013, 02:29
Location: medan
Contact:

Post by rimbun » 27 Mar 2013, 03:57

Last login: Wed Mar 27 03:31:33 2013 from 192.168.10.1
rimbun@rimbun:~$ sudo su
[sudo] password for rimbun:
root@rimbun:/home/rimbun# squid -v
Squid Cache: Version LUSCA_FMI
configure options: '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/sbin' '--sbindir=/usr/sbin' '--libexecdir=/usr/lib/squid' '--sysconfdir=/etc/squid' '--localstatedir=/var/spool/squid' '--datadir=/usr/share/squid' '--enable-referer-log' '--enable-http-gzip' '--enable-async-io=24' '--with-aufs-threads=24' '--with-pthreads' '--enable-storeio=aufs' '--enable-linux-netfilter' '--enable-arp-acl' '--enable-epoll' '--enable-removal-policies=heap' '--with-aio' '--with-dl' '--enable-snmp' '--enable-delay-pools' '--enable-htcp' '--enable-cache-digests' '--disable-unlinkd' '--enable-large-cache-files' '--with-large-files' '--enable-err-languages=English' '--enable-default-err-language=English' '--with-maxfd=65536'


udah bener ya om pro log


User avatar
rimbun
Posts: 5
Joined: 22 Mar 2013, 02:29
Location: medan
Contact:

Post by rimbun » 27 Mar 2013, 04:02

Last login: Wed Mar 27 03:31:33 2013 from 192.168.10.1
rimbun@rimbun:~$ sudo su
[sudo] password for rimbun:
root@rimbun:/home/rimbun# squid -v
Squid Cache: Version LUSCA_FMI
configure options: '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/sbin' '--sbindir=/usr/sbin' '--libexecdir=/usr/lib/squid' '--sysconfdir=/etc/squid' '--localstatedir=/var/spool/squid' '--datadir=/usr/share/squid' '--enable-referer-log' '--enable-http-gzip' '--enable-async-io=24' '--with-aufs-threads=24' '--with-pthreads' '--enable-storeio=aufs' '--enable-linux-netfilter' '--enable-arp-acl' '--enable-epoll' '--enable-removal-policies=heap' '--with-aio' '--with-dl' '--enable-snmp' '--enable-delay-pools' '--enable-htcp' '--enable-cache-digests' '--disable-unlinkd' '--enable-large-cache-files' '--with-large-files' '--enable-err-languages=English' '--enable-default-err-language=English' '--with-maxfd=65536'

kalo isi squid conf:
http_port 3128 transparent
cache_mem 8 MB
server_http11 on
icp_port 3130
pid_filename /var/run/squid.pid
coredump_dir /var/spool/squid/
referer_log /var/log/squid/referer.log
error_directory /usr/share/squid/errors/English
icon_directory /usr/share/squid/icons
mime_table /usr/share/squid/mime.conf

kalo storeurl.pl
#!/usr/bin/perl
# by tukangcucinamanyanandez@yahoo.com
# Youtube updates at http://wiki.squid-cache.org/ConfigExamp ... Discussion

$|=1;
while () {
@X = split;
$x = $X[0] . " ";

#facebook
if (m/^http\:\/\/.*(profile|photo).*\.ak\.fbcdn\.net(\/(h|)(profile|photos)-ak-)(snc|ash|prn)[0-9]?(.*)/) {
print $x . "http://facebook.SQUIDINTERNAL" . $2 . "fb" . $6 . "\n";

#Speedtest
} elsif (m/^http\:\/\/.*\/speedtest\/(.*\.(jpg|txt)).*/) {
print $x . "http://speedtest.SQUIDINTERNAL/" . $1 . "\n";

#BLOGSPOT
} elsif (m/^http:\/\/[1-4]\.bp\.(blogspot\.com.*)/) {
print $x . "http://blog-cdn." . $1 . "\n";

#ytimg
} elsif (m/^http:\/\/i[1-4]\.ytimg\.com(.*)/) {
print $x . "http://cdn.ytimg.com" . $1 . "\n";

#AVAST
} elsif (m/^http:\/\/download[0-9]{3}.(avast.com.*)/) {
print $x . "http://avast-cdn." . $1 . "\n";

#KAV
} elsif (m/^http:\/\/dnl-[0-9]{2}.(geo.kaspersky.com.*)/) {
print $x . "http://kav-cdn." . $1 . "\n";

#AVG
} elsif (m/^http:\/\/update.avg.com/) {
print $x . "http://avg-cdn." . $1 . "\n";

#maps.google.com
} elsif (m/^http:\/\/(cbk|mt|khm|mlt|tbn)[0-9]?(.google\.co(m|\.uk|\.id).*)/) {
print $x . "http://" . $1 . $2 . "\n";

#gstatic and/or wikimapia
} elsif (m/^http:\/\/([a-z])[0-9]?(\.gstatic\.com.*|\.wikimapia\.org.*)/) {
print $x . "http://" . $1 . $2 . "\n";

#maps.google.com
} elsif (m/^http:\/\/(khm|mt)[0-9]?(.google.com.*)/) {
print $x . "http://" . $1 . $2 . "\n";

#Untuk ALL Youtube
} elsif ($X[1] =~ m/^http\:\/\/.*(youtube|google).*videoplayback.*/){
@itag = m/[&?](itag=[0-9]*)/;
@CPN = m/[&?]cpn\=([a-zA-Z0-9\-\_]*)/;
@IDS = m/[&?]id\=([a-zA-Z0-9\-\_]*)/;
$id = &GetID($CPN[0], $IDS[0]);
@range = m/[&?](range=[^\&\s]*)/;
print $x . "http://video-srv.youtube.com.SQUIDINTERNAL/id=" . $id . "&@itag@range\n";

#Google
} elsif (m/^http:\/\/www\.google-analytics\.com\/__utm\.gif\?.*/) {
print $x . "http://www.google-analytics.com/__utm.gif\n";

#Cache High Latency Ads
} elsif (m/^http:\/\/([a-z0-9.]*)(\.doubleclick\.net|\.quantserve\.com|\.googlesyndication\.com|yieldmanager|cpxinteractive)(.*)/) {
$y = $3;$z = $2;
for ($y) {
s/pixel;.*/pixel/;
s/activity;.*/activity/;
s/(imgad[^&]*).*/\1/;
s/;ord=[?0-9]*//;
s/;&timestamp=[0-9]*//;
s/[&?]correlator=[0-9]*//;
s/&cookie=[^&]*//;
s/&ga_hid=[^&]*//;
s/&ga_vid=[^&]*//;
s/&ga_sid=[^&]*//;
# s/&prev_slotnames=[^&]*//
# s/&u_his=[^&]*//;
s/&dt=[^&]*//;
s/&dtd=[^&]*//;
s/&lmt=[^&]*//;
s/(&alternate_ad_url=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/(&url=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/(&ref=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/(&cookie=http%3A%2F%2F[^(%2F)]*)[^&]*/\1/;
s/[;&?]ord=[?0-9]*//;
s/[;&]mpvid=[^&;]*//;
s/&xpc=[^&]*//;
# yieldmanager
s/\?clickTag=[^&]*//;
s/&u=[^&]*//;
s/&slotname=[^&]*//;
s/&page_slots=[^&]*//;
}
print $x . "http://" . $1 . $2 . $y . "\n";

#cache high latency ads
} elsif (m/^http:\/\/(.*?)\/(ads)\?(.*?)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

} elsif (m/^http:\/\/(www\.ziddu\.com.*\.[^\/]{3,4})\/(.*?)/) {
print $x . "http://" . $1 . "\n";

#cdn, varialble 1st path
} elsif (($X[1] =~ /filehippo/) && (m/^http:\/\/(.*?)\.(.*?)\/(.*?)\/(.*)\.([a-z0-9]{3,4})(\?.*)?/)) {
@y = ($1,$2,$4,$5);
$y[0] =~ s/[a-z0-9]{2,5}/cdn./;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

#rapidshare
} elsif (($X[1] =~ /rapidshare/) && (m/^http:\/\/(([A-Za-z]+[0-9-.]+)*?)([a-z]*\.[^\/]{3}\/[a-z]*\/[0-9]*)\/(.*?)\/([^\/\?\&]{4,})$/)) {
print $x . "http://cdn." . $3 . "/SQUIDINTERNAL/" . $5 . "\n";

} elsif (($X[1] =~ /maxporn/) && (m/^http:\/\/([^\/]*?)\/(.*?)\/([^\/]*?)(\?.*)?$/)) {
print $x . "http://" . $1 . "/SQUIDINTERNAL/" . $3 . "\n";

#domain/path/.*/path/filename
} elsif (($X[1] =~ /fucktube/) && (m/^http:\/\/(.*?)(\.[^\.\-]*?[^\/]*\/[^\/]*)\/(.*)\/([^\/]*)\/([^\/\?\&]*)\.([^\/\?\&]{3,4})(\?.*?)$/)) {
@y = ($1,$2,$4,$5,$6);
$y[0] =~ s/(([a-zA-A]+[0-9]+(-[a-zA-Z])?$)|([^\.]*cdn[^\.]*)|([^\.]*cache[^\.]*))/cdn/;
print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "/" . $y[3] . "." . $y[4] . "\n";

#like porn hub variables url and center part of the path, filename etention 3 or 4 with or without ? at the end
} elsif (($X[1] =~ /tube8|pornhub|xvideos/) && (m/^http:\/\/(([A-Za-z]+[0-9-.]+)*?(\.[a-z]*)?)\.([a-z]*[0-9]?\.[^\/]{3}\/[a-z]*)(.*?)((\/[a-z]*)?(\/[^\/]*){4}\.[^\/\?]{3,4})(\?.*)?$/)) {
print $x . "http://cdn." . $4 . $6 . "\n";

#for yimg.com video
} elsif (m/^http:\/\/(.*yimg.com)\/\/(.*)\/([^\/\?\&]*\/[^\/\?\&]*\.[^\/\?\&]{3,4})(\?.*)?$/) {
print $x . "http://cdn.yimg.com/" . $3 . "\n";

#for yimg.com doubled
} elsif (m/^http:\/\/(.*?)\.yimg\.com\/(.*?)\.yimg\.com\/(.*?)\?(.*)/) {
print $x . "http://cdn.yimg.com/" . $3 . "\n";

#for yimg.com with &sig=
} elsif (m/^http:\/\/([^\.]*)\.yimg\.com\/(.*)/) {
@y = ($1,$2);
$y[0] =~ s/[a-z]+([0-9]+)?/cdn/;
$y[1] =~ s/&sig=.*//;
print $x . "http://" . $y[0] . ".yimg.com/" . $y[1] . "\n";

#youjizz. We use only domain and filename
#} elsif (($X[1] =~ /media[0-9]{1,5}\.youjizz/) && (m/^http:\/\/(.*?)(\.[^\.\-]*?\.[^\/]*)\/(.*)\/([^\/\?\&]*)\.([^\/\?\&]{3,4})(\?.*?)$/)) {
# @y = ($1,$2,$4,$5);
# $y[0] =~ s/(([a-zA-A]+[0-9]+(-[a-zA-Z])?$)|([^\.]*cdn[^\.]*)|([^\.]*cache[^\.]*))/cdn/;
# print $x . "http://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

#general purpose for cdn servers. add above your specific servers.
} elsif (m/^http:\/\/([0-9.]*?)\/\/(.*?)\.(.*)\?(.*?)/) {
print $x . "http://squid-cdn-url/" . $2 . "." . $3 . "\n";

# spicific extention
# } elsif (m/^http:\/\/(.*?)\.(jp(e?g|e|2)|gif|png|tiff?|bmp|ico|flv|wmv|3gp|mp(4|3)|exe|msi|zip|on2|mar|swf).*?/) {
# @y = ($1,$2);
# $y[0] =~ s/((cache|cdn)[-\d]*)|([a-zA-A]+-?[0-9]+(-[a-zA-Z]*)?)/cdn/;
# print $x . "http://" . $y[0] . "." . $y[1] . "\n";

#generic http://variable.domain.com/path/filename. "ext" or "exte"
#http://cdn1-28.projectplaylist.com
#http://s1sdlod041.bcst.cdn.s1s.yimg.com
} elsif (m/^http:\/\/(.*?)(\.[^\.\-]*?\..*?)\/([^\?\&\=]*)\.([\w\d]{2,4})\??.*$/) {
@y = ($1,$2,$3,$4);
$y[0] =~ s/([a-z][0-9][a-z]dlod[\d]{3})|((cache|cdn)[-\d]*)|([a-zA-A]+-?[0-9]+(-[a-zA-Z]*)?)/cdn/;
print $x . "storeurl://" . $y[0] . $y[1] . "/" . $y[2] . "." . $y[3] . "\n";

# all that ends with ;
} elsif (m/^http:\/\/(.*?)\/(.*?)\;(.*)/) {
print $x . "http://" . $1 . "/" . $2 . "\n";

} else {
print $x . $X[1] . "\n";
}
}


sub GetID
{
use File::ReadBackwards;
my $ref_log = File::ReadBackwards->new('/var/log/squid/referer.log');
while (defined($line = $ref_log->readline))
{
if ($line =~ m/.*youtube.*\/watch\?.*v=([a-zA-Z0-9\-\_]*).*\s.*id=$IDS[0].*/){
$id = $1;
last;
}
if ($line =~ m/.*youtube.*\/ptracking.*cpn=$CPN[0].*video\_id=([a-zA-Z0-9\-\_]*).*/){
$id = $1;
last;
}
if ($line =~ m/.*youtube.*\/ptracking.*video\_id=([a-zA-Z0-9\-\_]*).*cpn=$CPN[0].*/){
$id = $1;
last;
}
}
$ref_log->close();
return $id;
}


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 04:48

Dari output squid -v sudah betul ada '--enable-referer-log' dan storeurl.pl sudah pakai yang di pejwan. :confused:
Kasus-nya tidak bisa HIT tapi sudah tidak lagi redirect ya mas ?
Sebelum youtube error, bisa cache dan HIT ?


User avatar
rimbun
Posts: 5
Joined: 22 Mar 2013, 02:29
Location: medan
Contact:

Post by rimbun » 27 Mar 2013, 09:08

tq om sudah si balas..
kalo sebelum nya lancar jaya,,
mohon dibantu om dimana kendala saya


User avatar
q_p
Posts: 3109
Joined: 14 Oct 2012, 13:01
Contact:

Post by q_p » 27 Mar 2013, 11:43

Yang berubah setelah kita kompil ulang, baik yang berhasil mencache dan tdk redirect maupun yang tdk berhasil adalah =
1. Ubuntu kita terinstall 'libfile-readbackwards-perl' agar bisa memasukkan option '--enable-referer-log' pada saat kompile squid.\
2. Konfigurasi squid bertambah satu yaitu adanya '--enable-referer-log' seperti dalam output-nya cli "squid -v"
3. squid.conf berubah dengan bertambahnya satu baris yaitu "referer_log /var/log/squid/referer.log"
4. dan storeurl.pl
Sudah, hanya itu. Yang lain, termasuk misalnya refresh_pattern tidak ada perubahan.

Sekarang mari kita lihat output cli "squid -v" yang tidak berhasil =
rimbun wrote:root@rimbun:/home/rimbun# squid -v
Squid Cache: Version LUSCA_FMI
configure options: '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/sbin' '--sbindir=/usr/sbin' '--libexecdir=/usr/lib/squid' '--sysconfdir=/etc/squid' '--localstatedir=/var/spool/squid' '--datadir=/usr/share/squid' '--enable-referer-log' '--enable-http-gzip' '--enable-async-io=24' '--with-aufs-threads=24' '--with-pthreads' '--enable-storeio=aufs' '--enable-linux-netfilter' '--enable-arp-acl' '--enable-epoll' '--enable-removal-policies=heap' '--with-aio' '--with-dl' '--enable-snmp' '--enable-delay-pools' '--enable-htcp' '--enable-cache-digests' '--disable-unlinkd' '--enable-large-cache-files' '--with-large-files' '--enable-err-languages=English' '--enable-default-err-language=English' '--with-maxfd=65536'
Bandingkan dengan yang sudah berhasil mencache dan tdk redirect seperti di pejwan
Pragola_Pati wrote: CHOST="x86_64-pc-linux-gnu" CFLAGS="-march=amdfam10 -O2 -pipe" CXXFLAGS="${CFLAGS}" \
./configure -prefix=/usr -exec-prefix=/usr -bindir=/usr/sbin -sbindir=/usr/sbin \
-libexecdir=/usr/lib/squid -sysconfdir=/etc/squid -localstatedir=/var/spool/squid \
-datadir=/usr/share/squid --enable-gnuregex --enable-async-io=24 --with-aufs-threads=24 \
--with-pthreads --with-aio --with-dl --enable-storeio=aufs,null \
--enable-removal-policies=heap --enable-icmp --enable-delay-pools --disable-wccp \
--enable-snmp --enable-cache-digests --enable-default-err-language=English \
--enable-err-languages=English --enable-linux-netfilter --disable-ident-lookups \
--with-maxfd=65535 --enable-follow-x-forwarded-for --enable-large-cache-files \
--with-large-files --enable-referer-log
Menurut saya ada dua opsi yang perlu diperhatikan, yaitu =
1. CHOST="x86_64-pc-linux-gnu" CFLAGS="-march=amdfam10 -O2 -pipe" CXXFLAGS="${CFLAGS}"
2. dan '--with-maxfd=65535'
Yang pertama berkaitan dengan penggunaan prosesor dan yang kedua mengenai file-descriptor

Saran =
1. Konfigurasikan squid pada saat compile agar menggunakan processor secara optimal. Untuk itu sesuaikan processor yang digunakan server dengan merujuk ke Safe Cflags. Jika Ubuntu server anda memakai processor Intel silahkan merujuk ke sini
http://en.gentoo-wiki.com/wiki/Safe_Cflags/Intel
Jika AMD monggo mampir ke sini =
http://en.gentoo-wiki.com/wiki/Safe_Cflags/AMD
Untuk mengatahui type prosesor mesin Ubuntu Server anda, buka terminal =

Code: Select all

cat /proc/cpuinfo
Pada outputnya, perhatikan baris ke-5. Itulah type processor yang akan disesuaikan profile-nya dengan Safe Cflags. Profile inilah yang dimasukkan ke salah satu opsi penting dalam melakukan compile squid.
2. Mengenai file-descritor yang semuanya menggunakan angka 65536, lakukan cross-ceck pada file squid.conf, output dari cache-managerCGI, init-script (/etc/init.d/squid), file /etc/default/squid dan mesin ubuntu itu sendiri (ulimit -n). Hasilnya semua harus ada kesesuaian yaitu 65536, jika tidak penggunakan opsi '--with-maxfd=65536' pada saat kompil menjadi mentah. Untuk menaikkan file-descriptors secara permanen, silahkan ke trit =
http://ubuntu-indonesia.com/forums/ubbt ... Post117313
cmiiw


User avatar
cah_clacap
Posts: 258
Joined: 19 Mar 2013, 23:07
Location: Cilacap
Contact:

Post by cah_clacap » 27 Mar 2013, 15:51

Pragola_Pati wrote:@Cah Cilacap
Saya tidak tahu mas,
1. Bisa jadi memang begitu jika dilihat dari panjang tiap baris yang berbeda, sama2 diakhiri dollar. Jika pengaruh dari wrapping word pada jendela CLI, panjang baris pasti sama.
2. Jika tidak yakin dengan skenario pertama, hilangkan saja tanda dollar.
BTW, bagaimana untuk mengetahui = "youtube tidak loopback di atas storeurl_access deny dontrewrite yg lainnya ?

+++++++++++++++++++++++++++++++++++++
Ini bos link youtube yg tdk bisa cache ....................

http://www.youtube.com/watch?v=G-tZHIfKD2A

apa karena refresh_pattern nya ya yg bermasalah????

Saya pake ini .... mohon koreksi kesalahannya mas ..please

acl store_rewrite_list urlpath_regex \/(get_video|video\?v|videoplayback\?id|videoplayback.*id)
acl store_rewrite_list urlpath_regex \/(get_video\?|videodownload\?|videoplayback.*id|watch\?)
acl store_rewrite_list urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)\?
acl store_rewrite_list_domain url_regex ^http:\/\/(([a-z-]+[0-9-]+)|([0-9-]+[a-z-]+))\.[a-z0-9-]*\.[a-z]{2,4}
acl store_rewrite_list_domain url_regex ^http:\/\/([a-zA-Z-]+[0-9-]+)\.[A-Za-z]*\.[A-Za-z]*
acl store_rewrite_list_domain url_regex (([a-z]{1,2}[0-9]{1,3})|([0-9]{1,3}[a-z]{1,2}))\.[a-z]*[0-9]?\.[a-z]{3}
acl store_rewrite_list_path urlpath_regex \.(3gp|mp(3|4)|flv|(m|f)4v|on2|fid|avi|mov|wm(a|v)|(mp(e?g|a|e|1|2))|mk(a|v)|jp(e?g|e|2)|gif|png|tiff?|bmp|tga|svg|ico|swf|exe|ms(i|u|p)|cab|psf|mar|bin|z(ip|[0-9]{2})|r(ar|[0-9]{2})|7z)$
acl store_rewrite_list_domain_CDN url_regex (cbk|mt|khm|mlt|tbn)[0-9]?.google\.co(m|\.uk|\.id)
acl store_rewrite_list_domain_CDN url_regex photos-[a-z].ak.fbcdn.net
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/([a-z])[0-9]?(\.gstatic\.com|\.wikimapia\.org)
acl store_rewrite_list_domain_CDN url_regex ^http:\/\/[.a-z0-9]*\.photobucket\.com.*\.[a-z]{3}$
#acl store_rewrite_list_domain_CDN url_regex ^http:\/\/.*speedtest.*
acl store_rewrite_list_domain_CDN url_regex streamate.doublepimp.com.*\.js\? \.doubleclick\.net.* yieldmanager cpxinteractive quantserve\.com
acl speedtest_allow_url url_regex -i \.speedtest\.net\/ speedtest
acl speedtest_allow_url url_regex ^http:\/\/speedtest\.*
acl speedtest_allow_dom dstdomain .speedtest.net

acl dontrewrite url_regex (get_video|video\?v=|videoplayback\?id|videoplayback.*id).*begin\=[1-9][0-9]* \.php\? \.asp\? \.aspx\? threadless.*\.jpg\?r=
acl getmethod method GET

storeurl_access deny dontrewrite
storeurl_access deny !getmethod

storeurl_access allow store_rewrite_list_domain_CDN
storeurl_access allow store_rewrite_list
storeurl_access allow store_rewrite_list_domain store_rewrite_list_path
storeurl_access allow speedtest_allow_url
storeurl_access allow speedtest_allow_dom
storeurl_access deny all
storeurl_rewrite_program /usr/local/share/squid/storeurl.pl
#storeurl_rewrite_children 1
storeurl_rewrite_children 5
#storeurl_rewrite_concurrency 99
storeurl_rewrite_concurrency 10

acl billing dst 202.162.220.9
acl billing dst infobillingpln.msibali.com
always_direct allow billing
cache deny billing

acl DENYCACHE urlpath_regex \.(ini|ui|lst|inf|pak|ver|patch|md5|cfg|lst|list|rsc|log|conf|dbd|db)$
acl DENYCACHE urlpath_regex (notice.html|afs.dat|dat.asp|patchinfo.xml|version.list|iepngfix.htc|updates.txt|patchlist.txt)
acl DENYCACHE urlpath_regex (pointblank.css|login_form.css|form.css)$
acl DENYCACHE urlpath_regex (Loader|gamenotice|sources|captcha|notice|reset)
cache deny DENYCACHE

refresh_pattern imeem.*\.flv 0 0% 0 override-lastmod override-expire store-stale
refresh_pattern \.rapidshare.*\/[0-9]*\/.*\/[^\/]* 129600 90% 129600 ignore-reload store-stale
refresh_pattern ^http:\/\/199\.91\.15\d\.\d*\/\w{12}\/(\w*)\/(.*) 129600 90% 129600 ignore-no-cache ignore-no-store ignore-private override-expire override-lastmod reload-into-ims store-stale negative-ttl=0
refresh_pattern ^http:\/\/s[0-9]*\.filesonic\.com\/download\/([0-9]*)\/(.*) 129600 90% 129600 ignore-no-cache ignore-no-store ignore-private override-expire override-lastmod reload-into-ims store-stale negative-ttl=0
refresh_pattern ^http:\/\/[a-zA-Z]{2}\d*\.4shared\.com(:8080|)\/download\/(.*)\/(.*\..*)\?.* 129600 90% 129600 ignore-no-cache ignore-no-store ignore-private override-expire override-lastmod reload-into-ims store-stale negative-ttl=0
refresh_pattern (watch\?|get_video\?|videoplayback\?|videodownload\?|\.flv?) 129600 90% 129600 ignore-no-cache ignore-no-store ignore-private override-expire override-lastmod reload-into-ims store-stale negative-ttl=0
refresh_pattern vid\.akm\.dailymotion\.com.*\.on2\? 129600 90% 129600 override-expire override-lastmod ignore-no-cache store-stale
refresh_pattern \.(ico|video-stats) 129600 90% 129600 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-auth ignore-no-store negative-ttl=10080 store-stale
refresh_pattern ^http://(cbk|mt|khm|mlt)[0-9]?)\.google\.co(m|\.id) 129600 90% 129600 override-expire ignore-reload ignore-private negative-ttl=10080 store-stale
refresh_pattern ^http://(kh|khmdb|mw1)\.google\.com 129600 90% 129600 override-expire ignore-reload ignore-private negative-ttl=10080 store-stale
refresh_pattern ^http:\/\/[a-z]+[0-9]\.google\.co(m|\.id) 129600 90% 129600 override-expire ignore-reload ignore-private negative-ttl=10080 store-stale
refresh_pattern ^.*safebrowsing.*google 129600 90% 129600 override-expire ignore-reload ignore-no-cache ignore-private ignore-auth ignore-no-store negative-ttl=10080 store-stale
refresh_pattern (zynga|zgncdn)\.com.*\/ 10080 90% 129600 override-expire ignore-reload ignore-no-cache ignore-private ignore-auth ignore-no-store store-stale
refresh_pattern (ninjasaga|mafiawars|cityville|crowdstar)\.com.*\/ 10080 90% 129600 override-expire ignore-reload ignore-no-cache ignore-private ignore-auth ignore-no-store store-stale
refresh_pattern (yimg|ytimg|twimg)\.com.*\/ 129600 90% 129600 override-expire ignore-reload ignore-no-cache ignore-private ignore-auth ignore-no-store store-stale
refresh_pattern (photobucket|overclockersclub)\.com.*\/ 129600 90% 129600 override-expire ignore-reload ignore-no-cache ignore-private ignore-auth ignore-no-store store-stale
refresh_pattern ^http:\/\/image|images|pics|thumbs[0-9]\. 129600 90% 129600 override-expire ignore-reload ignore-no-cache ignore-private ignore-auth ignore-no-store store-stale
refresh_pattern \.etology\? 129600 90% 129600 override-expire ignore-reload ignore-no-cache store-stale
refresh_pattern galleries\.video(\?|sz) 129600 90% 129600 override-expire ignore-reload ignore-no-cache store-stale
refresh_pattern brazzers\? 129600 90% 129600 override-expire ignore-reload ignore-no-cache store-stale
refresh_pattern \.adtology\? 129600 90% 129600 override-expire ignore-reload ignore-no-cache store-stale
refresh_pattern ^.*(streamate.doublepimp.com.*\.js\?|utm\.gif|ads\?|rmxads\.com|ad\.z5x\.net|bh\.contextweb\.com|bstats\.adbrite\.com|a1\.interclick\.com|ad\.trafficmp\.com|ads\.cubics\.com|ad\.xtendmedia\.com|\.googlesyndication\.com|advertising\.com|yieldmanager|game-advertising\.com|pixel\.quantserve\.com|adperium\.com|doubleclick\.net|adserving\.cpxinteractive\.com|syndication\.com|media.fastclick.net).* 129600 90% 129600 ignore-no-cache ignore-private override-expire ignore-reload
refresh_pattern garena\.com 129600 90% 129600 override-expire reload-into-ims store-stale
refresh_pattern mediafire.com\/images.*\.(jp(e?g|e|2)|tiff?|bmp|gif|png) 129600 90% 129600 reload-into-ims override-expire ignore-private store-stale
refresh_pattern ^http:\/\/www.onemanga.com.*\/ 129600 90% 129600 reload-into-ims ignore-no-cache ignore-no-store ignore-reload override-expire store-stale
refresh_pattern ^http://v\.okezone\.com/get_video\/([a-zA-Z0-9]) 129600 90% 129600 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-private ignore-auth override-lastmod negative-ttl=10080 store-stale
refresh_pattern speedtest.*\.(jp(e?g|e|2)|tiff?|bmp|gif|png|swf|txt|js) 129600 90% 129600 store-stale negative-ttl=0
refresh_pattern code.google.com.*(svn|download) 86400 50% 129600 reload-into-ims
refresh_pattern \.google\.co(m|\.id).*\/ 10080 200% 43200 override-expire override-lastmod ignore-reload ignore-no-cache
refresh_pattern ^.google-analytics.com 43200 90% 43200 override-expire ignore-reload ignore-no-cache ignore-private
refresh_pattern -i \.(blogger|blogspot).com.*\.(jpg|png|gif|css|js)$ 10080 500% 262800 override-expire reload-into-ims override-lastmod ignore-no-cache
refresh_pattern -i \.wp.com.*\.(jpg|gif|png|ico|swf) 43200 90% 129600 override-expire override-lastmod ignore-reload ignore-no-cache
refresh_pattern -i (wp-(content|admin|include)).*\.(jp(e?g|e|2)|png|gif|swf|css|js)$ 10080 99% 20160 override-expire reload-into-ims override-lastmod ignore-no-cache
refresh_pattern -i ytimg.com.*\.(jpg|ico|png|gif)$ 43200 99% 43200 override-expire ignore-reload
refresh_pattern -i ytimg.com.*\.(css|js|xml)$ 1440 50% 10080 reload-into-ims override-expire
refresh_pattern -i friv.com.*\.(ico|jpg|png|gif|swf|js) 10080 90% 43200 ignore-reload override-expire ignore-no-cache ignore-no-store ignore-must-revalidate store-stale
refresh_pattern -i stl.gamib.com.*\.(ico|jpg|png|gif|swf|js) 10080 90% 43200 ignore-reload override-expire ignore-no-cache ignore-no-store ignore-must-revalidate store-stale
refresh_pattern .kemdiknas.\go.id.*\.(jp(e?g|e|2)|gif|png|swf) 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern .kemenag.\go.id.*\.(jp(e?g|e|2)|gif|png|swf) 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale


#images facebook
refresh_pattern -i .*\.((facebook.com)|(85.131.151.39))\.(jpg|png|gif) 10080 90% 129600 ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern -i .*\.fbcdn\.net\/.*\.((jp(e?g|e|2)|gif|pn[pg]|bm?|tiff?|ico|swf|css|js)|(jp(e?g|e|2)|gif|pn[pg]|bm?|tiff?|ico|swf|css|js)\?) 10080 99% 129600 ignore-no-cache ignore-no-store ignore-private override-expire override-lastmod reload-into-ims store-stale
refresh_pattern -i \.((facebook.com)|(fbcdn.net)|(akamaihd.net)).*\/ 10080 99% 129600 ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern static\.ak\.fbcdn\.net*\.(jpg|gif|png) 10080 99% 129600 ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/profile\.ak\.fbcdn.net*\.(jpg|gif|png) 10080 99% 129600 ignore-reload override-expire ignore-no-cache ignore-no-store store-stale

#ads
refresh_pattern ^.*(streamate.doublepimp.com.*\.js\?|utm\.gif|ads\?|rmxads\.com|ad\.z5x\.net|bh\.contextweb\.com|bstats\.adbrite\.com|a1\.interclick\.com|ad\.trafficmp\.com|ads\.cubics\.com|ad\.xtendmedia\.com|\.googlesyndication\.com|advertising\.com|yieldmanager|game-advertising\.com|pixel\.quantserve\.com|adperium\.com|doubleclick\.net|adserving\.cpxinteractive\.com|syndication\.com|media.fastclick.net).* 2629742 20% 2629742 ignore-no-cache ignore-no-store ignore-private override-expire ignore-reload ignore-auth ignore-must-revalidate store-stale negative-ttl=40320 max-stale=1440
refresh_pattern (get_video\?|videoplayback\?|videodownload\?|watch\?\.flv?|.vid\?) 2629742 99999999% 2629742 override-expire ignore-reload ignore-must-revalidate ignore-no-cache ignore-no-store ignore-private store-stale negative-ttl=0
refresh_pattern (\.swf\?|\.avi\?|\.mov\?|\.wm(a|v)\?|\.3gp\?|\.mp(4|3)\?|\.rm\?|\.ram\?|\.m4v\?|\.on2\?) 43200 999999% 2629742 override-expire ignore-reload ignore-must-revalidate ignore-no-cache ignore-no-store ignore-private store-stale negative-ttl=0
refresh_pattern \.(ico|video-stats) 2629742 999999% 2629742 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-private ignore-auth override-lastmod ignore-must-revalidate negative-ttl=10080 store-stale

refresh_pattern (photobucket|pbsrc|flickr|yimg|ytimg|twimg|gravatar)\.com.*\.(jp(e?g|e|2)|gif|png|tiff?|bmp|swf|mp(4|3)) 2629742 999999% 2629742 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern ^http:\/\/images|image|img|pics|openx|thumbs[0-9]\. 2629742 999999% 2629742 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern (zynga|ninjasaga|mafiawars|cityville|farmville|crowdstar|spilcdn|agame|popcap)\.com/.* 2629742 999999% 2629742 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern \.(akamaihd|edgecastcdn|spilcdn|zgncdn|(tw|y|yt)img)\.com.*\.(jp(e?g|e|2)|gif|png|swf|mp(3|4)) 43200 99999% 43200 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-must-revalidate store-stale
refresh_pattern \.gstatic\.com/images\? 43200 99999% 43200 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-must-revalidate store-stale
refresh_pattern (gstatic|diggstatic)\.com/.* 2629742 999999% 2629742 override-expire ignore-reload ignore-no-cache ignore-private ignore-no-store ignore-must-revalidate store-stale
refresh_pattern ^http://((cbk|mt|khm|mlt|tbn)[0-9]?)\.google\.co(m|\.uk|\.id) 43200 999999% 43200 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-auth ignore-must-revalidate ignore-no-store negative-ttl=10080 store-stale
refresh_pattern vid\.akm\.dailymotion\.com.*\.on2\? 2629742 999999% 2629742 ignore-no-cache override-expire override-lastmod store-stale
refresh_pattern \.speedtest/.* 43200 99999% 432000 override-expire ignore-reload ignore-no-cache ignore-no-store ignore-must-revalidate store-stale
refresh_pattern galleries\.video(\?|sz) 2629742 999999% 2629742 override-expire ignore-reload ignore-no-cache ignore-must-revalidate ignore-private store-stale
refresh_pattern \.wikimapia\.org\/? 43200 99999% 43200 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-must-revalidate store-stale
refresh_pattern \.(rackcdn|spilcdn|zgncdn)\.com.*\.(jp(e?g|e|2)|gif|png|swf|mp(3|4)) 43200 9999% 43200 override-expire ignore-reload ignore-no-cache store-stale
refresh_pattern code.googlec.com.*(svn|download) 0 50% 1440 reload-into-ims

#sensitive site
refresh_pattern -i \.(sc-|dl-|ex-|mh-|dll|da-|iop) 0 5% 60 reload-into-ims
refresh_pattern -i \.(mst|Xtp)$ 0 50% 1440 reload-into-ims
refresh_pattern -i (main.exe|update.exe|grandchase.exe|FSLauncher.exe|FreeStyle_Setup.exe|grandchase.exe|filelist.zip|autoupgrade.exe)$ 0 50% 1440 reload-into-ims
refresh_pattern -i (UpdaterModifier.exe|FreeStyle.exe|PBLauncher.exe|update.exe|NewLauncher.exe|NewAvalon.exe|hon.exe.zip|cabal.exe)$ 0 50% 1440 reload-into-ims
refresh_pattern -i (PointBlank.exe.zip|HSUpdate.exe.zip|PBConfig.exe.zip) 0 50% 1440 reload-into-ims
refresh_pattern -i (wks_avira-win32-en-pecl.info.gz|wks_avira10-win32-en-pecl.info.gz)$ 0 50% 1440 reload-into-ims
refresh_pattern -i (setup.exe.gz|avscan.exe.gz|avguard.exe.gz|filelist.zip|AvaClient.exe) 0 50% 1440 reload-into-ims
refresh_pattern -i (livescore.com|goal.com|bobet) 0 50% 240 reload-into-ims

#News
refresh_pattern -i \.(kompas|kompasiana).com.*\.(jpg|png|gif|swf)$ 10080 500% 262800 override-expire reload-into-ims override-lastmod ignore-no-cache
refresh_pattern -i \.vivanews.com.*\.(jpg|png|gif|swf)$ 10080 500% 262800 override-expire reload-into-ims override-lastmod ignore-no-cache
refresh_pattern \.(detik|detik(inet|sport|food|health|news)).com.*\.(jpg|png|gif|css|js|swf)$ 10080 200% 43200 override-expire override-lastmod ignore-no-cache
refresh_pattern -i \.(yimg|yahoo).com.*\.(jpg|png|gif)$ 10080 500% 262800 override-expire reload-into-ims override-lastmod ignore-no-cache

#banner IIX
refresh_pattern ^http:\/\/openx.*\.(jp(e?g|e|2)|gif|pn[pg]|swf|ico|css|tiff?) 129600 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/ads(1|2|3|4).kompas.com.*\/ 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/img.ads.kompas.com.*\/ 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern .kompasimages.com.*\.(jpg|gif|png|swf) 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern .kompasads.com.*\.(jpg|gif|png|swf) 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/openx.kompas.com.*\/ 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/openx.detik.com.*\/ 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern .kaskus.\co.id.*\.(jp(e?g|e|2)|gif|png|swf) 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale
refresh_pattern ^http:\/\/img.kaskus.co.id.*\.(jpg|gif|png|swf) 43200 99% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale

# WINDOWS UPDATE
refresh_pattern windowsupdate.com/.*\.(cab|exe) 43200 999999% 129600 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern update.microsoft.com/.*\.(cab|exe) 43200 999999% 129600 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern download.microsoft.com/.*\.(cab|exe) 43200 999999% 129600 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale

# ANTI VIRUS
refresh_pattern avast.com.*\.vpx 43200 99% 43200 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern guru.avg.com/.*\.(bin) 43200 99% 43200 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern (avgate|avira).*(idx|gz)$ 43200 99% 43200 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern kaspersky.*\.avc$ 43200 99% 43200 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern kaspersky 43200 999% 43200 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern update.nai.com/.*\.(gem|zip|mcs) 43200 99% 43200 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale
refresh_pattern ^http:\/\/liveupdate.symantecliveupdate.com.*\(zip) 43200 99% 43200 ignore-no-cache ignore-no-store ignore-reload reload-into-ims store-stale

#IIX DOWNLOAD
refresh_pattern ^http:\/\/\.www[0-9][0-9]\.indowebster\.com\/(.*)(mp3|rar|zip|flv|wmv|3gp|mp(4|3)|exe|msi|zip) 43200 99999% 129600 reload-into-ims ignore-reload override-expire ignore-no-cache ignore-no-store store-stale ignore-auth

#general
refresh_pattern \.(jp(e?g|e|2)|tiff?|bmp|gif|png) 2629742 999999% 2629742 ignore-no-cache ignore-no-store reload-into-ims override-expire ignore-private ignore-must-revalidate store-stale
refresh_pattern \.(z(ip|[0-9]{2})|r(ar|[0-9]{2})|jar|bz2|gz|tar|rpm|vpu) 2629742 999999% 2629742 override-expire reload-into-ims ignore-no-cache ignore-private ignore-must-revalidate ignore-no-store store-stale
refresh_pattern \.(mp3|wav|og(g|a)|flac|midi?|rm|aac|wma|mka|ape) 2629742 999999% 2629742 override-expire reload-into-ims ignore-reload ignore-no-cache ignore-private ignore-must-revalidate ignore-no-store store-stale
refresh_pattern \.(exe|msi|msp|msu|dmg|bin|xpi|iso|swf|mar|psf|cab) 2629742 999999% 2629742 override-expire reload-into-ims ignore-reload ignore-no-cache ignore-private ignore-must-revalidate ignore-no-store store-stale
refresh_pattern \.(mpeg|ra?m|avi|mp(g|e|4)|mov|divx|asf|wmv|m\dv|rv|vob|asx|ogm|flv|3gp|on2) 2629742 999999% 2629742 override-expire override-lastmod ignore-reload ignore-no-cache ignore-private ignore-auth ignore-must-revalidate ignore-no-store negative-ttl=0 store-stale
refresh_pattern -i (cgi-bin) 0 0% 0
refresh_pattern \.(php|jsp|cgi|asx|asp|aspx)\? 0 0% 0
refresh_pattern ^ftp: 40320 20% 40320 override-expire reload-into-ims store-stale
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern . 0 50% 40320 store-stale


User avatar
cah_clacap
Posts: 258
Joined: 19 Mar 2013, 23:07
Location: Cilacap
Contact:

Post by cah_clacap » 27 Mar 2013, 15:52

@ MAs Pragola :

Apa karena refresh_pattern saya yg ga bener ya .... mohon dibantu koreksi refresh_pattern saya yg di atas tadi mas ...
makasih


Post Reply

Who is online

Users browsing this forum: No registered users and 21 guests