User-agent: *
Disallow: /db/
Disallow: /dl/
Disallow: /enrol/
Disallow: /portal/
Disallow: /intro/
Disallow: /et/
Disallow: /pdf/
Disallow: /sphider/
Disallow: /test/