1

I am trying to download a site as you see bellow with curl or wget but either one seems to work. I tried different options like "curl -k" seemed promising, but did not work. Every one is allowed to visit the page, it works with Firefox. I also check this page for answers but did not find one, although I think it is a similar problem.

--

curl "https://cdburnerxp.se/en/development"

Community
  • 1
andrej
  • 129

1 Answers1

0

Either it is a 403 page. You are not allowed. Or you can use a user agent such as this.

wget --header="User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_0) AppleWebKit/600.1.17 (KHTML, like Gecko) Version/8.0 Safari/600.1.17" http://website.com

It will allow you to access some websites. If this doesn't work then your are probably not allowed to visit the link.

DisplayName
  • 11,688
  • Everyone is allowed to visit, it works with Firefox. If I do code(curl -k "http://notepad-plus-plus.org/news/") it works fine – andrej Sep 30 '14 at 06:23
  • Ok, did you try it with a user agent? – DisplayName Sep 30 '14 at 06:24
  • Sorry, what is a user agent? – andrej Sep 30 '14 at 06:27
  • It makes the the website think that you are on a browser. – DisplayName Sep 30 '14 at 06:28
  • I just tried code(curl --user-agent "Mozilla/4.0" "https://cdburnerxp.se/en/development") but it does not work. – andrej Sep 30 '14 at 06:31
  • I guess it is not possible to download the page https://cdburnerxp.se/en/development with linux :( – andrej Oct 02 '14 at 06:53
  • You have to type out a longer agent. Copy my code. – DisplayName Oct 02 '14 at 18:07
  • And add the website at the end instead of http://website.com – DisplayName Oct 02 '14 at 18:08
  • I did: wget --header="User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_0) AppleWebKit/600.1.17 (KHTML, like Gecko) Version/8.0 Safari/600.1.17" "https://cdburnerxp.se/en/development"

    and get :

    --2014-10-03 08:58:46-- https://cdburnerxp.se/en/development Resolving cdburnerxp.se... 176.9.56.74, 2a01:4f8:150:84c2::2 Connecting to cdburnerxp.se|176.9.56.74|:443... connected. HTTP request sent, awaiting response... 403 Forbidden 2014-10-03 08:58:47 ERROR 403: Forbidden. `

     – andrej Oct 03 '14 at 04:59
  • I did this, wget --header="User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_0) AppleWebKit/600.1.17 (KHTML, like Gecko) Version/8.0 Safari/600.1.17" cdburnerxp.se/en/development And it worked. – DisplayName Oct 03 '14 at 05:29