blob: 3c6dd9d8b4ce38043549619500cca64d5153adb9 [file] [log] [blame]
Daniel Stenberga19b23b2005-04-13 08:47:59 +00001Updated: April 13, 2005 (http://curl.haxx.se/docs/faq.html)
Daniel Stenbergeea22872004-03-16 07:56:51 +00002 _ _ ____ _
3 ___| | | | _ \| |
4 / __| | | | |_) | |
5 | (__| |_| | _ <| |___
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +00006 \___|\___/|_| \_\_____|
7
8FAQ
9
Daniel Stenbergc3318b42000-08-17 14:06:42 +000010 1. Philosophy
11 1.1 What is cURL?
12 1.2 What is libcurl?
Daniel Stenbergc3688002004-10-04 12:54:58 +000013 1.3 What is curl not?
Daniel Stenbergc3318b42000-08-17 14:06:42 +000014 1.4 When will you make curl do XXXX ?
Daniel Stenbergc3688002004-10-04 12:54:58 +000015 1.5 Who makes curl?
16 1.6 What do you get for making curl?
Daniel Stenbergc528dc52001-08-07 11:17:37 +000017 1.7 What about CURL from curl.com?
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +000018 1.8 I have a problem who do I mail?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000019
Daniel Stenbergc3318b42000-08-17 14:06:42 +000020 2. Install Related Problems
21 2.1 configure doesn't find OpenSSL even when it is installed
Daniel Stenberg811edcd2004-08-10 08:41:41 +000022 2.1.1 native linker doesn't find OpenSSL
23 2.1.2 only the libssl lib is missing
Daniel Stenbergc3318b42000-08-17 14:06:42 +000024 2.2 Does curl work/build with other SSL libraries?
25 2.3 Where can I find a copy of LIBEAY32.DLL?
Daniel Stenbergc3688002004-10-04 12:54:58 +000026 2.4 Does curl support Socks (RFC 1928) ?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000027
Daniel Stenbergc3318b42000-08-17 14:06:42 +000028 3. Usage Problems
29 3.1 curl: (1) SSL is disabled, https: not supported
30 3.2 How do I tell curl to resume a transfer?
31 3.3 Why doesn't my posting using -F work?
32 3.4 How do I tell curl to run custom FTP commands?
33 3.5 How can I disable the Pragma: nocache header?
Daniel Stenberg48bc73c2002-05-21 13:53:32 +000034 3.6 Does curl support ASP, XML, XHTML or HTML version Y?
Daniel Stenbergc3318b42000-08-17 14:06:42 +000035 3.7 Can I use curl to delete/rename a file through FTP?
36 3.8 How do I tell curl to follow HTTP redirects?
Daniel Stenberg98871d12002-05-22 22:14:03 +000037 3.9 How do I use curl in my favorite programming language?
Daniel Stenberg147a6732001-03-08 09:25:09 +000038 3.10 What about SOAP, WebDAV, XML-RPC or similar protocols over HTTP?
Daniel Stenberg88d14e92001-05-29 14:02:20 +000039 3.11 How do I POST with a different Content-Type?
Daniel Stenberg6513dce2001-11-27 13:34:59 +000040 3.12 Why do FTP specific features over HTTP proxy fail?
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +000041 3.13 Why does my single/double quotes fail?
Daniel Stenberg48bc73c2002-05-21 13:53:32 +000042 3.14 Does curl support javascript or pac (automated proxy config)?
Daniel Stenbergf3e5d4a2003-12-22 17:24:21 +000043 3.15 Can I do recursive fetches with curl?
Daniel Stenbergedd16d92004-08-12 11:39:00 +000044 3.16 What certificates do I need when I use SSL?
Daniel Stenberg951fdeb2004-12-21 09:37:55 +000045 3.17 How do I list the root dir of an FTP server?
Daniel Stenberge9eb5232005-04-05 14:36:37 +000046 3.18 Can I use curl to send a POST/PUT and not wait for a response?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000047
Daniel Stenbergc3318b42000-08-17 14:06:42 +000048 4. Running Problems
49 4.1 Problems connecting to SSL servers.
Daniel Stenberge26ee092001-01-15 10:26:37 +000050 4.2 Why do I get problems when I use & or % in the URL?
Daniel Stenbergc3318b42000-08-17 14:06:42 +000051 4.3 How can I use {, }, [ or ] to specify multiple URLs?
52 4.4 Why do I get downloaded data even though the web page doesn't exist?
53 4.5 Why do I get return code XXX from a HTTP server?
54 4.5.1 "400 Bad Request"
55 4.5.2 "401 Unauthorized"
56 4.5.3 "403 Forbidden"
57 4.5.4 "404 Not Found"
58 4.5.5 "405 Method Not Allowed"
Daniel Stenbergd60029d2001-12-19 23:25:04 +000059 4.5.6 "301 Moved Permanently"
Daniel Stenbergc3318b42000-08-17 14:06:42 +000060 4.6 Can you tell me what error code 142 means?
Daniel Stenberg4c485992001-04-22 15:45:27 +000061 4.7 How do I keep user names and passwords secret in Curl command lines?
Daniel Stenberg09ba8562000-10-27 12:25:00 +000062 4.8 I found a bug!
Daniel Stenberg2c100372000-12-19 07:30:51 +000063 4.9 Curl can't authenticate to the server that requires NTLM?
Daniel Stenbergbc743752002-05-15 21:40:29 +000064 4.10 My HTTP request using HEAD, PUT or DELETE doesn't work!
Daniel Stenberg522b85a2002-11-12 20:00:02 +000065 4.11 Why does my HTTP range requests return the full document?
Daniel Stenberg16077112002-11-20 19:17:43 +000066 4.12 Why do I get "certificate verify failed" ?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000067
Daniel Stenbergc3318b42000-08-17 14:06:42 +000068 5. libcurl Issues
Daniel Stenberg7d09e512001-01-11 12:52:07 +000069 5.1 Is libcurl thread-safe?
Daniel Stenberga40b55d2000-11-22 07:27:26 +000070 5.2 How can I receive all data into a large memory chunk?
Daniel Stenberg2c100372000-12-19 07:30:51 +000071 5.3 How do I fetch multiple files with libcurl?
Daniel Stenberg910fc852000-12-30 11:48:51 +000072 5.4 Does libcurl do Winsock initing on win32 systems?
Daniel Stenberg7e3cd822003-12-08 13:59:35 +000073 5.5 Does CURLOPT_WRITEDATA and CURLOPT_READDATA work on win32 ?
Daniel Stenberg4c485992001-04-22 15:45:27 +000074 5.6 What about Keep-Alive or persistent connections?
Daniel Stenbergdd82d692002-10-08 07:16:17 +000075 5.7 Link errors when building libcurl on Windows!
Daniel Stenberg811edcd2004-08-10 08:41:41 +000076 5.8 libcurl.so.3: open failed: No such file or directory
Daniel Stenberg1d323362004-08-12 14:09:10 +000077 5.9 How does libcurl resolve host names?
Daniel Stenberge9eb5232005-04-05 14:36:37 +000078 5.10 How do I prevent libcurl from writing the response to stdout?
Daniel Stenberg6e8e0412005-04-05 14:38:38 +000079 5.11 How do I make libcurl not receive the whole HTTP response?
Daniel Stenbergb5d50e92005-04-11 13:39:55 +000080 5.12 Can I make libcurl fake or hide my real IP address?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000081
Daniel Stenbergc3318b42000-08-17 14:06:42 +000082 6. License Issues
83 6.1 I have a GPL program, can I use the libcurl library?
84 6.2 I have a closed-source program, can I use the libcurl library?
Daniel Stenberg31b8eea2000-08-23 07:27:00 +000085 6.3 I have a BSD licensed program, can I use the libcurl library?
86 6.4 I have a program that uses LGPL libraries, can I use libcurl?
87 6.5 Can I modify curl/libcurl for my program and keep the changes secret?
88 6.6 Can you please change the curl/libcurl license to XXXX?
Daniel Stenbergc3318b42000-08-17 14:06:42 +000089
Daniel Stenberg9ac76292004-08-18 11:18:36 +000090 7. PHP/CURL Issues
91 7.1 What is PHP/CURL?
92 7.2 Who write PHP/CURL?
93 7.3 Can I perform multiple requests using the same handle?
94
Daniel Stenbergc3318b42000-08-17 14:06:42 +000095==============================================================================
96
971. Philosophy
98
99 1.1 What is cURL?
100
Daniel Stenbergc3688002004-10-04 12:54:58 +0000101 cURL is the name of the project. The name is a play on 'Client for URLs',
102 originally with URL spelled in uppercase to make it obvious it deals with
103 URLs. The fact it can also be pronounced 'see URL' also helped, it works as
104 an abbrivation for "Client URL Request Library" or why not the recursive
Daniel Stenbergeea22872004-03-16 07:56:51 +0000105 version: "Curl URL Request Library".
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000106
Daniel Stenbergc3688002004-10-04 12:54:58 +0000107 The cURL project produces two products:
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000108
Daniel Stenbergc3688002004-10-04 12:54:58 +0000109 libcurl
110
111 A free and easy-to-use client-side URL transfer library, supporting FTP,
112 FTPS, HTTP, HTTPS, GOPHER, TELNET, DICT, FILE and LDAP. libcurl supports
113 HTTPS certificates, HTTP POST, HTTP PUT, FTP uploading, kerberos, HTTP
114 form based upload, proxies, cookies, user+password authentication, file
115 transfer resume, http proxy tunneling and more!
116
117 libcurl is highly portable, it builds and works identically on numerous
118 platforms, including Solaris, NetBSD, FreeBSD, OpenBSD, Darwin, HPUX,
119 IRIX, AIX, Tru64, Linux, UnixWare, HURD, Windows, Amiga, OS/2, BeOs, Mac
120 OS X, Ultrix, QNX, OpenVMS, RISC OS, Novell NetWare, DOS and more...
121
122 libcurl is free, thread-safe, IPv6 compatible, feature rich, well
123 supported and fast.
Gisle Vanem51a87fa2004-11-24 15:14:42 +0000124
Daniel Stenbergc3688002004-10-04 12:54:58 +0000125 curl
126
127 A command line tool for getting or sending files using URL syntax.
128
129 Since curl uses libcurl, it supports a range of common Internet protocols,
130 currently including HTTP, HTTPS, FTP, FTPS, GOPHER, LDAP, DICT, TELNET and
131 FILE.
132
133 We pronounce curl and cURL with an initial k sound: [kurl].
Daniel Stenberg887e7282001-01-03 09:13:07 +0000134
Daniel Stenberg073ef0b2003-05-09 07:07:13 +0000135 NOTE: there are numerous sub-projects and related projects that also use the
136 word curl in the project names in various combinations, but you should take
137 notice that this FAQ is directed at the command-line tool named curl (and
Daniel Stenbergeea22872004-03-16 07:56:51 +0000138 libcurl the library), and may therefore not be valid for other curl-related
Daniel Stenberg073ef0b2003-05-09 07:07:13 +0000139 projects.
140
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000141 1.2 What is libcurl?
142
Daniel Stenbergbc5954f2001-03-23 08:16:24 +0000143 libcurl is a reliable and portable library which provides you with an easy
Daniel Stenberg4c485992001-04-22 15:45:27 +0000144 interface to a range of common Internet protocols.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000145
Daniel Stenbergeea22872004-03-16 07:56:51 +0000146 You can use libcurl for free in your application, be it open source,
147 commercial or closed-source.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000148
Daniel Stenbergc3688002004-10-04 12:54:58 +0000149 1.3 What is curl not?
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000150
Daniel Stenbergeea22872004-03-16 07:56:51 +0000151 Curl is *not* a wget clone. That is a common misconception. Never, during
152 curl's development, have we intended curl to replace wget or compete on its
153 market. Curl is targeted at single-shot file transfers.
154
155 Curl is not a web site mirroring program. If you want to use curl to mirror
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000156 something: fine, go ahead and write a script that wraps around curl to make
157 it reality (like curlmirror.pl does).
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000158
Daniel Stenberg4c485992001-04-22 15:45:27 +0000159 Curl is not an FTP site mirroring program. Sure, get and send FTP with curl
160 but if you want systematic and sequential behavior you should write a
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000161 script (or write a new program that interfaces libcurl) and do it.
162
163 Curl is not a PHP tool, even though it works perfectly well when used from
Daniel Stenbergc3688002004-10-04 12:54:58 +0000164 or with PHP (when using the PHP/CURL module).
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000165
Daniel Stenberg31b8eea2000-08-23 07:27:00 +0000166 Curl is not a single-OS program. Curl exists, compiles, builds and runs
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000167 under a wide range of operating systems, including all modern Unixes (and a
168 bunch of older ones too), Windows, Amiga, BeOS, OS/2, OS X, QNX etc.
Daniel Stenberg31b8eea2000-08-23 07:27:00 +0000169
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000170 1.4 When will you make curl do XXXX ?
171
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000172 We love suggestions of what to change in order to make curl and libcurl
173 better. We do however believe in a few rules when it comes to the future of
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000174 curl:
175
Daniel Stenberg073ef0b2003-05-09 07:07:13 +0000176 * Curl -- the command line tool -- is to remain a non-graphical command line
177 tool. If you want GUIs or fancy scripting capabilities, you should look
178 for another tool that uses libcurl.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000179
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000180 * We do not add things to curl that other small and available tools already
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000181 do very fine at the side. Curl's output is fine to pipe into another
182 program or redirect to another file for the next program to interpret.
183
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000184 * We focus on protocol related issues and improvements. If you wanna do more
Daniel Stenberg5f8e93d2000-10-25 07:41:58 +0000185 magic with the supported protocols than curl currently does, chances are
Daniel Stenberg7d24ce92001-11-01 09:12:35 +0000186 big we will agree. If you wanna add more protocols, we may very well
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000187 agree.
188
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000189 * If you want someone else to make all the work while you wait for us to
190 implement it for you, that is not a very friendly attitude. We spend a
191 considerable time already on maintaining and developing curl. In order to
192 get more out of us, you should consider trading in some of your time and
193 efforts in return.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000194
195 * If you write the code, chances are bigger that it will get into curl
196 faster.
197
Daniel Stenbergc3688002004-10-04 12:54:58 +0000198 1.5 Who makes curl?
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000199
Daniel Stenbergc3688002004-10-04 12:54:58 +0000200 curl and libcurl are not made by any single individual. Sure, Daniel
Daniel Stenbergd16c7572002-08-08 11:54:11 +0000201 Stenberg writes the major parts, but other persons' submissions are
202 important and crucial. Anyone can contribute and post their changes and
203 improvements and have them inserted in the main sources (of course on the
204 condition that developers agree on that the fixes are good).
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000205
Daniel Stenberg81f22462001-11-27 13:33:21 +0000206 The list of contributors in the docs/THANKS file is only a small part of all
207 the people that every day provide us with bug reports, suggestions, ideas
208 and source code.
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000209
210 curl is developed by a community, with Daniel at the wheel.
211
Daniel Stenbergc3688002004-10-04 12:54:58 +0000212 1.6 What do you get for making curl?
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000213
Daniel Stenbergd16c7572002-08-08 11:54:11 +0000214 Project cURL is entirely free and open. No person gets paid for developing
Daniel Stenbergc3688002004-10-04 12:54:58 +0000215 (lib)curl. We do this voluntarily on our spare time.
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000216
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000217 We get some help from companies. Contactor Data hosts the curl web site,
Daniel Stenbergeea22872004-03-16 07:56:51 +0000218 Haxx owns the curl web site's domain and sourceforge.net hosts project
Daniel Stenbergc3688002004-10-04 12:54:58 +0000219 services we take advantage from, like the bug tracker. Also, some companies
220 have sponsored certain parts of the development in the past and I hope some
221 will continue to do so in the future.
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000222
Daniel Stenbergd3706812001-11-27 13:37:29 +0000223 If you want to support our project with a donation or similar, one way of
Daniel Stenberg25fe47f2001-11-14 20:13:38 +0000224 doing that would be to buy "gift certificates" at useful online shopping
225 sites, such as amazon.com or thinkgeek.com. Another way would be to sponsor
Daniel Stenbergd16c7572002-08-08 11:54:11 +0000226 us through a banner-program or even better: by helping us coding,
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000227 documenting, testing etc. You're welcome to send us a buck using paypal, as
228 described here: http://curl.haxx.se/donation.html
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000229
230 1.7 What about CURL from curl.com?
231
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000232 During the summer 2001, curl.com was busy advertising their client-side
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000233 programming language for the web, named CURL.
234
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000235 We are in no way associated with curl.com or their CURL programming
Daniel Stenbergeea22872004-03-16 07:56:51 +0000236 language.
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000237
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000238 Our project name curl has been in effective use since 1998. We were not the
Daniel Stenberg4045cd52001-08-07 21:21:24 +0000239 first computer related project to use the name "curl" and do not claim any
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000240 first-hand rights to the name.
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000241
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000242 We recognize that we will be living in parallel with curl.com and wish them
243 every success.
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000244
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000245 1.8 I have a problem who do I mail?
246
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000247 Please do not mail any single individual unless you really need to. Keep
248 curl-related questions on a suitable mailing list. All available mailing
249 lists are listed in the MANUAL document and online at
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000250 http://curl.haxx.se/mail/
251
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000252 Keeping curl-related questions and discussions on mailing lists allows
253 others to join in and help, to share their ideas, contribute their
254 suggestions and spread their wisdom. Keeping discussions on public mailing
255 lists also allows for others to learn from this (both current and future
256 users thanks to the web based archives of the mailing lists), thus saving us
257 from having to repeat ourselves even more. Thanks for respecting this.
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000258
259
Daniel Stenbergc3318b42000-08-17 14:06:42 +00002602. Install Related Problems
261
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000262 2.1 configure doesn't find OpenSSL even when it is installed
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000263
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000264 This may be because of several reasons.
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000265
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000266 2.1.1 native linker doesn't find openssl
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000267
Daniel Stenbergbfb16902000-08-17 11:42:59 +0000268 Affected platforms:
269 Solaris (native cc compiler)
270 HPUX (native cc compiler)
271 SGI IRIX (native cc compiler)
Daniel Stenberg13962ad2000-09-28 10:26:44 +0000272 SCO UNIX (native cc compiler)
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000273
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000274 When configuring curl, I specify --with-ssl. OpenSSL is installed in
275 /usr/local/ssl Configure reports SSL in /usr/local/ssl, but fails to find
276 CRYPTO_lock in -lcrypto
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000277
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000278 Cause: The cc for this test places the -L/usr/local/ssl/lib AFTER
279 -lcrypto, so ld can't find the library. This is due to a bug in the GNU
280 autoconf tool.
281
282 Workaround: Specifying "LDFLAGS=-L/usr/local/ssl/lib" in front of
283 ./configure places the -L/usr/local/ssl/lib early enough in the command
284 line to make things work
285
Daniel Stenbergbfb16902000-08-17 11:42:59 +0000286 Solution submitted by: Bob Allison <allisonb@users.sourceforge.net>
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000287
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000288 2.1.2 only the libssl lib is missing
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000289
290 If all include files and the libcrypto lib is present, with only the
291 libssl being missing according to configure, this is mostly likely because
292 a few functions are left out from the libssl.
293
294 If the function names missing include RSA or RSAREF you can be certain
Daniel Stenberg4c485992001-04-22 15:45:27 +0000295 that this is because libssl requires the RSA and RSAREF libs to build.
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000296
297 See the INSTALL file section that explains how to add those libs to
298 configure. Make sure that you remove the config.cache file before you
299 rerun configure with the new flags.
300
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000301 2.2 Does curl work/build with other SSL libraries?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000302
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000303 Curl has been written to use OpenSSL, although there should not be much
Daniel Stenberg26d1aac2001-02-16 13:41:09 +0000304 problems using a different library. If anyone does "port" curl to use a
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000305 different SSL library, we are of course very interested in getting the
306 patch!
Daniel Stenberge9640b62000-08-02 07:17:56 +0000307
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000308 2.3 Where can I find a copy of LIBEAY32.DLL?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000309
310 That is an OpenSSL binary built for Windows.
311
312 Curl uses OpenSSL to do the SSL stuff. The LIBEAY32.DLL is what curl needs
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000313 on a windows machine to do https://. Check out the curl web site to find
Daniel Stenberg4c485992001-04-22 15:45:27 +0000314 accurate and up-to-date pointers to recent OpenSSL DLLs and other binary
Daniel Stenberge9640b62000-08-02 07:17:56 +0000315 packages.
316
Daniel Stenbergc3688002004-10-04 12:54:58 +0000317 2.4 Does curl support Socks (RFC 1928) ?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000318
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000319 Yes, SOCKS5 is supported.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000320
321
Daniel Stenbergc3318b42000-08-17 14:06:42 +00003223. Usage problems
Daniel Stenberge9640b62000-08-02 07:17:56 +0000323
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000324 3.1 curl: (1) SSL is disabled, https: not supported
Daniel Stenberge9640b62000-08-02 07:17:56 +0000325
326 If you get this output when trying to get anything from a https:// server,
327 it means that the configure script couldn't find all libs and include files
328 it requires for SSL to work. If the configure script fails to find them,
329 curl is simply built without SSL support.
330
331 To get the https:// support into a curl that was previously built but that
332 reports that https:// is not supported, you should dig through the document
333 and logs and check out why the configure script doesn't find the SSL libs
334 and/or include files.
335
336 Also, check out the other paragraph in this FAQ labeled "configure doesn't
337 find OpenSSL even when it is installed".
338
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000339 3.2 How do I tell curl to resume a transfer?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000340
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000341 Curl supports resumed transfers both ways on both FTP and HTTP.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000342
Daniel Stenberg887e7282001-01-03 09:13:07 +0000343 Try the -C option.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000344
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000345 3.3 Why doesn't my posting using -F work?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000346
347 You can't simply use -F or -d at your choice. The web server that will
348 receive your post assumes one of the formats. If the form you're trying to
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000349 "fake" sets the type to 'multipart/form-data', then and only then you must
Daniel Stenberge9640b62000-08-02 07:17:56 +0000350 use the -F type. In all the most common cases, you should use -d which then
351 causes a posting with the type 'application/x-www-form-urlencoded'.
352
Daniel Stenberg4c485992001-04-22 15:45:27 +0000353 This is described in some detail in the MANUAL and TheArtOfHttpScripting
354 documents, and if you don't understand it the first time, read it again
355 before you post questions about this to the mailing list. Also, try reading
356 through the mailing list archives for old postings and questions regarding
357 this.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000358
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000359 3.4 How do I tell curl to run custom FTP commands?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000360
361 You can tell curl to perform optional commands both before and/or after a
362 file transfer. Study the -Q/--quote option.
363
364 Since curl is used for file transfers, you don't use curl to just perform
Daniel Stenberg4c485992001-04-22 15:45:27 +0000365 FTP commands without transferring anything. Therefore you must always specify
Daniel Stenberge9640b62000-08-02 07:17:56 +0000366 a URL to transfer to/from even when doing custom FTP commands.
367
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000368 3.5 How can I disable the Pragma: nocache header?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000369
370 You can change all internally generated headers by adding a replacement with
371 the -H/--header option. By adding a header with empty contents you safely
372 disable that one. Use -H "Pragma:" to disable that specific header.
373
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000374 3.6 Does curl support ASP, XML, XHTML or HTML version Y?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000375
376 To curl, all contents are alike. It doesn't matter how the page was
Daniel Stenberg4c485992001-04-22 15:45:27 +0000377 generated. It may be ASP, PHP, Perl, shell-script, SSI or plain
Daniel Stenberge9640b62000-08-02 07:17:56 +0000378 HTML-files. There's no difference to curl and it doesn't even know what kind
379 of language that generated the page.
380
Daniel Stenberg20807382002-05-21 14:00:55 +0000381 See also item 3.14 regarding javascript.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000382
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000383 3.7 Can I use curl to delete/rename a file through FTP?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000384
Daniel Stenberg4c485992001-04-22 15:45:27 +0000385 Yes. You specify custom FTP commands with -Q/--quote.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000386
387 One example would be to delete a file after you have downloaded it:
388
389 curl -O ftp://download.com/coolfile -Q '-DELE coolfile'
390
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000391 3.8 How do I tell curl to follow HTTP redirects?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000392
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000393 Curl does not follow so-called redirects by default. The Location: header
394 that informs the client about this is only interpreted if you're using the
395 -L/--location option. As in:
Daniel Stenberge9640b62000-08-02 07:17:56 +0000396
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000397 curl -L http://redirector.com
398
Daniel Stenberg98871d12002-05-22 22:14:03 +0000399 3.9 How do I use curl in my favorite programming language?
Daniel Stenberg368e3522001-01-29 10:16:21 +0000400
Daniel Stenbergdfdf4912001-12-21 09:20:04 +0000401 There exist many language interfaces/bindings for curl that integrates it
402 better with various languages. If you are fluid in a script language, you
403 may very well opt to use such an interface instead of using the command line
404 tool.
Daniel Stenberg4c485992001-04-22 15:45:27 +0000405
Daniel Stenberg4c485992001-04-22 15:45:27 +0000406 Find out more about which languages that support curl directly, and how to
407 install and use them, in the libcurl section of the curl web site:
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000408 http://curl.haxx.se/libcurl/
Daniel Stenberg368e3522001-01-29 10:16:21 +0000409
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000410 In February 2003, there are interfaces available for the following
411 languages: Basic, C, C++, Cocoa, Dylan, Euphoria, Java, Lua, Object-Pascal,
412 Pascal, Perl, PHP, PostgreSQL, Python, Rexx, Ruby, Scheme and Tcl. By the
413 time you read this, additional ones may have appeared!
Daniel Stenberg368e3522001-01-29 10:16:21 +0000414
Daniel Stenberg147a6732001-03-08 09:25:09 +0000415 3.10 What about SOAP, WebDAV, XML-RPC or similar protocols over HTTP?
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000416
417 Curl adheres to the HTTP spec, which basically means you can play with *any*
Daniel Stenberg4c485992001-04-22 15:45:27 +0000418 protocol that is built on top of HTTP. Protocols such as SOAP, WEBDAV and
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000419 XML-RPC are all such ones. You can use -X to set custom requests and -H to
420 set custom headers (or replace internally generated ones).
421
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000422 Using libcurl is of course just as fine and you'd just use the proper
423 library options to do the same.
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000424
Daniel Stenberg88d14e92001-05-29 14:02:20 +0000425 3.11 How do I POST with a different Content-Type?
426
427 You can always replace the internally generated headers with -H/--header.
428 To make a simple HTTP POST with text/xml as content-type, do something like:
429
430 curl -d "datatopost" -H "Content-Type: text/xml" [URL]
431
Daniel Stenberg50e9f8f2001-10-23 10:12:28 +0000432 3.12 Why do FTP specific features over HTTP proxy fail?
Daniel Stenberg7d3daa52001-10-23 10:12:00 +0000433
434 Because when you use a HTTP proxy, the protocol spoken on the network will
435 be HTTP, even if you specify a FTP URL. This effectively means that you
Daniel Stenberg98871d12002-05-22 22:14:03 +0000436 normally can't use FTP specific features such as FTP upload and FTP quote
Daniel Stenberg7d3daa52001-10-23 10:12:00 +0000437 etc.
438
439 There is one exception to this rule, and that is if you can "tunnel through"
Daniel Stenberg271f96f2001-11-20 08:03:01 +0000440 the given HTTP proxy. Proxy tunneling is enabled with a special option (-p)
Daniel Stenberg97a8c982001-12-21 08:10:34 +0000441 and is generally not available as proxy admins usually disable tunneling to
Daniel Stenberg7d3daa52001-10-23 10:12:00 +0000442 other ports than 443 (which is used for HTTPS access through proxies).
443
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000444 3.13 Why does my single/double quotes fail?
445
446 To specify a command line option that includes spaces, you might need to
447 put the entire option within quotes. Like in:
448
449 curl -d " with spaces " url.com
Daniel Stenbergeea22872004-03-16 07:56:51 +0000450
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000451 or perhaps
452
453 curl -d ' with spaces ' url.com
454
455 Exactly what kind of quotes and how to do this is entirely up to the shell
Daniel Stenberg98871d12002-05-22 22:14:03 +0000456 or command line interpreter that you are using. For most unix shells, you
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000457 can more or less pick either single (') or double (") quotes. For
458 Windows/DOS prompts I believe you're forced to use double (") quotes.
459
Daniel Stenberg98871d12002-05-22 22:14:03 +0000460 Please study the documentation for your particular environment. Examples in
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000461 the curl docs will use a mix of both these ones as shown above. You must
462 adjust them to work in your environment.
463
Daniel Stenberg61f62842002-03-11 08:39:00 +0000464 Remember that curl works and runs on more operating systems than most single
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000465 individuals have ever tried.
466
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000467 3.14 Does curl support javascript or pac (automated proxy config)?
468
469 Many web pages do magic stuff using embedded javascript. Curl and libcurl
470 have no built-in support for that, so it will be treated just like any other
471 contents.
472
473 .pac files are a netscape invention and are sometimes used by organizations
474 to allow them to differentiate which proxies to use. The .pac contents is
475 just a javascript program that gets invoked by the browser and that returns
476 the name of the proxy to connect to. Since curl doesn't support javascript,
477 it can't support .pac proxy configuration either.
478
479 Some work-arounds usually suggested to overcome this javascript dependency:
480
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000481 - Depending on the javascript complexity, write up a script that
482 translates it to another language and execute that.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000483
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000484 - Read the javascript code and rewrite the same logic in another language.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000485
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000486 - Implement a javascript interpreter, people have successfully used the
487 Mozilla javascript engine in the past.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000488
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000489 - Ask your admins to stop this, for a static proxy setup or similar.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000490
Daniel Stenbergf3e5d4a2003-12-22 17:24:21 +0000491 3.15 Can I do recursive fetches with curl?
492
493 No. curl itself has no code that performs recursive operations, such as
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000494 those performed by wget and similar tools.
Daniel Stenbergf3e5d4a2003-12-22 17:24:21 +0000495
496 There exist wrapper scripts with that functionality (for example the
497 curlmirror perl script), and you can write programs based on libcurl to do
498 it, but the command line tool curl itself cannot.
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000499
Daniel Stenbergedd16d92004-08-12 11:39:00 +0000500 3.16 What certificates do I need when I use SSL?
Daniel Stenberg43563562004-08-12 11:02:01 +0000501
502 There are three different kinds of "certificates" to keep track of when we
503 talk about using SSL-based protocols (HTTPS or FTPS) using curl or libcurl.
504
505 - Client certificate. The server you communicate may require that you can
506 provide this in order to prove that you actually are who you claim to be.
507 If the server doesn't require this, you don't need a client certificate.
508
509 - Server certificate. The server you communicate with has a server
510 certificate. You can and should verify this certficate to make sure that
511 you are truly talking to the real server and not a server impersonating
512 it. The server certificate verifaction process is made by using a
513 Certificate Authority certificate ("CA cert") that was used to sign the
514 server certificate. Server certificate verification is enabled by default
515 in curl and libcurl and is often the reason for problems as explained in
516 FAQ entry 4.12 and the SSLCERTS document
517 (http://curl.haxx.se/docs/sslcerts.html). Server certificates that are
518 "self-signed" or otherwise signed by a CA that you do not have a CA cert
519 for, cannot be verified. If the verification during a connect fails, you
520 are refused access. You then need to explicitly disable the verification
521 to connect to the server.
522
523 - Certificate Authority certificate ("CA cert"). You often have several CA
524 certs in a CA cert bundle that can be used to verify a server certificate
525 that was signed by one of the authorities in the bundle. curl comes with a
526 default CA cert bundle. You can override the default.
527
Daniel Stenberg951fdeb2004-12-21 09:37:55 +0000528 3.17 How do I list the root dir of an FTP server?
529
530 There are two ways. The way defined in the RFC is to use an encoded slash
531 in the first path part. List the "/tmp" dir like this:
532
533 curl ftp://ftp.sunet.se/%2ftmp/
534
535 or the not-quite-kosher-but-more-readable way, by simply starting the path
536 section of the URL with a slash:
537
538 curl ftp://ftp.sunet.se//tmp/
539
Daniel Stenberge9eb5232005-04-05 14:36:37 +0000540 3.18 Can I use curl to send a POST/PUT and not wait for a response?
541
542 No.
543
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000544
Daniel Stenbergc3318b42000-08-17 14:06:42 +00005454. Running Problems
546
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000547 4.1 Problems connecting to SSL servers.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000548
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000549 It took a very long time before we could sort out why curl had problems to
550 connect to certain SSL servers when using SSLeay or OpenSSL v0.9+. The
551 error sometimes showed up similar to:
Daniel Stenberge9640b62000-08-02 07:17:56 +0000552
553 16570:error:1407D071:SSL routines:SSL2_READ:bad mac decode:s2_pkt.c:233:
554
555 It turned out to be because many older SSL servers don't deal with SSLv3
556 requests properly. To correct this problem, tell curl to select SSLv2 from
557 the command line (-2/--sslv2).
558
Daniel Stenbergeea22872004-03-16 07:56:51 +0000559 There have also been examples where the remote server didn't like the SSLv2
Daniel Stenberge9640b62000-08-02 07:17:56 +0000560 request and instead you had to force curl to use SSLv3 with -3/--sslv3.
561
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000562 4.2 Why do I get problems when I use & or % in the URL?
Daniel Stenberg29470102000-06-02 13:32:01 +0000563
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000564 In general unix shells, the & letter is treated special and when used, it
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000565 runs the specified command in the background. To safely send the & as a part
Daniel Stenberg4c485992001-04-22 15:45:27 +0000566 of a URL, you should quote the entire URL by using single (') or double (")
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000567 quotes around it.
Daniel Stenberg29470102000-06-02 13:32:01 +0000568
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000569 An example that would invoke a remote CGI that uses &-letters could be:
Daniel Stenberg8f037322000-06-06 14:09:01 +0000570
Daniel Stenbergedcd5df2000-06-06 14:13:36 +0000571 curl 'http://www.altavista.com/cgi-bin/query?text=yes&q=curl'
Daniel Stenberg8f037322000-06-06 14:09:01 +0000572
Daniel Stenbergdaf55702002-08-29 07:05:31 +0000573 In Windows, the standard DOS shell treats the %-letter specially and you
574 need to use TWO %-letters for each single one you want to use in the URL.
Daniel Stenberge26ee092001-01-15 10:26:37 +0000575
Daniel Stenberg1b77c182001-01-29 10:24:51 +0000576 Also note that if you want the literal %-letter to be part of the data you
Daniel Stenbergdaf55702002-08-29 07:05:31 +0000577 pass in a POST using -d/--data you must encode it as '%25' (which then also
578 needs the %-letter doubled on Windows machines).
Daniel Stenberg1b77c182001-01-29 10:24:51 +0000579
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000580 4.3 How can I use {, }, [ or ] to specify multiple URLs?
Daniel Stenberg29470102000-06-02 13:32:01 +0000581
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000582 Because those letters have a special meaning to the shell, and to be used in
583 a URL specified to curl you must quote them.
Daniel Stenberg29470102000-06-02 13:32:01 +0000584
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000585 An example that downloads two URLs (sequentially) would do:
Daniel Stenberg8f037322000-06-06 14:09:01 +0000586
Daniel Stenbergedcd5df2000-06-06 14:13:36 +0000587 curl '{curl,www}.haxx.se'
Daniel Stenberg8f037322000-06-06 14:09:01 +0000588
Daniel Stenberge26ee092001-01-15 10:26:37 +0000589 To be able to use those letters as actual parts of the URL (without using
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000590 them for the curl URL "globbing" system), use the -g/--globoff option:
Daniel Stenberge26ee092001-01-15 10:26:37 +0000591
592 curl -g 'www.site.com/weirdname[].html'
593
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000594 4.4 Why do I get downloaded data even though the web page doesn't exist?
Daniel Stenberg29470102000-06-02 13:32:01 +0000595
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000596 Curl asks remote servers for the page you specify. If the page doesn't exist
597 at the server, the HTTP protocol defines how the server should respond and
598 that means that headers and a "page" will be returned. That's simply how
599 HTTP works.
Daniel Stenberg29470102000-06-02 13:32:01 +0000600
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000601 By using the --fail option you can tell curl explicitly to not get any data
602 if the HTTP return code doesn't say success.
Daniel Stenberg8f037322000-06-06 14:09:01 +0000603
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000604 4.5 Why do I get return code XXX from a HTTP server?
Daniel Stenberg29470102000-06-02 13:32:01 +0000605
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000606 RFC2616 clearly explains the return codes. This is a short transcript. Go
607 read the RFC for exact details:
Daniel Stenberg29470102000-06-02 13:32:01 +0000608
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000609 4.5.1 "400 Bad Request"
Daniel Stenberg29470102000-06-02 13:32:01 +0000610
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000611 The request could not be understood by the server due to malformed
612 syntax. The client SHOULD NOT repeat the request without modifications.
613
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000614 4.5.2 "401 Unauthorized"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000615
616 The request requires user authentication.
617
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000618 4.5.3 "403 Forbidden"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000619
620 The server understood the request, but is refusing to fulfill it.
621 Authorization will not help and the request SHOULD NOT be repeated.
622
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000623 4.5.4 "404 Not Found"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000624
625 The server has not found anything matching the Request-URI. No indication
626 is given of whether the condition is temporary or permanent.
627
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000628 4.5.5 "405 Method Not Allowed"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000629
630 The method specified in the Request-Line is not allowed for the resource
631 identified by the Request-URI. The response MUST include an Allow header
632 containing a list of valid methods for the requested resource.
633
Daniel Stenbergd60029d2001-12-19 23:25:04 +0000634 4.5.6 "301 Moved Permanently"
Daniel Stenbergeea22872004-03-16 07:56:51 +0000635
Daniel Stenberg98871d12002-05-22 22:14:03 +0000636 If you get this return code and an HTML output similar to this:
Daniel Stenbergd60029d2001-12-19 23:25:04 +0000637
638 <H1>Moved Permanently</H1> The document has moved <A
639 HREF="http://same_url_now_with_a_trailing_slash/">here</A>.
640
641 it might be because you request a directory URL but without the trailing
642 slash. Try the same operation again _with_ the trailing URL, or use the
643 -L/--location option to follow the redirection.
644
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000645 4.6 Can you tell me what error code 142 means?
Daniel Stenberg29470102000-06-02 13:32:01 +0000646
Daniel Stenberg8b5f0ab2004-12-21 21:35:00 +0000647 All curl error codes are described at the end of the man page, in the
648 section called "EXIT CODES".
649
650 Error codes that are larger than the highest documented error code means
Daniel Stenberg13bf9642001-08-23 11:11:13 +0000651 that curl has exited due to a crash. This is a serious error, and we
Daniel Stenberg25fe47f2001-11-14 20:13:38 +0000652 appreciate a detailed bug report from you that describes how we could go
Daniel Stenberg13bf9642001-08-23 11:11:13 +0000653 ahead and repeat this!
Daniel Stenberg29470102000-06-02 13:32:01 +0000654
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000655 4.7 How do I keep user names and passwords secret in Curl command lines?
Daniel Stenberg29470102000-06-02 13:32:01 +0000656
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000657 This problem has two sides:
Daniel Stenberg29470102000-06-02 13:32:01 +0000658
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000659 The first part is to avoid having clear-text passwords in the command line
660 so that they don't appear in 'ps' outputs and similar. That is easily
Daniel Stenbergeea22872004-03-16 07:56:51 +0000661 avoided by using the "-K" option to tell curl to read parameters from a file
662 or stdin to which you can pass the secret info. curl itself will also
663 attempt to "hide" the given password by blanking out the option - this
664 doesn't work on all platforms.
Daniel Stenberg29470102000-06-02 13:32:01 +0000665
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000666 To keep the passwords in your account secret from the rest of the world is
667 not a task that curl addresses. You could of course encrypt them somehow to
668 at least hide them from being read by human eyes, but that is not what
669 anyone would call security.
Daniel Stenberg29470102000-06-02 13:32:01 +0000670
Daniel Stenbergeea22872004-03-16 07:56:51 +0000671 Also note that regular HTTP (using Basic authentication) and FTP passwords
672 are sent in clear across the network. All it takes for anyone to fetch them
673 is to listen on the network. Eavesdropping is very easy. Use more secure
674 authentication methods (like Digest, Negotiate or even NTLM) or consider the
675 SSL-based alternatives HTTPS and FTPS.
Daniel Stenberg887e7282001-01-03 09:13:07 +0000676
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000677 4.8 I found a bug!
678
Daniel Stenberg4c485992001-04-22 15:45:27 +0000679 It is not a bug if the behavior is documented. Read the docs first.
Daniel Stenbergeea22872004-03-16 07:56:51 +0000680 Especially check out the KNOWN_BUGS file, it may be a documented bug!
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000681
682 If it is a problem with a binary you've downloaded or a package for your
683 particular platform, try contacting the person who built the package/archive
684 you have.
685
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000686 If there is a bug, read the BUGS document first. Then report it as described
687 in there.
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000688
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000689 4.9 Curl can't authenticate to the server that requires NTLM?
Daniel Stenberg2c100372000-12-19 07:30:51 +0000690
Daniel Stenberg3a552b12003-06-26 11:35:48 +0000691 This is supported in curl 7.10.6 or later. No earlier curl version knows
692 of this magic.
693
694 NTLM is a Microsoft proprietary protocol. Proprietary formats are evil. You
695 should not use such ones.
Daniel Stenberg29470102000-06-02 13:32:01 +0000696
Daniel Stenbergbc743752002-05-15 21:40:29 +0000697 4.10 My HTTP request using HEAD, PUT or DELETE doesn't work!
698
699 Many web servers allow or demand that the administrator configures the
700 server properly for these requests to work on the web server.
701
702 Some servers seem to support HEAD only on certain kinds of URLs.
703
704 To fully grasp this, try the documentation for the particular server
705 software you're trying to interact with. This is not anything curl can do
706 anything about.
707
Daniel Stenberg522b85a2002-11-12 20:00:02 +0000708 4.11 Why does my HTTP range requests return the full document?
709
710 Because the range may not be supported by the server, or the server may
711 choose to ignore it and return the full document anyway.
Daniel Stenbergbc743752002-05-15 21:40:29 +0000712
Daniel Stenberg16077112002-11-20 19:17:43 +0000713 4.12 Why do I get "certificate verify failed" ?
714
715 You invoke curl 7.10 or later to communicate on a https:// URL and get an
716 error back looking something similar to this:
717
Daniel Stenbergeea22872004-03-16 07:56:51 +0000718 curl: (35) SSL: error:14090086:SSL routines:
Daniel Stenberg16077112002-11-20 19:17:43 +0000719 SSL3_GET_SERVER_CERTIFICATE:certificate verify failed
720
721 Then it means that curl couldn't verify that the server's certificate was
722 good. Curl verifies the certificate using the CA cert bundle that comes with
723 the curl installation.
724
725 To disable the verification (which makes it act like curl did before 7.10),
726 use -k. This does however enable man-in-the-middle attacks.
727
728 If you get this failure but are having a CA cert bundle installed and used,
729 the server's certificate is not signed by one of the CA's in the bundle. It
730 might for example be self-signed. You then correct this problem by obtaining
731 a valid CA cert for the server. Or again, decrease the security by disabling
732 this check.
733
734 Details are also in the SSLCERTS file in the release archives, found online
Daniel Stenberg9b6d0102003-02-25 08:36:29 +0000735 here: http://curl.haxx.se/docs/sslcerts.html
Daniel Stenberg16077112002-11-20 19:17:43 +0000736
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000737
Daniel Stenbergc3318b42000-08-17 14:06:42 +00007385. libcurl Issues
Daniel Stenberg29470102000-06-02 13:32:01 +0000739
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000740 5.1 Is libcurl thread-safe?
Daniel Stenberg29470102000-06-02 13:32:01 +0000741
Daniel Stenberg7d09e512001-01-11 12:52:07 +0000742 Yes.
743
744 We have written the libcurl code specificly adjusted for multi-threaded
745 programs. libcurl will use thread-safe functions instead of non-safe ones if
746 your system has such.
Daniel Stenberg29470102000-06-02 13:32:01 +0000747
Daniel Stenberga19b23b2005-04-13 08:47:59 +0000748 If you use a OpenSSL-powered libcurl in a multi-threaded environment, you
749 need to provide one or two locking functions:
750
751 http://www.openssl.org/docs/crypto/threads.html#DESCRIPTION
752
753 If you use a GnuTLS-powered libcurl in a multi-threaded environment, you
754 need to provide locking function(s) for libgcrypt (which is used by GnuTLS
755 for the crypto functions).
756
757 [informative link missing]
Daniel Stenberg29470102000-06-02 13:32:01 +0000758
Daniel Stenberga40b55d2000-11-22 07:27:26 +0000759 5.2 How can I receive all data into a large memory chunk?
760
Daniel Stenberga84af982001-05-15 13:09:27 +0000761 [ See also the examples/getinmemory.c source ]
762
Daniel Stenberga40b55d2000-11-22 07:27:26 +0000763 You are in full control of the callback function that gets called every time
764 there is data received from the remote server. You can make that callback do
Daniel Stenberg4c485992001-04-22 15:45:27 +0000765 whatever you want. You do not have to write the received data to a file.
Daniel Stenberga40b55d2000-11-22 07:27:26 +0000766
767 One solution to this problem could be to have a pointer to a struct that you
768 pass to the callback function. You set the pointer using the
769 curl_easy_setopt(CURLOPT_FILE) function. Then that pointer will be passed to
770 the callback instead of a FILE * to a file:
771
772 /* imaginary struct */
773 struct MemoryStruct {
774 char *memory;
775 size_t size;
776 };
777
778 /* imaginary callback function */
779 size_t
780 WriteMemoryCallback(void *ptr, size_t size, size_t nmemb, void *data)
781 {
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000782 size_t realsize = size * nmemb;
Daniel Stenberga40b55d2000-11-22 07:27:26 +0000783 struct MemoryStruct *mem = (struct MemoryStruct *)data;
Daniel Stenbergeea22872004-03-16 07:56:51 +0000784
Daniel Stenberga40b55d2000-11-22 07:27:26 +0000785 mem->memory = (char *)realloc(mem->memory, mem->size + realsize + 1);
786 if (mem->memory) {
787 memcpy(&(mem->memory[mem->size]), ptr, realsize);
788 mem->size += realsize;
789 mem->memory[mem->size] = 0;
790 }
791 return realsize;
792 }
793
Daniel Stenberg2c100372000-12-19 07:30:51 +0000794 5.3 How do I fetch multiple files with libcurl?
Daniel Stenbergec5ac822000-12-14 08:37:09 +0000795
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000796 libcurl has excellent support for transferring multiple files. You should
797 just repeatedly set new URLs with curl_easy_setopt() and then transfer it
798 with curl_easy_perform(). The handle you get from curl_easy_init() is not
799 only reusable, but you're even encouraged to reuse it if you can, as that
800 will enable libcurl to use persistent connections.
Daniel Stenberga40b55d2000-11-22 07:27:26 +0000801
Daniel Stenbergbc5954f2001-03-23 08:16:24 +0000802 5.4 Does libcurl do Winsock initialization on win32 systems?
Daniel Stenberg910fc852000-12-30 11:48:51 +0000803
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000804 Yes, if told to in the curl_global_init() call.
Daniel Stenberg910fc852000-12-30 11:48:51 +0000805
Daniel Stenberg7e3cd822003-12-08 13:59:35 +0000806 5.5 Does CURLOPT_WRITEDATA and CURLOPT_READDATA work on win32 ?
Daniel Stenberg41084e52001-01-22 08:42:00 +0000807
808 Yes, but you cannot open a FILE * and pass the pointer to a DLL and have
Daniel Stenberg7e3cd822003-12-08 13:59:35 +0000809 that DLL use the FILE * (as the DLL and the client application cannot access
810 each others' variable memory areas). If you set CURLOPT_WRITEDATA you must
811 also use CURLOPT_WRITEFUNCTION as well to set a function that writes the
812 file, even if that simply writes the data to the specified FILE *.
813 Similarly, if you use CURLOPT_READDATA you must also specify
814 CURLOPT_READFUNCTION.
Daniel Stenberg41084e52001-01-22 08:42:00 +0000815
Daniel Stenberg5d7b32d2001-02-04 20:08:42 +0000816 (Provided by Joel DeYoung and Bob Schader)
Daniel Stenberg41084e52001-01-22 08:42:00 +0000817
Daniel Stenberg4c485992001-04-22 15:45:27 +0000818 5.6 What about Keep-Alive or persistent connections?
Daniel Stenberg6dc5c6f2001-01-27 20:51:31 +0000819
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000820 curl and libcurl have excellent support for persistent connections when
821 transferring several files from the same server. Curl will attempt to reuse
822 connections for all URLs specified on the same command line/config file, and
823 libcurl will reuse connections for all transfers that are made using the
824 same libcurl handle.
Daniel Stenberg6dc5c6f2001-01-27 20:51:31 +0000825
Daniel Stenbergdd82d692002-10-08 07:16:17 +0000826 5.7 Link errors when building libcurl on Windows!
827
828 You need to make sure that your project, and all the libraries (both static
829 and dynamic) that it links against, are compiled/linked against the same run
830 time library.
831
832 This is determined by the /MD, /ML, /MT (and their corresponding /M?d)
833 options to the command line compiler. /MD (linking against MSVCRT dll) seems
834 to be the most commonly used option.
835
836 (Provided by Andrew Francis)
837
Gisle Vanem51a87fa2004-11-24 15:14:42 +0000838 When building an application that uses the static libcurl library, you must
839 add -DCURL_STATICLIB to your CFLAGS. Otherwise the linker will look for
840 dynamic import symbols. If you get linker error like "unknown symbol
Daniel Stenberg9cdaae92005-01-04 16:01:34 +0000841 __imp__curl_easy_init ..." you have linked against the wrong (static)
Gisle Vanem2dcb8b62005-01-04 16:16:03 +0000842 library. If you want to use the libcurl.dll and import lib, you don't need
843 any extra CFLAGS, but use one of the import libraries below. These are the
Daniel Stenberg9cdaae92005-01-04 16:01:34 +0000844 libraries produced by the various lib/Makefile.* files:
Gisle Vanem51a87fa2004-11-24 15:14:42 +0000845
Gisle Vanem2dcb8b62005-01-04 16:16:03 +0000846 Target: static lib. import lib for libcurl*.dll.
847 -----------------------------------------------------------
Gisle Vanem51a87fa2004-11-24 15:14:42 +0000848 MingW: libcurl.a libcurldll.a
849 MSVC (release): libcurl.lib libcurl_imp.lib
850 MSVC (debug): libcurld.lib libcurld_imp.lib
851 Borland: libcurl.lib libcurl_imp.lib
852
853
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000854 5.8 libcurl.so.3: open failed: No such file or directory
855
856 This is an error message you might get when you try to run a program linked
857 with a shared version of libcurl and your run-time linker (ld.so) couldn't
858 find the shared library named libcurl.so.3.
859
860 You need to make sure that ld.so finds libcurl.so.3. You can do that
861 multiple ways, and it differs somewhat between different operating systems,
862 but they are usually:
863
864 * Add an option to the linker command line that specify the hard-coded path
865 the run-time linker should check for the lib (usually -R)
866
867 * Set an environment variable (LD_LIBRARY_PATH for example) where ld.so
868 should check for libs
869
870 * Adjust the system's config to check for libs in the directory where you've
871 put the dir (like Linux's /etc/ld.so.conf)
872
873 'man ld.so' and 'man ld' will tell you more details
874
Daniel Stenberg1d323362004-08-12 14:09:10 +0000875 5.9 How does libcurl resolve host names?
876
877 libcurl includes a number of different name resolve functions:
878
879 - The non-ipv6 resolver that can use one out of four host name resolve calls
880 (depending on what your system supports):
881
882 A - gethostbyname()
883 B - gethostbyname_r() with 3 arguments
884 C - gethostbyname_r() with 5 arguments
885 D - gethostbyname_r() with 6 arguments
886
887 - The ipv6-resolver that uses getaddrinfo()
888
889 - The c-ares based name resolver that uses the c-ares library for resolves.
890
891 - The Windows threaded resolver. It use:
892
893 A - gethostbyname() on plain ipv4 windows hosts
894 B - getaddrinfo() on ipv6-enabled windows hosts
Daniel Stenbergdd82d692002-10-08 07:16:17 +0000895
Daniel Stenberge9eb5232005-04-05 14:36:37 +0000896 Also note that libcurl never resolves or reverse-lookups addresses given as
897 pure numbers, such as 127.0.0.1 or ::1.
898
899 5.10 How do I prevent libcurl from writing the response to stdout?
900
901 libcurl provides a default built-in write function that writes received data
902 to stdout. Set a WRITEFUNCTION to receive the data, or possibly set
903 WRITEDATA to a different FILE * handle.
904
Daniel Stenberg6e8e0412005-04-05 14:38:38 +0000905 5.11 How do I make libcurl not receive the whole HTTP response?
906
907 You make the write callback (or progress callback) return an error and
908 libcurl will then abort the transfer.
909
Daniel Stenbergb5d50e92005-04-11 13:39:55 +0000910 5.12 Can I make libcurl fake or hide my real IP address?
911
912 No. libcurl operates on a higher level than so. Besides, faking IP address
913 would imply sending IP packages with a made-up source address, and then you
914 normally get a problem with intercepting the packages sent back as they
915 would then not be routed to you!
916
917 If you use a proxy to access remote sites, the sites will not see your local
918 IP address but instead the address of the proxy.
919
920 Also note that on many networks NATs or other IP-munging techniques are used
921 that makes you see and use a different IP address locally than what the
922 remote server will see you coming from.
923
Daniel Stenberge9eb5232005-04-05 14:36:37 +0000924
Daniel Stenbergc3318b42000-08-17 14:06:42 +00009256. License Issues
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000926
Daniel Stenberg1c961282002-09-03 11:58:18 +0000927 Curl and libcurl are released under a MIT/X derivate license. The license is
928 very liberal and should not impose a problem for your project. This section
929 is just a brief summary for the cases we get the most questions. (Parts of
930 this section was much enhanced by Bjorn Reese.)
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000931
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000932 6.1 I have a GPL program, can I use the libcurl library?
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000933
Daniel Stenberg0d181b52001-01-04 12:43:53 +0000934 Yes!
Daniel Stenberg7d1ef962000-08-14 06:31:59 +0000935
Daniel Stenberg0d181b52001-01-04 12:43:53 +0000936 Since libcurl may be distributed under the MIT/X derivate license, it can be
937 used together with GPL in any software.
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000938
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000939 6.2 I have a closed-source program, can I use the libcurl library?
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000940
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000941 Yes!
Daniel Stenberg0d181b52001-01-04 12:43:53 +0000942
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000943 libcurl does not put any restrictions on the program that uses the library.
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000944
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000945 6.3 I have a BSD licensed program, can I use the libcurl library?
Daniel Stenberg31b8eea2000-08-23 07:27:00 +0000946
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000947 Yes!
Daniel Stenberg0d181b52001-01-04 12:43:53 +0000948
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000949 libcurl does not put any restrictions on the program that uses the library.
Daniel Stenberg31b8eea2000-08-23 07:27:00 +0000950
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000951 6.4 I have a program that uses LGPL libraries, can I use libcurl?
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000952
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000953 Yes!
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000954
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000955 The LGPL license doesn't clash with other licenses.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000956
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000957 6.5 Can I modify curl/libcurl for my program and keep the changes secret?
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000958
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000959 Yes!
Daniel Stenberg0d181b52001-01-04 12:43:53 +0000960
961 The MIT/X derivate license practically allows you to do almost anything with
962 the sources, on the condition that the copyright texts in the sources are
963 left intact.
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000964
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000965 6.6 Can you please change the curl/libcurl license to XXXX?
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000966
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000967 No.
968
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000969 We have carefully picked this license after years of development and
970 discussions and a large amount of people have contributed with source code
971 knowing that this is the license we use. This license puts the restrictions
972 we want on curl/libcurl and it does not spread to other programs or
Daniel Stenberg3a552b12003-06-26 11:35:48 +0000973 libraries that use it. It should be possible for everyone to use libcurl or
974 curl in their projects, no matter what license they already have in use.
Daniel Stenberg9ac76292004-08-18 11:18:36 +0000975
9767. PHP/CURL Issues
977
978 7.1 What is PHP/CURL?
979
980 The module for PHP that makes it possible for PHP programs to access curl-
981 functions from within PHP. We often call it PHP/CURL to differentiate from
982 curl the command line tool and libcurl the library.
983
984 7.2 Who write PHP/CURL?
985
986 PHP/CURL is a module that comes with the regular PHP package. It depends and
987 uses libcurl, so you need to have libcurl installed properly first before
988 PHP/CURL can be used. PHP/CURL is written by Sterling Hughes.
989
990 7.3 Can I perform multiple requests using the same handle?
991
Daniel Stenbergee400f92004-08-19 06:31:29 +0000992 Yes - at least in PHP version 4.3.8 and later (this has been known to not
993 work in earlier versions, but the exact version when it started to work is
994 unknown to me).
Daniel Stenberg9ac76292004-08-18 11:18:36 +0000995
Daniel Stenbergee400f92004-08-19 06:31:29 +0000996 After a transfer, you just set new options in the handle and make another
997 transfer. This will make libcurl to re-use the same connection if it can.