blob: d0d3270d9e47d4e9e1eba1d7805fba133de79e9f [file] [log] [blame]
Daniel Stenberg0d0f8082011-03-08 11:15:59 +01001Updated: March 8, 2011 (http://curl.haxx.se/docs/faq.html)
Daniel Stenbergeea22872004-03-16 07:56:51 +00002 _ _ ____ _
3 ___| | | | _ \| |
4 / __| | | | |_) | |
5 | (__| |_| | _ <| |___
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +00006 \___|\___/|_| \_\_____|
7
8FAQ
9
Daniel Stenbergc3318b42000-08-17 14:06:42 +000010 1. Philosophy
11 1.1 What is cURL?
12 1.2 What is libcurl?
Daniel Stenbergc3688002004-10-04 12:54:58 +000013 1.3 What is curl not?
Daniel Stenbergc3318b42000-08-17 14:06:42 +000014 1.4 When will you make curl do XXXX ?
Daniel Stenbergc3688002004-10-04 12:54:58 +000015 1.5 Who makes curl?
16 1.6 What do you get for making curl?
Daniel Stenbergc528dc52001-08-07 11:17:37 +000017 1.7 What about CURL from curl.com?
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +000018 1.8 I have a problem who do I mail?
Daniel Stenberg9a44fa82005-11-02 09:34:53 +000019 1.9 Where do I buy commercial support for curl?
20 1.10 How many are using curl?
Daniel Stenberg15bf1682008-02-07 15:43:36 +000021 1.11 Why don't you update ca-bundle.crt
Daniel Stenberg8740d142009-06-09 09:02:39 +000022 1.12 I have a problem who can I chat with?
Daniel Stenberg59842d42010-08-18 16:54:11 +020023 1.13 curl's ECCN number?
Daniel Stenberga5f96b42010-10-06 20:03:13 +020024 1.14 How do I submit my patch?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000025
Daniel Stenbergc3318b42000-08-17 14:06:42 +000026 2. Install Related Problems
27 2.1 configure doesn't find OpenSSL even when it is installed
Daniel Stenberg811edcd2004-08-10 08:41:41 +000028 2.1.1 native linker doesn't find OpenSSL
29 2.1.2 only the libssl lib is missing
Daniel Stenbergc3318b42000-08-17 14:06:42 +000030 2.2 Does curl work/build with other SSL libraries?
31 2.3 Where can I find a copy of LIBEAY32.DLL?
Dan Fandrich5c9fff92009-01-30 18:28:29 +000032 2.4 Does curl support SOCKS (RFC 1928) ?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000033
Daniel Stenbergc3318b42000-08-17 14:06:42 +000034 3. Usage Problems
35 3.1 curl: (1) SSL is disabled, https: not supported
36 3.2 How do I tell curl to resume a transfer?
37 3.3 Why doesn't my posting using -F work?
38 3.4 How do I tell curl to run custom FTP commands?
39 3.5 How can I disable the Pragma: nocache header?
Daniel Stenberg48bc73c2002-05-21 13:53:32 +000040 3.6 Does curl support ASP, XML, XHTML or HTML version Y?
Daniel Stenbergc3318b42000-08-17 14:06:42 +000041 3.7 Can I use curl to delete/rename a file through FTP?
42 3.8 How do I tell curl to follow HTTP redirects?
Daniel Stenberg98871d12002-05-22 22:14:03 +000043 3.9 How do I use curl in my favorite programming language?
Daniel Stenberg147a6732001-03-08 09:25:09 +000044 3.10 What about SOAP, WebDAV, XML-RPC or similar protocols over HTTP?
Daniel Stenberg88d14e92001-05-29 14:02:20 +000045 3.11 How do I POST with a different Content-Type?
Daniel Stenberg6513dce2001-11-27 13:34:59 +000046 3.12 Why do FTP specific features over HTTP proxy fail?
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +000047 3.13 Why does my single/double quotes fail?
Dan Fandrich5c9fff92009-01-30 18:28:29 +000048 3.14 Does curl support Javascript or PAC (automated proxy config)?
Daniel Stenbergf3e5d4a2003-12-22 17:24:21 +000049 3.15 Can I do recursive fetches with curl?
Daniel Stenbergedd16d92004-08-12 11:39:00 +000050 3.16 What certificates do I need when I use SSL?
Daniel Stenberg951fdeb2004-12-21 09:37:55 +000051 3.17 How do I list the root dir of an FTP server?
Daniel Stenberge9eb5232005-04-05 14:36:37 +000052 3.18 Can I use curl to send a POST/PUT and not wait for a response?
Daniel Stenberg64f12a32010-09-07 19:05:07 +020053 3.19 How do I get HTTP from a host using a specific IP address?
Daniel Stenberg3f7b7de2011-03-07 22:27:26 +010054 3.20 How to SFTP from my user's home directory?
Daniel Stenberg0d0f8082011-03-08 11:15:59 +010055 3.21 Protocol xxx not supported or disabled in libcurl
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000056
Daniel Stenbergc3318b42000-08-17 14:06:42 +000057 4. Running Problems
58 4.1 Problems connecting to SSL servers.
Daniel Stenberge26ee092001-01-15 10:26:37 +000059 4.2 Why do I get problems when I use & or % in the URL?
Daniel Stenbergc3318b42000-08-17 14:06:42 +000060 4.3 How can I use {, }, [ or ] to specify multiple URLs?
61 4.4 Why do I get downloaded data even though the web page doesn't exist?
62 4.5 Why do I get return code XXX from a HTTP server?
63 4.5.1 "400 Bad Request"
64 4.5.2 "401 Unauthorized"
65 4.5.3 "403 Forbidden"
66 4.5.4 "404 Not Found"
67 4.5.5 "405 Method Not Allowed"
Daniel Stenbergd60029d2001-12-19 23:25:04 +000068 4.5.6 "301 Moved Permanently"
Daniel Stenbergc3318b42000-08-17 14:06:42 +000069 4.6 Can you tell me what error code 142 means?
Daniel Stenberg4c485992001-04-22 15:45:27 +000070 4.7 How do I keep user names and passwords secret in Curl command lines?
Daniel Stenberg09ba8562000-10-27 12:25:00 +000071 4.8 I found a bug!
Daniel Stenberg2c100372000-12-19 07:30:51 +000072 4.9 Curl can't authenticate to the server that requires NTLM?
Daniel Stenbergbc743752002-05-15 21:40:29 +000073 4.10 My HTTP request using HEAD, PUT or DELETE doesn't work!
Daniel Stenberg522b85a2002-11-12 20:00:02 +000074 4.11 Why does my HTTP range requests return the full document?
Daniel Stenberg16077112002-11-20 19:17:43 +000075 4.12 Why do I get "certificate verify failed" ?
Daniel Stenberg1dc0ce92005-06-13 18:33:40 +000076 4.13 Why is curl -R on Windows one hour off?
Daniel Stenberg09cb9c72005-08-26 13:22:39 +000077 4.14 Redirects work in browser but not with curl!
Daniel Stenberg844cbc72007-07-29 22:17:39 +000078 4.15 FTPS doesn't work
Daniel Stenberg95df5d02008-09-24 07:50:46 +000079 4.16 My HTTP POST or PUT requests are slow!
Daniel Stenberg2afb88e2009-02-23 21:21:00 +000080 4.17 Non-functional connect timeouts on Windows
Daniel Stenbergb8012ea2009-11-07 21:52:41 +000081 4.18 file:// URLs containing drive letters (Windows, NetWare)
Dan Fandrich7d166b02010-07-21 15:15:07 -070082 4.19 Why doesn't cURL return an error when the network cable is unplugged?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +000083
Daniel Stenbergc3318b42000-08-17 14:06:42 +000084 5. libcurl Issues
Daniel Stenberg7d09e512001-01-11 12:52:07 +000085 5.1 Is libcurl thread-safe?
Daniel Stenberga40b55d2000-11-22 07:27:26 +000086 5.2 How can I receive all data into a large memory chunk?
Daniel Stenberg2c100372000-12-19 07:30:51 +000087 5.3 How do I fetch multiple files with libcurl?
Daniel Stenberg910fc852000-12-30 11:48:51 +000088 5.4 Does libcurl do Winsock initing on win32 systems?
Daniel Stenberg7e3cd822003-12-08 13:59:35 +000089 5.5 Does CURLOPT_WRITEDATA and CURLOPT_READDATA work on win32 ?
Daniel Stenberg4c485992001-04-22 15:45:27 +000090 5.6 What about Keep-Alive or persistent connections?
Daniel Stenbergdd82d692002-10-08 07:16:17 +000091 5.7 Link errors when building libcurl on Windows!
Daniel Stenberg9754b202010-08-11 09:15:43 +020092 5.8 libcurl.so.X: open failed: No such file or directory
Daniel Stenberg1d323362004-08-12 14:09:10 +000093 5.9 How does libcurl resolve host names?
Daniel Stenberge9eb5232005-04-05 14:36:37 +000094 5.10 How do I prevent libcurl from writing the response to stdout?
Daniel Stenberg6e8e0412005-04-05 14:38:38 +000095 5.11 How do I make libcurl not receive the whole HTTP response?
Daniel Stenbergb5d50e92005-04-11 13:39:55 +000096 5.12 Can I make libcurl fake or hide my real IP address?
Daniel Stenberg24602ed2007-12-10 10:28:56 +000097 5.13 How do I stop an ongoing transfer?
Daniel Stenberg22059852008-09-24 07:39:42 +000098 5.14 Using C++ non-static functions for callbacks?
Yang Tsea07bc792010-02-14 19:40:18 +000099 5.15 How do I get an FTP directory listing?
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000100
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000101 6. License Issues
102 6.1 I have a GPL program, can I use the libcurl library?
103 6.2 I have a closed-source program, can I use the libcurl library?
Daniel Stenberg31b8eea2000-08-23 07:27:00 +0000104 6.3 I have a BSD licensed program, can I use the libcurl library?
105 6.4 I have a program that uses LGPL libraries, can I use libcurl?
106 6.5 Can I modify curl/libcurl for my program and keep the changes secret?
107 6.6 Can you please change the curl/libcurl license to XXXX?
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000108 6.7 What are my obligations when using libcurl in my commercial apps?
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000109
Daniel Stenberg9ac76292004-08-18 11:18:36 +0000110 7. PHP/CURL Issues
111 7.1 What is PHP/CURL?
Daniel Stenberge38a7882011-03-17 11:30:29 +0100112 7.2 Who wrote PHP/CURL?
Daniel Stenberg9ac76292004-08-18 11:18:36 +0000113 7.3 Can I perform multiple requests using the same handle?
114
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000115==============================================================================
116
1171. Philosophy
118
119 1.1 What is cURL?
120
Daniel Stenbergc3688002004-10-04 12:54:58 +0000121 cURL is the name of the project. The name is a play on 'Client for URLs',
122 originally with URL spelled in uppercase to make it obvious it deals with
123 URLs. The fact it can also be pronounced 'see URL' also helped, it works as
Dan Fandrichec2ad572005-04-13 19:31:00 +0000124 an abbreviation for "Client URL Request Library" or why not the recursive
Daniel Stenbergeea22872004-03-16 07:56:51 +0000125 version: "Curl URL Request Library".
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000126
Daniel Stenbergc3688002004-10-04 12:54:58 +0000127 The cURL project produces two products:
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000128
Daniel Stenbergc3688002004-10-04 12:54:58 +0000129 libcurl
130
Daniel Stenberg8d121b62010-08-27 23:15:45 +0200131 A free and easy-to-use client-side URL transfer library, supporting DICT,
132 FILE, FTP, FTPS, GOPHER, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, POP3,
133 POP3S, RTMP, RTSP, SCP, SFTP, SMTP, SMTPS, TELNET and TFTP.
Daniel Stenbergac20f522010-08-18 19:43:06 +0200134
Daniel Stenberg7ac16812009-01-14 22:52:18 +0000135 libcurl supports HTTPS certificates, HTTP POST, HTTP PUT, FTP uploading,
136 kerberos, HTTP form based upload, proxies, cookies, user+password
137 authentication, file transfer resume, http proxy tunneling and more!
Daniel Stenbergc3688002004-10-04 12:54:58 +0000138
139 libcurl is highly portable, it builds and works identically on numerous
140 platforms, including Solaris, NetBSD, FreeBSD, OpenBSD, Darwin, HPUX,
141 IRIX, AIX, Tru64, Linux, UnixWare, HURD, Windows, Amiga, OS/2, BeOs, Mac
Dan Fandrichea1f30e2009-11-03 19:07:19 +0000142 OS X, Ultrix, QNX, OpenVMS, RISC OS, Novell NetWare, DOS, Symbian, OSF,
143 Android, Minix, IBM TPF and more...
Daniel Stenbergc3688002004-10-04 12:54:58 +0000144
145 libcurl is free, thread-safe, IPv6 compatible, feature rich, well
146 supported and fast.
Gisle Vanem51a87fa2004-11-24 15:14:42 +0000147
Daniel Stenbergc3688002004-10-04 12:54:58 +0000148 curl
149
150 A command line tool for getting or sending files using URL syntax.
151
Daniel Stenbergac20f522010-08-18 19:43:06 +0200152 Since curl uses libcurl, curl supports the same wide range of common
153 Internet protocols that libcurl does.
Daniel Stenbergc3688002004-10-04 12:54:58 +0000154
155 We pronounce curl and cURL with an initial k sound: [kurl].
Daniel Stenberg887e7282001-01-03 09:13:07 +0000156
Daniel Stenbergf83be112005-05-18 10:12:08 +0000157 There are numerous sub-projects and related projects that also use the word
158 curl in the project names in various combinations, but you should take
Daniel Stenberg073ef0b2003-05-09 07:07:13 +0000159 notice that this FAQ is directed at the command-line tool named curl (and
Daniel Stenbergeea22872004-03-16 07:56:51 +0000160 libcurl the library), and may therefore not be valid for other curl-related
Daniel Stenbergf83be112005-05-18 10:12:08 +0000161 projects. (There is however a small section for the PHP/CURL in this FAQ.)
Daniel Stenberg073ef0b2003-05-09 07:07:13 +0000162
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000163 1.2 What is libcurl?
164
Daniel Stenbergbc5954f2001-03-23 08:16:24 +0000165 libcurl is a reliable and portable library which provides you with an easy
Daniel Stenberg4c485992001-04-22 15:45:27 +0000166 interface to a range of common Internet protocols.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000167
Daniel Stenbergeea22872004-03-16 07:56:51 +0000168 You can use libcurl for free in your application, be it open source,
169 commercial or closed-source.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000170
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000171 libcurl is most probably the most portable, most powerful and most often
172 used C-based multi-platform file transfer library on this planet - be it
173 open source or commercial.
174
Daniel Stenbergc3688002004-10-04 12:54:58 +0000175 1.3 What is curl not?
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000176
Daniel Stenberg890b34d2007-02-11 09:55:17 +0000177 Curl is not a wget clone. That is a common misconception. Never, during
Daniel Stenbergeea22872004-03-16 07:56:51 +0000178 curl's development, have we intended curl to replace wget or compete on its
179 market. Curl is targeted at single-shot file transfers.
180
181 Curl is not a web site mirroring program. If you want to use curl to mirror
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000182 something: fine, go ahead and write a script that wraps around curl to make
183 it reality (like curlmirror.pl does).
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000184
Daniel Stenberg4c485992001-04-22 15:45:27 +0000185 Curl is not an FTP site mirroring program. Sure, get and send FTP with curl
186 but if you want systematic and sequential behavior you should write a
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000187 script (or write a new program that interfaces libcurl) and do it.
188
189 Curl is not a PHP tool, even though it works perfectly well when used from
Daniel Stenbergc3688002004-10-04 12:54:58 +0000190 or with PHP (when using the PHP/CURL module).
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000191
Daniel Stenberg890b34d2007-02-11 09:55:17 +0000192 Curl is not a program for a single operating system. Curl exists, compiles,
193 builds and runs under a wide range of operating systems, including all
194 modern Unixes (and a bunch of older ones too), Windows, Amiga, BeOS, OS/2,
195 OS X, QNX etc.
Daniel Stenberg31b8eea2000-08-23 07:27:00 +0000196
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000197 1.4 When will you make curl do XXXX ?
198
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000199 We love suggestions of what to change in order to make curl and libcurl
200 better. We do however believe in a few rules when it comes to the future of
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000201 curl:
202
Daniel Stenberg073ef0b2003-05-09 07:07:13 +0000203 * Curl -- the command line tool -- is to remain a non-graphical command line
204 tool. If you want GUIs or fancy scripting capabilities, you should look
205 for another tool that uses libcurl.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000206
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000207 * We do not add things to curl that other small and available tools already
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000208 do very fine at the side. Curl's output is fine to pipe into another
209 program or redirect to another file for the next program to interpret.
210
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000211 * We focus on protocol related issues and improvements. If you wanna do more
Daniel Stenberg5f8e93d2000-10-25 07:41:58 +0000212 magic with the supported protocols than curl currently does, chances are
Daniel Stenberg7d24ce92001-11-01 09:12:35 +0000213 big we will agree. If you wanna add more protocols, we may very well
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000214 agree.
215
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000216 * If you want someone else to make all the work while you wait for us to
217 implement it for you, that is not a very friendly attitude. We spend a
218 considerable time already on maintaining and developing curl. In order to
219 get more out of us, you should consider trading in some of your time and
220 efforts in return.
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000221
222 * If you write the code, chances are bigger that it will get into curl
223 faster.
224
Daniel Stenbergc3688002004-10-04 12:54:58 +0000225 1.5 Who makes curl?
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000226
Daniel Stenbergf83be112005-05-18 10:12:08 +0000227 curl and libcurl are not made by any single individual. Daniel Stenberg is
228 project leader and main developer, but other persons' submissions are
Daniel Stenbergd16c7572002-08-08 11:54:11 +0000229 important and crucial. Anyone can contribute and post their changes and
230 improvements and have them inserted in the main sources (of course on the
231 condition that developers agree on that the fixes are good).
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000232
Daniel Stenbergdb2d52a2007-12-10 11:33:46 +0000233 The full list of all contributors is found in the docs/THANKS file.
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000234
235 curl is developed by a community, with Daniel at the wheel.
236
Daniel Stenbergc3688002004-10-04 12:54:58 +0000237 1.6 What do you get for making curl?
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000238
Daniel Stenbergd16c7572002-08-08 11:54:11 +0000239 Project cURL is entirely free and open. No person gets paid for developing
Daniel Stenberg72acffc2009-10-22 07:56:10 +0000240 (lib)curl on full or even part time. We do this voluntarily on our spare
241 time. Occasionally companies pay individual developers to work on curl, but
242 that's up to each company and developer. It is not controlled by nor
243 supervised in any way by the project.
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000244
Daniel Stenberg72acffc2009-10-22 07:56:10 +0000245 We still get help from companies. Haxx provides web site, bandwidth, mailing
Daniel Stenberg16096852010-03-22 00:34:09 +0100246 lists etc and sourceforge.net hosts project services we take advantage from,
247 like the bug tracker. Also again, some companies have sponsored certain
248 parts of the development in the past and I hope some will continue to do so
249 in the future.
Daniel Stenberga0eb52b2001-03-23 15:28:13 +0000250
Daniel Stenbergf83be112005-05-18 10:12:08 +0000251 If you want to support our project, consider a donation or a banner-program
252 or even better: by helping us coding, documenting, testing etc.
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000253
254 1.7 What about CURL from curl.com?
255
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000256 During the summer 2001, curl.com was busy advertising their client-side
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000257 programming language for the web, named CURL.
258
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000259 We are in no way associated with curl.com or their CURL programming
Daniel Stenbergeea22872004-03-16 07:56:51 +0000260 language.
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000261
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000262 Our project name curl has been in effective use since 1998. We were not the
Daniel Stenberg4045cd52001-08-07 21:21:24 +0000263 first computer related project to use the name "curl" and do not claim any
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000264 first-hand rights to the name.
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000265
Daniel Stenberg81b6ebc2001-08-07 18:02:37 +0000266 We recognize that we will be living in parallel with curl.com and wish them
267 every success.
Daniel Stenbergc528dc52001-08-07 11:17:37 +0000268
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000269 1.8 I have a problem who do I mail?
270
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000271 Please do not mail any single individual unless you really need to. Keep
272 curl-related questions on a suitable mailing list. All available mailing
273 lists are listed in the MANUAL document and online at
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000274 http://curl.haxx.se/mail/
275
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000276 Keeping curl-related questions and discussions on mailing lists allows
277 others to join in and help, to share their ideas, contribute their
278 suggestions and spread their wisdom. Keeping discussions on public mailing
279 lists also allows for others to learn from this (both current and future
280 users thanks to the web based archives of the mailing lists), thus saving us
281 from having to repeat ourselves even more. Thanks for respecting this.
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000282
Daniel Stenberg0b8f57b2005-08-07 14:36:55 +0000283 If you have found or simply suspect a security problem in curl or libcurl,
284 mail curl-security at haxx.se (closed list of receivers, mails are not
285 disclosed) and tell. Then we can produce a fix in a timely manner before the
286 flaw is announced to the world, thus lessen the impact the problem will have
287 on existing users.
288
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000289 1.9 Where do I buy commercial support for curl?
290
291 curl is fully open source. It means you can hire any skilled engineer to fix
292 your curl-related problems.
293
294 We list available alternatives on the curl web site:
295 http://curl.haxx.se/support.html
296
297 1.10 How many are using curl?
298
299 It is impossible to tell.
300
301 We don't know how many users that knowingly have installed and use curl.
302
303 We don't know how many users that use curl without knowing that they are in
304 fact using it.
305
306 We don't know how many users that downloaded or installed curl and then
307 never use it.
308
309 Some facts to use as input to the math:
310
Daniel Stenberg844cbc72007-07-29 22:17:39 +0000311 curl packages are downloaded from the curl.haxx.se and mirrors over a
Daniel Stenberg890b34d2007-02-11 09:55:17 +0000312 million times per year. curl is installed by default with most Linux
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000313 distributions. curl is installed by default with Mac OS X. curl and libcurl
314 as used by numerous applications that include libcurl binaries in their
315 distribution packages (like Adobe Acrobat Reader and Google Earth).
316
Daniel Stenberg64f12a32010-09-07 19:05:07 +0200317 More than a hundred known named companies use curl in commercial
318 environments and products and more than a hundred known named open source
319 projects depend on (lib)curl.
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000320
321 In a poll on the curl web site mid-2005, more than 50% of the 300+ answers
322 estimated a user base of one million users or more.
323
324 In March 2005, the "Linux Counter project" estimated a total Linux user base
325 of some 29 millions, while Netcraft detected some 4 million "active" Linux
326 based web servers. A guess is that a fair amount of these Linux
327 installations have curl installed.
328
Dan Fandricha7f67472010-09-09 12:38:15 -0700329 The Debian project maintains statistics on packages installed by people
330 who have voluntarily run their package counting application. In mid-2010,
331 libcurl3 was installed on over 55000 such systems (62% of reporting systems)
332 and was one of the 320 most popular installed packages (out of about 107000
333 possible packages).
334
Daniel Stenberg890b34d2007-02-11 09:55:17 +0000335 All this taken together, there is no doubt that there are millions of
336 (lib)curl users.
337
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000338 http://curl.haxx.se/docs/companies.html
339 http://curl.haxx.se/docs/programs.html
340 http://curl.haxx.se/libcurl/using/apps.html
341 http://counter.li.org/estimates.php
342 http://news.netcraft.com/archives/2005/03/14/fedora_makes_rapid_progress.html
Dan Fandricha7f67472010-09-09 12:38:15 -0700343 http://qa.debian.org/popcon.php?package=curl
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000344
Daniel Stenberg15bf1682008-02-07 15:43:36 +0000345 1.11 Why don't you update ca-bundle.crt
346
Daniel Stenberg074bd2a2008-02-18 11:39:11 +0000347 The ca-bundle.crt file that used to be bundled with curl was very outdated
348 (it being last modified year 2000 should tell) and must be replaced with a
349 much more modern and up-to-date version by anyone who wants to verify peers
350 anyway. It is no longer provided, the last curl release that shipped it was
351 curl 7.18.0.
Daniel Stenberg15bf1682008-02-07 15:43:36 +0000352
353 In the cURL project we've decided not to attempt to keep this file updated
Daniel Stenberg074bd2a2008-02-18 11:39:11 +0000354 (or even present anymore) since deciding what to add to a ca cert bundle is
355 an undertaking we've not been ready to accept, and the one we can get from
356 Mozilla is perfectly fine so there's no need to duplicate that work.
Daniel Stenberg15bf1682008-02-07 15:43:36 +0000357
358 Today, with many services performed over HTTPS, every operating system
359 should come with a default ca cert bundle that can be deemed somewhat
360 trustworthy and that collection (if reasonably updated) should be deemed to
Daniel Stenberg074bd2a2008-02-18 11:39:11 +0000361 be a lot better than a private curl version.
Daniel Stenberg15bf1682008-02-07 15:43:36 +0000362
Daniel Stenberg074bd2a2008-02-18 11:39:11 +0000363 If you want the most recent collection of ca certs that Mozilla Firefox
364 uses, we recommend that you extract the collection yourself from Mozilla
365 Firefox (by running 'make ca-bundle), or by using our online service setup
366 for this purpose: http://curl.haxx.se/docs/caextract.html
Daniel Stenberg15bf1682008-02-07 15:43:36 +0000367
Daniel Stenberg8740d142009-06-09 09:02:39 +0000368 1.12 I have a problem who can I chat with?
369
370 There's a bunch of friendly people hanging out in the #curl channel on the
371 IRC network irc.freenode.net. If you're polite and nice, chances are big
372 that you can get -- or provide -- help instantly.
373
Daniel Stenberg59842d42010-08-18 16:54:11 +0200374 1.13 curl's ECCN number?
375
376 The US government restricts exports of software that contains or uses
377 cryptography. When doing so, the Export Control Classification Number (ECCN)
378 is used to identify the level of export control etc.
379
380 ASF gives a good explanation at http://www.apache.org/dev/crypto.html
381
382 We believe curl's number might be ECCN 5D002, another possibility is
383 5D992. It seems necessary to write them, asking to confirm.
384
385 Comprehensible explanations of the meaning of such numbers and how to
386 obtain them (resp.) are here
387
388 http://www.bis.doc.gov/licensing/exportingbasics.htm
389 http://www.bis.doc.gov/licensing/do_i_needaneccn.html
390
391 An incomprehensible description of the two numbers above is here
392 http://www.access.gpo.gov/bis/ear/pdf/ccl5-pt2.pdf
393
Daniel Stenberga5f96b42010-10-06 20:03:13 +0200394 1.14 How do I submit my patch?
395
396 When you have made a patch or a change of whatever sort, and want to submit
397 that to the project, there are a few different ways we prefer:
398
399 o send a patch to the curl-library mailing list. We're many subscribers
400 there and there are lots of people who can review patches, comment on them
401 and "receive" them properly.
402
403 o if your patch changes or fixes a bug, you can also opt to submit a bug
404 report in the bug tracker and attach your patch there. There are less
405 people involved there.
406
407 Lots of more details are found in the CONTRIBUTE and INTERNALS docs.
408
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000409
Daniel Stenbergc3318b42000-08-17 14:06:42 +00004102. Install Related Problems
411
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000412 2.1 configure doesn't find OpenSSL even when it is installed
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000413
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000414 This may be because of several reasons.
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000415
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000416 2.1.1 native linker doesn't find openssl
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000417
Daniel Stenbergbfb16902000-08-17 11:42:59 +0000418 Affected platforms:
419 Solaris (native cc compiler)
420 HPUX (native cc compiler)
421 SGI IRIX (native cc compiler)
Daniel Stenberg13962ad2000-09-28 10:26:44 +0000422 SCO UNIX (native cc compiler)
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000423
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000424 When configuring curl, I specify --with-ssl. OpenSSL is installed in
425 /usr/local/ssl Configure reports SSL in /usr/local/ssl, but fails to find
426 CRYPTO_lock in -lcrypto
Daniel Stenberg7c37c6a2000-05-22 17:35:35 +0000427
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000428 Cause: The cc for this test places the -L/usr/local/ssl/lib AFTER
429 -lcrypto, so ld can't find the library. This is due to a bug in the GNU
430 autoconf tool.
431
432 Workaround: Specifying "LDFLAGS=-L/usr/local/ssl/lib" in front of
433 ./configure places the -L/usr/local/ssl/lib early enough in the command
434 line to make things work
435
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000436 2.1.2 only the libssl lib is missing
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000437
438 If all include files and the libcrypto lib is present, with only the
439 libssl being missing according to configure, this is mostly likely because
440 a few functions are left out from the libssl.
441
442 If the function names missing include RSA or RSAREF you can be certain
Daniel Stenberg4c485992001-04-22 15:45:27 +0000443 that this is because libssl requires the RSA and RSAREF libs to build.
Daniel Stenbergef34ad22000-06-02 12:45:23 +0000444
445 See the INSTALL file section that explains how to add those libs to
446 configure. Make sure that you remove the config.cache file before you
447 rerun configure with the new flags.
448
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000449 2.2 Does curl work/build with other SSL libraries?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000450
Daniel Stenberga0a70dc2010-12-15 16:08:45 +0100451 Curl has been written to use OpenSSL, GnuTLS, yassl, NSS, PolarSSL, axTLS or
452 qssl, although there should not be many problems using a different
453 library. If anyone does "port" curl to use a different SSL library, we are
454 of course very interested in getting the patch!
Daniel Stenberge9640b62000-08-02 07:17:56 +0000455
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000456 2.3 Where can I find a copy of LIBEAY32.DLL?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000457
458 That is an OpenSSL binary built for Windows.
459
460 Curl uses OpenSSL to do the SSL stuff. The LIBEAY32.DLL is what curl needs
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000461 on a windows machine to do https://. Check out the curl web site to find
Daniel Stenberg4c485992001-04-22 15:45:27 +0000462 accurate and up-to-date pointers to recent OpenSSL DLLs and other binary
Daniel Stenberge9640b62000-08-02 07:17:56 +0000463 packages.
464
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000465 2.4 Does curl support SOCKS (RFC 1928) ?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000466
Daniel Stenberg844cbc72007-07-29 22:17:39 +0000467 Yes, SOCKS 4 and 5 are supported.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000468
469
Daniel Stenbergc3318b42000-08-17 14:06:42 +00004703. Usage problems
Daniel Stenberge9640b62000-08-02 07:17:56 +0000471
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000472 3.1 curl: (1) SSL is disabled, https: not supported
Daniel Stenberge9640b62000-08-02 07:17:56 +0000473
474 If you get this output when trying to get anything from a https:// server,
Daniel Stenberg0d0f8082011-03-08 11:15:59 +0100475 it means that the instance of curl/libcurl that you're using was built
476 without support for this protocol.
477
478 This could've happened if the configure script that was run at build time
479 couldn't find all libs and include files curl requires for SSL to work. If
480 the configure script fails to find them, curl is simply built without SSL
481 support.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000482
483 To get the https:// support into a curl that was previously built but that
484 reports that https:// is not supported, you should dig through the document
485 and logs and check out why the configure script doesn't find the SSL libs
486 and/or include files.
487
Dan Fandrichea1f30e2009-11-03 19:07:19 +0000488 Also, check out the other paragraph in this FAQ labelled "configure doesn't
Daniel Stenberge9640b62000-08-02 07:17:56 +0000489 find OpenSSL even when it is installed".
490
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000491 3.2 How do I tell curl to resume a transfer?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000492
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000493 Curl supports resumed transfers both ways on both FTP and HTTP.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000494
Daniel Stenberg887e7282001-01-03 09:13:07 +0000495 Try the -C option.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000496
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000497 3.3 Why doesn't my posting using -F work?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000498
499 You can't simply use -F or -d at your choice. The web server that will
500 receive your post assumes one of the formats. If the form you're trying to
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000501 "fake" sets the type to 'multipart/form-data', then and only then you must
Daniel Stenberge9640b62000-08-02 07:17:56 +0000502 use the -F type. In all the most common cases, you should use -d which then
503 causes a posting with the type 'application/x-www-form-urlencoded'.
504
Daniel Stenberg4c485992001-04-22 15:45:27 +0000505 This is described in some detail in the MANUAL and TheArtOfHttpScripting
506 documents, and if you don't understand it the first time, read it again
507 before you post questions about this to the mailing list. Also, try reading
508 through the mailing list archives for old postings and questions regarding
509 this.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000510
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000511 3.4 How do I tell curl to run custom FTP commands?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000512
513 You can tell curl to perform optional commands both before and/or after a
514 file transfer. Study the -Q/--quote option.
515
516 Since curl is used for file transfers, you don't use curl to just perform
Daniel Stenberg4c485992001-04-22 15:45:27 +0000517 FTP commands without transferring anything. Therefore you must always specify
Daniel Stenberge9640b62000-08-02 07:17:56 +0000518 a URL to transfer to/from even when doing custom FTP commands.
519
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000520 3.5 How can I disable the Pragma: nocache header?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000521
522 You can change all internally generated headers by adding a replacement with
523 the -H/--header option. By adding a header with empty contents you safely
524 disable that one. Use -H "Pragma:" to disable that specific header.
525
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000526 3.6 Does curl support ASP, XML, XHTML or HTML version Y?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000527
528 To curl, all contents are alike. It doesn't matter how the page was
Daniel Stenberg4c485992001-04-22 15:45:27 +0000529 generated. It may be ASP, PHP, Perl, shell-script, SSI or plain
Daniel Stenberge9640b62000-08-02 07:17:56 +0000530 HTML-files. There's no difference to curl and it doesn't even know what kind
531 of language that generated the page.
532
Daniel Stenberg20807382002-05-21 14:00:55 +0000533 See also item 3.14 regarding javascript.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000534
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000535 3.7 Can I use curl to delete/rename a file through FTP?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000536
Daniel Stenberg4c485992001-04-22 15:45:27 +0000537 Yes. You specify custom FTP commands with -Q/--quote.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000538
539 One example would be to delete a file after you have downloaded it:
540
541 curl -O ftp://download.com/coolfile -Q '-DELE coolfile'
542
Daniel Stenberg33b9daa2007-06-26 21:53:46 +0000543 or rename a file after upload:
544
545 curl -T infile ftp://upload.com/dir/ -Q "-RNFR infile" -Q "-RNTO newname"
546
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000547 3.8 How do I tell curl to follow HTTP redirects?
Daniel Stenberge9640b62000-08-02 07:17:56 +0000548
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000549 Curl does not follow so-called redirects by default. The Location: header
550 that informs the client about this is only interpreted if you're using the
551 -L/--location option. As in:
Daniel Stenberge9640b62000-08-02 07:17:56 +0000552
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000553 curl -L http://redirector.com
554
Daniel Stenberg09cb9c72005-08-26 13:22:39 +0000555 Not all redirects are HTTP ones, see 4.14
556
Daniel Stenberg98871d12002-05-22 22:14:03 +0000557 3.9 How do I use curl in my favorite programming language?
Daniel Stenberg368e3522001-01-29 10:16:21 +0000558
Daniel Stenbergdfdf4912001-12-21 09:20:04 +0000559 There exist many language interfaces/bindings for curl that integrates it
560 better with various languages. If you are fluid in a script language, you
561 may very well opt to use such an interface instead of using the command line
562 tool.
Daniel Stenberg4c485992001-04-22 15:45:27 +0000563
Daniel Stenberg4c485992001-04-22 15:45:27 +0000564 Find out more about which languages that support curl directly, and how to
565 install and use them, in the libcurl section of the curl web site:
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000566 http://curl.haxx.se/libcurl/
Daniel Stenberg368e3522001-01-29 10:16:21 +0000567
Dan Fandrichea1f30e2009-11-03 19:07:19 +0000568 In October 2009, there were interfaces available for the following
569 languages: Ada95, Basic, C, C++, Ch, Cocoa, D, Dylan, Eiffel, Euphoria,
570 Ferite, Gambas, glib/GTK+, Haskell, ILE/RPG, Java, Lisp, Lua, Mono, .NET,
571 Object-Pascal, O'Caml, Pascal, Perl, PHP, PostgreSQL, Python, R, Rexx, Ruby,
572 Scheme, S-Lang, Smalltalk, SP-Forth, SPL, Tcl, Visual Basic, Visual FoxPro,
573 Q, wxwidgets and XBLite. By the time you read this, additional ones may have
574 appeared!
Daniel Stenberg368e3522001-01-29 10:16:21 +0000575
Daniel Stenberg147a6732001-03-08 09:25:09 +0000576 3.10 What about SOAP, WebDAV, XML-RPC or similar protocols over HTTP?
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000577
578 Curl adheres to the HTTP spec, which basically means you can play with *any*
Daniel Stenberg4c485992001-04-22 15:45:27 +0000579 protocol that is built on top of HTTP. Protocols such as SOAP, WEBDAV and
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000580 XML-RPC are all such ones. You can use -X to set custom requests and -H to
581 set custom headers (or replace internally generated ones).
582
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000583 Using libcurl is of course just as fine and you'd just use the proper
584 library options to do the same.
Daniel Stenbergc59baa02001-02-12 10:05:09 +0000585
Daniel Stenberg88d14e92001-05-29 14:02:20 +0000586 3.11 How do I POST with a different Content-Type?
587
588 You can always replace the internally generated headers with -H/--header.
589 To make a simple HTTP POST with text/xml as content-type, do something like:
590
591 curl -d "datatopost" -H "Content-Type: text/xml" [URL]
592
Daniel Stenberg50e9f8f2001-10-23 10:12:28 +0000593 3.12 Why do FTP specific features over HTTP proxy fail?
Daniel Stenberg7d3daa52001-10-23 10:12:00 +0000594
595 Because when you use a HTTP proxy, the protocol spoken on the network will
596 be HTTP, even if you specify a FTP URL. This effectively means that you
Daniel Stenberg98871d12002-05-22 22:14:03 +0000597 normally can't use FTP specific features such as FTP upload and FTP quote
Daniel Stenberg7d3daa52001-10-23 10:12:00 +0000598 etc.
599
600 There is one exception to this rule, and that is if you can "tunnel through"
Daniel Stenberg271f96f2001-11-20 08:03:01 +0000601 the given HTTP proxy. Proxy tunneling is enabled with a special option (-p)
Daniel Stenberg97a8c982001-12-21 08:10:34 +0000602 and is generally not available as proxy admins usually disable tunneling to
Daniel Stenberg7d3daa52001-10-23 10:12:00 +0000603 other ports than 443 (which is used for HTTPS access through proxies).
604
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000605 3.13 Why does my single/double quotes fail?
606
607 To specify a command line option that includes spaces, you might need to
608 put the entire option within quotes. Like in:
609
610 curl -d " with spaces " url.com
Daniel Stenbergeea22872004-03-16 07:56:51 +0000611
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000612 or perhaps
613
614 curl -d ' with spaces ' url.com
615
616 Exactly what kind of quotes and how to do this is entirely up to the shell
Daniel Stenberg98871d12002-05-22 22:14:03 +0000617 or command line interpreter that you are using. For most unix shells, you
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000618 can more or less pick either single (') or double (") quotes. For
619 Windows/DOS prompts I believe you're forced to use double (") quotes.
620
Daniel Stenberg98871d12002-05-22 22:14:03 +0000621 Please study the documentation for your particular environment. Examples in
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000622 the curl docs will use a mix of both these ones as shown above. You must
623 adjust them to work in your environment.
624
Daniel Stenberg61f62842002-03-11 08:39:00 +0000625 Remember that curl works and runs on more operating systems than most single
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000626 individuals have ever tried.
627
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000628 3.14 Does curl support Javascript or PAC (automated proxy config)?
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000629
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000630 Many web pages do magic stuff using embedded Javascript. Curl and libcurl
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000631 have no built-in support for that, so it will be treated just like any other
632 contents.
633
634 .pac files are a netscape invention and are sometimes used by organizations
635 to allow them to differentiate which proxies to use. The .pac contents is
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000636 just a Javascript program that gets invoked by the browser and that returns
637 the name of the proxy to connect to. Since curl doesn't support Javascript,
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000638 it can't support .pac proxy configuration either.
639
Dan Fandrichea1f30e2009-11-03 19:07:19 +0000640 Some workarounds usually suggested to overcome this Javascript dependency:
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000641
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000642 - Depending on the Javascript complexity, write up a script that
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000643 translates it to another language and execute that.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000644
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000645 - Read the Javascript code and rewrite the same logic in another language.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000646
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000647 - Implement a Javascript interpreter, people have successfully used the
648 Mozilla Javascript engine in the past.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000649
Daniel Stenberg17de7e02004-08-10 12:41:44 +0000650 - Ask your admins to stop this, for a static proxy setup or similar.
Daniel Stenberg48bc73c2002-05-21 13:53:32 +0000651
Daniel Stenbergf3e5d4a2003-12-22 17:24:21 +0000652 3.15 Can I do recursive fetches with curl?
653
654 No. curl itself has no code that performs recursive operations, such as
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000655 those performed by wget and similar tools.
Daniel Stenbergf3e5d4a2003-12-22 17:24:21 +0000656
657 There exist wrapper scripts with that functionality (for example the
658 curlmirror perl script), and you can write programs based on libcurl to do
659 it, but the command line tool curl itself cannot.
Daniel Stenberg6b1a1a62002-03-11 08:29:26 +0000660
Daniel Stenbergedd16d92004-08-12 11:39:00 +0000661 3.16 What certificates do I need when I use SSL?
Daniel Stenberg43563562004-08-12 11:02:01 +0000662
663 There are three different kinds of "certificates" to keep track of when we
664 talk about using SSL-based protocols (HTTPS or FTPS) using curl or libcurl.
665
666 - Client certificate. The server you communicate may require that you can
667 provide this in order to prove that you actually are who you claim to be.
668 If the server doesn't require this, you don't need a client certificate.
669
Daniel Stenberg64f12a32010-09-07 19:05:07 +0200670 A client certificate is always used together with a private key, and the
671 private key has a pass phrase that protects it.
672
Daniel Stenberg43563562004-08-12 11:02:01 +0000673 - Server certificate. The server you communicate with has a server
Dan Fandrichec2ad572005-04-13 19:31:00 +0000674 certificate. You can and should verify this certificate to make sure that
Daniel Stenberg43563562004-08-12 11:02:01 +0000675 you are truly talking to the real server and not a server impersonating
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000676 it.
Daniel Stenberg43563562004-08-12 11:02:01 +0000677
678 - Certificate Authority certificate ("CA cert"). You often have several CA
679 certs in a CA cert bundle that can be used to verify a server certificate
Daniel Stenberg64f12a32010-09-07 19:05:07 +0200680 that was signed by one of the authorities in the bundle. curl does not
681 come with a CA cert bundle but most curl installs provide one. You can
682 also override the default.
Daniel Stenberg43563562004-08-12 11:02:01 +0000683
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000684 The server certificate verification process is made by using a Certificate
685 Authority certificate ("CA cert") that was used to sign the server
686 certificate. Server certificate verification is enabled by default in curl
687 and libcurl and is often the reason for problems as explained in FAQ entry
688 4.12 and the SSLCERTS document
689 (http://curl.haxx.se/docs/sslcerts.html). Server certificates that are
690 "self-signed" or otherwise signed by a CA that you do not have a CA cert
691 for, cannot be verified. If the verification during a connect fails, you
692 are refused access. You then need to explicitly disable the verification
693 to connect to the server.
694
Daniel Stenberg951fdeb2004-12-21 09:37:55 +0000695 3.17 How do I list the root dir of an FTP server?
696
697 There are two ways. The way defined in the RFC is to use an encoded slash
698 in the first path part. List the "/tmp" dir like this:
699
700 curl ftp://ftp.sunet.se/%2ftmp/
701
702 or the not-quite-kosher-but-more-readable way, by simply starting the path
703 section of the URL with a slash:
704
705 curl ftp://ftp.sunet.se//tmp/
706
Daniel Stenberge9eb5232005-04-05 14:36:37 +0000707 3.18 Can I use curl to send a POST/PUT and not wait for a response?
Yang Tsea07bc792010-02-14 19:40:18 +0000708
Daniel Stenberge9eb5232005-04-05 14:36:37 +0000709 No.
710
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000711 But you could easily write your own program using libcurl to do such stunts.
712
Daniel Stenberg64f12a32010-09-07 19:05:07 +0200713 3.19 How do I get HTTP from a host using a specific IP address?
714
715 For example, you may be trying out a web site installation that isn't yet in
716 the DNS. Or you have a site using multiple IP addresses for a given host
717 name and you want to address a specific one out of the set.
718
719 Set a custom Host: header that identifies the server name you want to reach
720 but use the target IP address in the URL:
721
722 curl --header "Host: www.example.com" http://127.0.0.1/
723
Daniel Stenberg3f7b7de2011-03-07 22:27:26 +0100724 3.20 How to SFTP from my user's home directory?
725
726 Contrary to how FTP works, SFTP and SCP URLs specify the exact directory to
727 work with. It means that if you don't specify that you want the user's home
728 directory, you get the actual root directory.
729
730 To specify a file in your user's home directory, you need to use the correct
731 URL syntax which for sftp might look similar to:
732
733 curl -O -u user:password sftp://example.com/~/file.txt
734
735 and for SCP it is just a different protocol prefix:
736
737 curl -O -u user:password scp://example.com/~/file.txt
738
Daniel Stenberg0d0f8082011-03-08 11:15:59 +0100739 3.21 Protocol xxx not supported or disabled in libcurl
740
741 When passing on a URL to curl to use, it may respond that the particular
742 protocol is not supported or disabled. The particular way this error message
743 is phrased is because curl doesn't make a distinction internally of whether
744 a particular protocol is not supported (ie never got any code added that
745 knows how to speak that protocol) or if it was explicitly disabled. curl can
746 be built to only support a given set of protocols, and the rest would then
747 be disabled or not supported.
748
749 Note that this error will also occur if you pass a wrongly spelled protocol
750 part as in "htpt://example.com" or as in the less evident case if you prefix
751 the protocol part with a space as in " http://example.com/".
752
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000753
Daniel Stenbergc3318b42000-08-17 14:06:42 +00007544. Running Problems
755
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000756 4.1 Problems connecting to SSL servers.
Daniel Stenberge9640b62000-08-02 07:17:56 +0000757
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000758 It took a very long time before we could sort out why curl had problems to
759 connect to certain SSL servers when using SSLeay or OpenSSL v0.9+. The
760 error sometimes showed up similar to:
Daniel Stenberge9640b62000-08-02 07:17:56 +0000761
762 16570:error:1407D071:SSL routines:SSL2_READ:bad mac decode:s2_pkt.c:233:
763
764 It turned out to be because many older SSL servers don't deal with SSLv3
765 requests properly. To correct this problem, tell curl to select SSLv2 from
766 the command line (-2/--sslv2).
767
Daniel Stenbergeea22872004-03-16 07:56:51 +0000768 There have also been examples where the remote server didn't like the SSLv2
Daniel Stenberge9640b62000-08-02 07:17:56 +0000769 request and instead you had to force curl to use SSLv3 with -3/--sslv3.
770
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000771 4.2 Why do I get problems when I use & or % in the URL?
Daniel Stenberg29470102000-06-02 13:32:01 +0000772
Daniel Stenberg07d46882009-02-13 09:12:52 +0000773 In general unix shells, the & symbol is treated specially and when used, it
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000774 runs the specified command in the background. To safely send the & as a part
Daniel Stenberg4c485992001-04-22 15:45:27 +0000775 of a URL, you should quote the entire URL by using single (') or double (")
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000776 quotes around it. Similar problems can also occur on some shells with other
777 characters, including ?*!$~(){}<>\|;`. When in doubt, quote the URL.
Daniel Stenberg29470102000-06-02 13:32:01 +0000778
Daniel Stenberg07d46882009-02-13 09:12:52 +0000779 An example that would invoke a remote CGI that uses &-symbols could be:
Daniel Stenberg8f037322000-06-06 14:09:01 +0000780
Daniel Stenbergedcd5df2000-06-06 14:13:36 +0000781 curl 'http://www.altavista.com/cgi-bin/query?text=yes&q=curl'
Daniel Stenberg8f037322000-06-06 14:09:01 +0000782
Daniel Stenberg07d46882009-02-13 09:12:52 +0000783 In Windows, the standard DOS shell treats the %-symbol specially and you
784 need to use TWO %-symbols for each single one you want to use in the URL.
Daniel Stenberge26ee092001-01-15 10:26:37 +0000785
Daniel Stenberg07d46882009-02-13 09:12:52 +0000786 Also note that if you want the literal %-symbol to be part of the data you
Daniel Stenbergdaf55702002-08-29 07:05:31 +0000787 pass in a POST using -d/--data you must encode it as '%25' (which then also
Daniel Stenberg07d46882009-02-13 09:12:52 +0000788 needs the %-symbol doubled on Windows machines).
Daniel Stenberg1b77c182001-01-29 10:24:51 +0000789
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000790 4.3 How can I use {, }, [ or ] to specify multiple URLs?
Daniel Stenberg29470102000-06-02 13:32:01 +0000791
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000792 Because those letters have a special meaning to the shell, and to be used in
793 a URL specified to curl you must quote them.
Daniel Stenberg29470102000-06-02 13:32:01 +0000794
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000795 An example that downloads two URLs (sequentially) would do:
Daniel Stenberg8f037322000-06-06 14:09:01 +0000796
Daniel Stenbergedcd5df2000-06-06 14:13:36 +0000797 curl '{curl,www}.haxx.se'
Daniel Stenberg8f037322000-06-06 14:09:01 +0000798
Daniel Stenberge26ee092001-01-15 10:26:37 +0000799 To be able to use those letters as actual parts of the URL (without using
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +0000800 them for the curl URL "globbing" system), use the -g/--globoff option:
Daniel Stenberge26ee092001-01-15 10:26:37 +0000801
802 curl -g 'www.site.com/weirdname[].html'
803
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000804 4.4 Why do I get downloaded data even though the web page doesn't exist?
Daniel Stenberg29470102000-06-02 13:32:01 +0000805
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000806 Curl asks remote servers for the page you specify. If the page doesn't exist
807 at the server, the HTTP protocol defines how the server should respond and
808 that means that headers and a "page" will be returned. That's simply how
809 HTTP works.
Daniel Stenberg29470102000-06-02 13:32:01 +0000810
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000811 By using the --fail option you can tell curl explicitly to not get any data
812 if the HTTP return code doesn't say success.
Daniel Stenberg8f037322000-06-06 14:09:01 +0000813
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000814 4.5 Why do I get return code XXX from a HTTP server?
Daniel Stenberg29470102000-06-02 13:32:01 +0000815
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000816 RFC2616 clearly explains the return codes. This is a short transcript. Go
817 read the RFC for exact details:
Daniel Stenberg29470102000-06-02 13:32:01 +0000818
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000819 4.5.1 "400 Bad Request"
Daniel Stenberg29470102000-06-02 13:32:01 +0000820
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000821 The request could not be understood by the server due to malformed
822 syntax. The client SHOULD NOT repeat the request without modifications.
823
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000824 4.5.2 "401 Unauthorized"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000825
826 The request requires user authentication.
827
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000828 4.5.3 "403 Forbidden"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000829
830 The server understood the request, but is refusing to fulfill it.
831 Authorization will not help and the request SHOULD NOT be repeated.
832
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000833 4.5.4 "404 Not Found"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000834
835 The server has not found anything matching the Request-URI. No indication
836 is given of whether the condition is temporary or permanent.
837
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000838 4.5.5 "405 Method Not Allowed"
Daniel Stenbergc3318b42000-08-17 14:06:42 +0000839
840 The method specified in the Request-Line is not allowed for the resource
841 identified by the Request-URI. The response MUST include an Allow header
842 containing a list of valid methods for the requested resource.
843
Daniel Stenbergd60029d2001-12-19 23:25:04 +0000844 4.5.6 "301 Moved Permanently"
Daniel Stenbergeea22872004-03-16 07:56:51 +0000845
Daniel Stenberg98871d12002-05-22 22:14:03 +0000846 If you get this return code and an HTML output similar to this:
Daniel Stenbergd60029d2001-12-19 23:25:04 +0000847
848 <H1>Moved Permanently</H1> The document has moved <A
849 HREF="http://same_url_now_with_a_trailing_slash/">here</A>.
850
851 it might be because you request a directory URL but without the trailing
852 slash. Try the same operation again _with_ the trailing URL, or use the
853 -L/--location option to follow the redirection.
854
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000855 4.6 Can you tell me what error code 142 means?
Daniel Stenberg29470102000-06-02 13:32:01 +0000856
Daniel Stenberg8b5f0ab2004-12-21 21:35:00 +0000857 All curl error codes are described at the end of the man page, in the
858 section called "EXIT CODES".
859
860 Error codes that are larger than the highest documented error code means
Daniel Stenberg13bf9642001-08-23 11:11:13 +0000861 that curl has exited due to a crash. This is a serious error, and we
Daniel Stenberg25fe47f2001-11-14 20:13:38 +0000862 appreciate a detailed bug report from you that describes how we could go
Daniel Stenberg13bf9642001-08-23 11:11:13 +0000863 ahead and repeat this!
Daniel Stenberg29470102000-06-02 13:32:01 +0000864
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000865 4.7 How do I keep user names and passwords secret in Curl command lines?
Daniel Stenberg29470102000-06-02 13:32:01 +0000866
Daniel Stenberg11d718b2001-03-13 11:47:30 +0000867 This problem has two sides:
Daniel Stenberg29470102000-06-02 13:32:01 +0000868
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000869 The first part is to avoid having clear-text passwords in the command line
870 so that they don't appear in 'ps' outputs and similar. That is easily
Daniel Stenbergeea22872004-03-16 07:56:51 +0000871 avoided by using the "-K" option to tell curl to read parameters from a file
872 or stdin to which you can pass the secret info. curl itself will also
873 attempt to "hide" the given password by blanking out the option - this
874 doesn't work on all platforms.
Daniel Stenberg29470102000-06-02 13:32:01 +0000875
Daniel Stenbergc3c77392000-07-31 22:42:34 +0000876 To keep the passwords in your account secret from the rest of the world is
877 not a task that curl addresses. You could of course encrypt them somehow to
878 at least hide them from being read by human eyes, but that is not what
879 anyone would call security.
Daniel Stenberg29470102000-06-02 13:32:01 +0000880
Daniel Stenbergeea22872004-03-16 07:56:51 +0000881 Also note that regular HTTP (using Basic authentication) and FTP passwords
882 are sent in clear across the network. All it takes for anyone to fetch them
883 is to listen on the network. Eavesdropping is very easy. Use more secure
884 authentication methods (like Digest, Negotiate or even NTLM) or consider the
885 SSL-based alternatives HTTPS and FTPS.
Daniel Stenberg887e7282001-01-03 09:13:07 +0000886
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000887 4.8 I found a bug!
888
Daniel Stenberg4c485992001-04-22 15:45:27 +0000889 It is not a bug if the behavior is documented. Read the docs first.
Daniel Stenbergeea22872004-03-16 07:56:51 +0000890 Especially check out the KNOWN_BUGS file, it may be a documented bug!
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000891
892 If it is a problem with a binary you've downloaded or a package for your
893 particular platform, try contacting the person who built the package/archive
894 you have.
895
Daniel Stenberg8eaa7fe2002-04-27 18:12:26 +0000896 If there is a bug, read the BUGS document first. Then report it as described
897 in there.
Daniel Stenberg09ba8562000-10-27 12:25:00 +0000898
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000899 4.9 Curl can't authenticate to the server that requires NTLM?
Daniel Stenberg2c100372000-12-19 07:30:51 +0000900
Daniel Stenberg64f12a32010-09-07 19:05:07 +0200901 NTLM support requires OpenSSL, GnuTLS, NSS or Microsoft Windows libraries at
902 build-time to provide this functionality.
Daniel Stenberg3a552b12003-06-26 11:35:48 +0000903
904 NTLM is a Microsoft proprietary protocol. Proprietary formats are evil. You
905 should not use such ones.
Daniel Stenberg29470102000-06-02 13:32:01 +0000906
Daniel Stenbergbc743752002-05-15 21:40:29 +0000907 4.10 My HTTP request using HEAD, PUT or DELETE doesn't work!
908
909 Many web servers allow or demand that the administrator configures the
910 server properly for these requests to work on the web server.
911
912 Some servers seem to support HEAD only on certain kinds of URLs.
913
914 To fully grasp this, try the documentation for the particular server
915 software you're trying to interact with. This is not anything curl can do
916 anything about.
917
Daniel Stenberg522b85a2002-11-12 20:00:02 +0000918 4.11 Why does my HTTP range requests return the full document?
919
920 Because the range may not be supported by the server, or the server may
921 choose to ignore it and return the full document anyway.
Daniel Stenbergbc743752002-05-15 21:40:29 +0000922
Daniel Stenberg16077112002-11-20 19:17:43 +0000923 4.12 Why do I get "certificate verify failed" ?
924
925 You invoke curl 7.10 or later to communicate on a https:// URL and get an
926 error back looking something similar to this:
927
Daniel Stenbergeea22872004-03-16 07:56:51 +0000928 curl: (35) SSL: error:14090086:SSL routines:
Daniel Stenberg16077112002-11-20 19:17:43 +0000929 SSL3_GET_SERVER_CERTIFICATE:certificate verify failed
930
931 Then it means that curl couldn't verify that the server's certificate was
932 good. Curl verifies the certificate using the CA cert bundle that comes with
933 the curl installation.
934
935 To disable the verification (which makes it act like curl did before 7.10),
936 use -k. This does however enable man-in-the-middle attacks.
937
938 If you get this failure but are having a CA cert bundle installed and used,
939 the server's certificate is not signed by one of the CA's in the bundle. It
940 might for example be self-signed. You then correct this problem by obtaining
941 a valid CA cert for the server. Or again, decrease the security by disabling
942 this check.
943
944 Details are also in the SSLCERTS file in the release archives, found online
Daniel Stenberg9b6d0102003-02-25 08:36:29 +0000945 here: http://curl.haxx.se/docs/sslcerts.html
Daniel Stenberg16077112002-11-20 19:17:43 +0000946
Daniel Stenberg1dc0ce92005-06-13 18:33:40 +0000947 4.13 Why is curl -R on Windows one hour off?
948
949 During daylight savings time, when -R is used, curl will set a time that
950 appears one hour off. This happens due to a flaw in how Windows stores and
951 uses file modification times and it is not easily worked around. For details
952 on this problem, read this: http://www.codeproject.com/datetime/dstbugs.asp
953
Daniel Stenberg09cb9c72005-08-26 13:22:39 +0000954 4.14 Redirects work in browser but not with curl!
955
956 curl supports HTTP redirects fine (see item 3.8). Browsers generally support
957 at least two other ways to perform directs that curl does not:
958
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000959 - Meta tags. You can write a HTML tag that will cause the browser to
960 redirect to another given URL after a certain time.
Daniel Stenberg09cb9c72005-08-26 13:22:39 +0000961
Dan Fandrich5c9fff92009-01-30 18:28:29 +0000962 - Javascript. You can write a Javascript program embedded in a HTML page
Daniel Stenberg9a44fa82005-11-02 09:34:53 +0000963 that redirects the browser to another given URL.
Daniel Stenberg09cb9c72005-08-26 13:22:39 +0000964
965 There is no way to make curl follow these redirects. You must either
966 manually figure out what the page is set to do, or you write a script that
967 parses the results and fetches the new URL.
968
Daniel Stenberg844cbc72007-07-29 22:17:39 +0000969 4.15 FTPS doesn't work
970
971 curl supports FTPS (sometimes known as FTP-SSL) both implicit and explicit
972 mode.
973
974 When a URL is used that starts with FTPS://, curl assumes implicit SSL on
975 the control connection and will therefore immediately connect and try to
976 speak SSL. FTPS:// connections default to port 990.
977
978 To use explicit FTPS, you use a FTP:// URL and the --ftp-ssl option (or one
979 of its related flavours). This is the most common method, and the one
980 mandated by RFC4217. This kind of connection then of course uses the
981 standard FTP port 21 by default.
982
Daniel Stenberg95df5d02008-09-24 07:50:46 +0000983 4.16 My HTTP POST or PUT requests are slow!
984
985 libcurl makes all POST and PUT requests (except for POST requests with a
986 very tiny request body) use the "Expect: 100-continue" header. This header
987 allows the server to deny the operation early so that libcurl can bail out
988 already before having to send any data. This is useful in authentication
989 cases and others.
990
991 However, many servers don't implement the Expect: stuff properly and if the
992 server doesn't respond (positively) within 1 second libcurl will continue
993 and send off the data anyway.
994
995 You can disable libcurl's use of the Expect: header the same way you disable
996 any header, using -H / CURLOPT_HTTPHEADER, or by forcing it to use HTTP 1.0.
Daniel Stenberg811edcd2004-08-10 08:41:41 +0000997
Daniel Stenberg2afb88e2009-02-23 21:21:00 +0000998 4.17 Non-functional connect timeouts
999
1000 In most Windows setups having a timeout longer than 21 seconds make no
1001 difference, as it will only send 3 TCP SYN packets and no more. The second
1002 packet sent three seconds after the first and the third six seconds after
1003 the second. No more than three packets are sent, no matter how long the
1004 timeout is set.
1005
1006 See option TcpMaxConnectRetransmissions on this page:
1007 http://support.microsoft.com/?scid=kb%3Ben-us%3B175523&x=6&y=7
1008
1009 Also, even on non-Windows systems there may run a firewall or anti-virus
1010 software or similar that accepts the connection but does not actually do
1011 anything else. This will make (lib)curl to consider the connection connected
1012 and thus the connect timeout won't trigger.
1013
Daniel Stenbergb8012ea2009-11-07 21:52:41 +00001014 4.18 file:// URLs containing drive letters (Windows, NetWare)
1015
1016 When using cURL to try to download a local file, one might use a URL
1017 in this format:
1018
1019 file://D:/blah.txt
1020
1021 You'll find that even if D:\blah.txt does exist, cURL returns a 'file
1022 not found' error.
1023
1024 According to RFC 1738 (http://www.faqs.org/rfcs/rfc1738.html),
1025 file:// URLs must contain a host component, but it is ignored by
1026 most implementations. In the above example, 'D:' is treated as the
1027 host component, and is taken away. Thus, cURL tries to open '/blah.txt'.
1028 If your system is installed to drive C:, that will resolve to 'C:\blah.txt',
1029 and if that doesn't exist you will get the not found error.
1030
1031 To fix this problem, use file:// URLs with *three* leading slashes:
1032
1033 file:///D:/blah.txt
1034
1035 Alternatively, if it makes more sense, specify 'localhost' as the host
1036 component:
1037
1038 file://localhost/D:/blah.txt
1039
1040 In either case, cURL should now be looking for the correct file.
Daniel Stenberg2afb88e2009-02-23 21:21:00 +00001041
Dan Fandrich7d166b02010-07-21 15:15:07 -07001042 4.19 Why doesn't cURL return an error when the network cable is unplugged?
1043
1044 Unplugging the cable is not an error situation. The TCP/IP protocol stack
1045 was designed to be fault tolerant, so even though there may be a physical
1046 break somewhere the connection shouldn't be affected, just possibly
1047 delayed. Eventually, the physical break will be fixed or the data will be
1048 re-routed around the physical problem.
1049
1050 In such cases, the TCP/IP stack is responsible for detecting when the
1051 network connection is irrevocably lost. Since with some protocols it is
1052 perfectly legal for the client wait indefinitely for data, the stack may
1053 never report a problem, and even when it does, it can take up to 20 minutes
1054 for it to detect an issue. The curl option --keepalive-time enables
1055 keep-alive support in the TCP/IP stack which makes it periodically probe the
1056 connection to make sure it is still available to send data. That should
1057 reliably detect any TCP/IP network failure.
1058
1059 But even that won't detect the network going down before the TCP/IP
1060 connection is established (e.g. during a DNS lookup) or using protocols that
1061 don't use TCP. To handle those situations, curl offers a number of timeouts
1062 on its own. --speed-limit/--speed-time will abort if the data transfer rate
1063 falls too low, and --connect-timeout and --max-time can be used to put an
1064 overall timeout on the connection phase or the entire transfer.
1065
1066
Daniel Stenbergc3318b42000-08-17 14:06:42 +000010675. libcurl Issues
Daniel Stenberg29470102000-06-02 13:32:01 +00001068
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001069 5.1 Is libcurl thread-safe?
Daniel Stenberg29470102000-06-02 13:32:01 +00001070
Daniel Stenberg7d09e512001-01-11 12:52:07 +00001071 Yes.
1072
Dan Fandrichec2ad572005-04-13 19:31:00 +00001073 We have written the libcurl code specifically adjusted for multi-threaded
Daniel Stenberg7d09e512001-01-11 12:52:07 +00001074 programs. libcurl will use thread-safe functions instead of non-safe ones if
1075 your system has such.
Daniel Stenberg29470102000-06-02 13:32:01 +00001076
Daniel Stenberga19b23b2005-04-13 08:47:59 +00001077 If you use a OpenSSL-powered libcurl in a multi-threaded environment, you
1078 need to provide one or two locking functions:
1079
Daniel Stenberg2afb88e2009-02-23 21:21:00 +00001080 http://www.openssl.org/docs/crypto/threads.html
Daniel Stenberga19b23b2005-04-13 08:47:59 +00001081
1082 If you use a GnuTLS-powered libcurl in a multi-threaded environment, you
1083 need to provide locking function(s) for libgcrypt (which is used by GnuTLS
1084 for the crypto functions).
1085
Daniel Stenbergf83be112005-05-18 10:12:08 +00001086 http://www.gnu.org/software/gnutls/manual/html_node/Multi_002dthreaded-applications.html
Daniel Stenberg29470102000-06-02 13:32:01 +00001087
Daniel Stenberg7f70dbc2007-02-12 22:32:37 +00001088 No special locking is needed with a NSS-powered libcurl. NSS is thread-safe.
1089
Daniel Stenberga40b55d2000-11-22 07:27:26 +00001090 5.2 How can I receive all data into a large memory chunk?
1091
Daniel Stenberga84af982001-05-15 13:09:27 +00001092 [ See also the examples/getinmemory.c source ]
1093
Daniel Stenberga40b55d2000-11-22 07:27:26 +00001094 You are in full control of the callback function that gets called every time
1095 there is data received from the remote server. You can make that callback do
Daniel Stenberg4c485992001-04-22 15:45:27 +00001096 whatever you want. You do not have to write the received data to a file.
Daniel Stenberga40b55d2000-11-22 07:27:26 +00001097
1098 One solution to this problem could be to have a pointer to a struct that you
1099 pass to the callback function. You set the pointer using the
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001100 CURLOPT_WRITEDATA option. Then that pointer will be passed to the callback
1101 instead of a FILE * to a file:
Daniel Stenberga40b55d2000-11-22 07:27:26 +00001102
1103 /* imaginary struct */
1104 struct MemoryStruct {
1105 char *memory;
1106 size_t size;
1107 };
1108
1109 /* imaginary callback function */
1110 size_t
1111 WriteMemoryCallback(void *ptr, size_t size, size_t nmemb, void *data)
1112 {
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001113 size_t realsize = size * nmemb;
Daniel Stenberga40b55d2000-11-22 07:27:26 +00001114 struct MemoryStruct *mem = (struct MemoryStruct *)data;
Daniel Stenbergeea22872004-03-16 07:56:51 +00001115
Daniel Stenberga40b55d2000-11-22 07:27:26 +00001116 mem->memory = (char *)realloc(mem->memory, mem->size + realsize + 1);
1117 if (mem->memory) {
1118 memcpy(&(mem->memory[mem->size]), ptr, realsize);
1119 mem->size += realsize;
1120 mem->memory[mem->size] = 0;
1121 }
1122 return realsize;
1123 }
1124
Daniel Stenberg2c100372000-12-19 07:30:51 +00001125 5.3 How do I fetch multiple files with libcurl?
Daniel Stenbergec5ac822000-12-14 08:37:09 +00001126
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +00001127 libcurl has excellent support for transferring multiple files. You should
1128 just repeatedly set new URLs with curl_easy_setopt() and then transfer it
1129 with curl_easy_perform(). The handle you get from curl_easy_init() is not
1130 only reusable, but you're even encouraged to reuse it if you can, as that
1131 will enable libcurl to use persistent connections.
Daniel Stenberga40b55d2000-11-22 07:27:26 +00001132
Daniel Stenbergbc5954f2001-03-23 08:16:24 +00001133 5.4 Does libcurl do Winsock initialization on win32 systems?
Daniel Stenberg910fc852000-12-30 11:48:51 +00001134
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +00001135 Yes, if told to in the curl_global_init() call.
Daniel Stenberg910fc852000-12-30 11:48:51 +00001136
Daniel Stenberg7e3cd822003-12-08 13:59:35 +00001137 5.5 Does CURLOPT_WRITEDATA and CURLOPT_READDATA work on win32 ?
Daniel Stenberg41084e52001-01-22 08:42:00 +00001138
1139 Yes, but you cannot open a FILE * and pass the pointer to a DLL and have
Daniel Stenberg7e3cd822003-12-08 13:59:35 +00001140 that DLL use the FILE * (as the DLL and the client application cannot access
1141 each others' variable memory areas). If you set CURLOPT_WRITEDATA you must
1142 also use CURLOPT_WRITEFUNCTION as well to set a function that writes the
1143 file, even if that simply writes the data to the specified FILE *.
1144 Similarly, if you use CURLOPT_READDATA you must also specify
1145 CURLOPT_READFUNCTION.
Daniel Stenberg41084e52001-01-22 08:42:00 +00001146
Daniel Stenberg4c485992001-04-22 15:45:27 +00001147 5.6 What about Keep-Alive or persistent connections?
Daniel Stenberg6dc5c6f2001-01-27 20:51:31 +00001148
Daniel Stenbergdb5c9cd2003-02-25 08:52:32 +00001149 curl and libcurl have excellent support for persistent connections when
1150 transferring several files from the same server. Curl will attempt to reuse
1151 connections for all URLs specified on the same command line/config file, and
1152 libcurl will reuse connections for all transfers that are made using the
1153 same libcurl handle.
Daniel Stenberg6dc5c6f2001-01-27 20:51:31 +00001154
Daniel Stenbergdd82d692002-10-08 07:16:17 +00001155 5.7 Link errors when building libcurl on Windows!
1156
1157 You need to make sure that your project, and all the libraries (both static
1158 and dynamic) that it links against, are compiled/linked against the same run
1159 time library.
1160
1161 This is determined by the /MD, /ML, /MT (and their corresponding /M?d)
1162 options to the command line compiler. /MD (linking against MSVCRT dll) seems
1163 to be the most commonly used option.
1164
Gisle Vanem51a87fa2004-11-24 15:14:42 +00001165 When building an application that uses the static libcurl library, you must
1166 add -DCURL_STATICLIB to your CFLAGS. Otherwise the linker will look for
Daniel Stenberg6ce76e62010-09-08 23:23:19 +02001167 dynamic import symbols. If you're using Visual Studio, you need to instead
1168 add CURL_STATICLIB in the "Preprocessor Definitions" section.
1169
1170 If you get linker error like "unknown symbol __imp__curl_easy_init ..." you
1171 have linked against the wrong (static) library. If you want to use the
1172 libcurl.dll and import lib, you don't need any extra CFLAGS, but use one of
1173 the import libraries below. These are the libraries produced by the various
1174 lib/Makefile.* files:
Gisle Vanem51a87fa2004-11-24 15:14:42 +00001175
Daniel Stenberg77110862011-03-14 13:31:05 +01001176 Target: static lib. import lib for libcurl*.dll.
1177 -----------------------------------------------------------
1178 MingW: libcurl.a libcurldll.a
1179 MSVC (release): libcurl.lib libcurl_imp.lib
1180 MSVC (debug): libcurld.lib libcurld_imp.lib
1181 Borland: libcurl.lib libcurl_imp.lib
Gisle Vanem51a87fa2004-11-24 15:14:42 +00001182
Daniel Stenberg9754b202010-08-11 09:15:43 +02001183 5.8 libcurl.so.X: open failed: No such file or directory
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001184
1185 This is an error message you might get when you try to run a program linked
1186 with a shared version of libcurl and your run-time linker (ld.so) couldn't
Daniel Stenberg9754b202010-08-11 09:15:43 +02001187 find the shared library named libcurl.so.X. (Where X is the number of the
1188 current libcurl ABI, typically 3 or 4).
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001189
Daniel Stenberg9754b202010-08-11 09:15:43 +02001190 You need to make sure that ld.so finds libcurl.so.X. You can do that
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001191 multiple ways, and it differs somewhat between different operating systems,
1192 but they are usually:
1193
1194 * Add an option to the linker command line that specify the hard-coded path
1195 the run-time linker should check for the lib (usually -R)
1196
1197 * Set an environment variable (LD_LIBRARY_PATH for example) where ld.so
1198 should check for libs
1199
1200 * Adjust the system's config to check for libs in the directory where you've
1201 put the dir (like Linux's /etc/ld.so.conf)
1202
1203 'man ld.so' and 'man ld' will tell you more details
1204
Daniel Stenberg1d323362004-08-12 14:09:10 +00001205 5.9 How does libcurl resolve host names?
1206
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001207 libcurl supports a large a number of different name resolve functions. One
1208 of them is picked at build-time and will be used unconditionally. Thus, if
1209 you want to change name resolver function you must rebuild libcurl and tell
1210 it to use a different function.
Daniel Stenberg1d323362004-08-12 14:09:10 +00001211
1212 - The non-ipv6 resolver that can use one out of four host name resolve calls
1213 (depending on what your system supports):
1214
Daniel Stenberg77110862011-03-14 13:31:05 +01001215 A - gethostbyname()
1216 B - gethostbyname_r() with 3 arguments
1217 C - gethostbyname_r() with 5 arguments
1218 D - gethostbyname_r() with 6 arguments
Daniel Stenberg1d323362004-08-12 14:09:10 +00001219
1220 - The ipv6-resolver that uses getaddrinfo()
1221
1222 - The c-ares based name resolver that uses the c-ares library for resolves.
Daniel Stenbergfa811932011-04-14 23:12:27 +02001223 Using this offers asynchronous name resolves.
Daniel Stenberg1d323362004-08-12 14:09:10 +00001224
Daniel Stenberg18a9ee62010-06-30 15:52:58 +02001225 - The threaded resolver (default option on Windows). It uses:
Daniel Stenberg1d323362004-08-12 14:09:10 +00001226
Daniel Stenberg77110862011-03-14 13:31:05 +01001227 A - gethostbyname() on plain ipv4 hosts
1228 B - getaddrinfo() on ipv6-enabled hosts
Daniel Stenbergdd82d692002-10-08 07:16:17 +00001229
Daniel Stenberge9eb5232005-04-05 14:36:37 +00001230 Also note that libcurl never resolves or reverse-lookups addresses given as
1231 pure numbers, such as 127.0.0.1 or ::1.
1232
1233 5.10 How do I prevent libcurl from writing the response to stdout?
1234
1235 libcurl provides a default built-in write function that writes received data
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001236 to stdout. Set the CURLOPT_WRITEFUNCTION to receive the data, or possibly
1237 set CURLOPT_WRITEDATA to a different FILE * handle.
Daniel Stenberge9eb5232005-04-05 14:36:37 +00001238
Daniel Stenberg6e8e0412005-04-05 14:38:38 +00001239 5.11 How do I make libcurl not receive the whole HTTP response?
1240
1241 You make the write callback (or progress callback) return an error and
1242 libcurl will then abort the transfer.
1243
Daniel Stenbergb5d50e92005-04-11 13:39:55 +00001244 5.12 Can I make libcurl fake or hide my real IP address?
1245
1246 No. libcurl operates on a higher level than so. Besides, faking IP address
1247 would imply sending IP packages with a made-up source address, and then you
1248 normally get a problem with intercepting the packages sent back as they
1249 would then not be routed to you!
1250
1251 If you use a proxy to access remote sites, the sites will not see your local
1252 IP address but instead the address of the proxy.
1253
1254 Also note that on many networks NATs or other IP-munging techniques are used
1255 that makes you see and use a different IP address locally than what the
1256 remote server will see you coming from.
1257
Daniel Stenberg24602ed2007-12-10 10:28:56 +00001258 5.13 How do I stop an ongoing transfer?
1259
Daniel Stenberg4b837a72011-01-24 22:18:43 +01001260 With the easy interface you make sure to return the correct error code from
1261 one of the callbacks, but none of them are instant. There is no function you
1262 can call from another thread or similar that will stop it immediately.
Daniel Stenberg24602ed2007-12-10 10:28:56 +00001263 Instead you need to make sure that one of the callbacks you use return an
1264 appropriate value that will stop the transfer.
1265
1266 Suitable callbacks that you can do this with include the progress callback,
1267 the read callback and the write callback.
1268
Daniel Stenberg4b837a72011-01-24 22:18:43 +01001269 If you're using the multi interface, you can also stop a transfer by
1270 removing the particular easy handle from the multi stack. At any moment you
1271 think the transfer is done.
Daniel Stenberge9eb5232005-04-05 14:36:37 +00001272
Daniel Stenberg22059852008-09-24 07:39:42 +00001273 5.14 Using C++ non-static functions for callbacks?
1274
1275 libcurl is a C library, it doesn't know anything about C++ member functions.
1276
1277 You can overcome this "limitation" with a relative ease using a static
1278 member function that is passed a pointer to the class:
1279
1280 // f is the pointer to your object.
Daniel Stenberg77110862011-03-14 13:31:05 +01001281 static YourClass::func(void *buffer, size_t sz, size_t n, void *f)
Daniel Stenberg22059852008-09-24 07:39:42 +00001282 {
1283 // Call non-static member function.
1284 static_cast<YourClass*>(f)->nonStaticFunction();
1285 }
1286
1287 // This is how you pass pointer to the static function:
Daniel Stenberg77110862011-03-14 13:31:05 +01001288 curl_easy_setopt(hcurl, CURLOPT_WRITEFUNCTION, YourClass:func);
Daniel Stenberg22059852008-09-24 07:39:42 +00001289 curl_easy_setopt(hcurl, CURLOPT_WRITEDATA, this);
1290
Yang Tsea07bc792010-02-14 19:40:18 +00001291 5.15 How do I get an FTP directory listing?
Daniel Stenberg8740d142009-06-09 09:02:39 +00001292
1293 If you end the FTP URL you request with a slash, libcurl will provide you
1294 with a directory listing of that given directory. You can also set
1295 CURLOPT_CUSTOMREQUEST to alter what exact listing command libcurl would use
1296 to list the files.
1297
1298 The follow-up question that tend to follow the previous one, is how a
1299 program is supposed to parse the directory listing. How does it know what's
1300 a file and what's a dir and what's a symlink etc. The harsh reality is that
1301 FTP provides no such fine and easy-to-parse output. The output format FTP
1302 servers respond to LIST commands are entirely at the server's own liking and
1303 the NLST output doesn't reveal any types and in many cases don't even
1304 include all the directory entries. Also, both LIST and NLST tend to hide
1305 unix-style hidden files (those that start with a dot) by default so you need
1306 to do "LIST -a" or similar to see them.
1307
1308 The application thus needs to parse the LIST output. One such existing
Dan Fandrich7d166b02010-07-21 15:15:07 -07001309 list parser is available at http://cr.yp.to/ftpparse.html Versions of
1310 libcurl since 7.21.0 also provide the ability to specify a wildcard to
1311 download multiple files from one FTP directory.
Daniel Stenberg8740d142009-06-09 09:02:39 +00001312
1313
Daniel Stenbergc3318b42000-08-17 14:06:42 +000013146. License Issues
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001315
Daniel Stenberg1c961282002-09-03 11:58:18 +00001316 Curl and libcurl are released under a MIT/X derivate license. The license is
1317 very liberal and should not impose a problem for your project. This section
1318 is just a brief summary for the cases we get the most questions. (Parts of
1319 this section was much enhanced by Bjorn Reese.)
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001320
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001321 We are not lawyers and this is not legal advice. You should probably consult
Dan Fandrichc28443c2010-12-08 10:16:25 -08001322 one if you want true and accurate legal insights without our prejudice. Note
1323 especially that this section concerns the libcurl license only; compiling in
1324 features of libcurl that depend on other libraries (e.g. OpenSSL) may affect
1325 the licensing obligations of your application.
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001326
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001327 6.1 I have a GPL program, can I use the libcurl library?
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001328
Daniel Stenberg0d181b52001-01-04 12:43:53 +00001329 Yes!
Daniel Stenberg7d1ef962000-08-14 06:31:59 +00001330
Daniel Stenberg0d181b52001-01-04 12:43:53 +00001331 Since libcurl may be distributed under the MIT/X derivate license, it can be
1332 used together with GPL in any software.
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001333
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001334 6.2 I have a closed-source program, can I use the libcurl library?
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001335
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001336 Yes!
Daniel Stenberg0d181b52001-01-04 12:43:53 +00001337
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001338 libcurl does not put any restrictions on the program that uses the library.
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001339
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001340 6.3 I have a BSD licensed program, can I use the libcurl library?
Daniel Stenberg31b8eea2000-08-23 07:27:00 +00001341
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001342 Yes!
Daniel Stenberg0d181b52001-01-04 12:43:53 +00001343
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001344 libcurl does not put any restrictions on the program that uses the library.
Daniel Stenberg31b8eea2000-08-23 07:27:00 +00001345
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001346 6.4 I have a program that uses LGPL libraries, can I use libcurl?
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001347
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001348 Yes!
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001349
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001350 The LGPL license doesn't clash with other licenses.
Daniel Stenbergc3318b42000-08-17 14:06:42 +00001351
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001352 6.5 Can I modify curl/libcurl for my program and keep the changes secret?
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001353
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001354 Yes!
Daniel Stenberg0d181b52001-01-04 12:43:53 +00001355
1356 The MIT/X derivate license practically allows you to do almost anything with
1357 the sources, on the condition that the copyright texts in the sources are
1358 left intact.
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001359
Daniel Stenberg811edcd2004-08-10 08:41:41 +00001360 6.6 Can you please change the curl/libcurl license to XXXX?
Daniel Stenbergc3c77392000-07-31 22:42:34 +00001361
Daniel Stenbergc59baa02001-02-12 10:05:09 +00001362 No.
1363
Daniel Stenberg11d718b2001-03-13 11:47:30 +00001364 We have carefully picked this license after years of development and
1365 discussions and a large amount of people have contributed with source code
1366 knowing that this is the license we use. This license puts the restrictions
1367 we want on curl/libcurl and it does not spread to other programs or
Daniel Stenberg3a552b12003-06-26 11:35:48 +00001368 libraries that use it. It should be possible for everyone to use libcurl or
1369 curl in their projects, no matter what license they already have in use.
Daniel Stenberg9ac76292004-08-18 11:18:36 +00001370
Dan Fandrich5c9fff92009-01-30 18:28:29 +00001371 6.7 What are my obligations when using libcurl in my commercial apps?
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001372
1373 Next to none. All you need to adhere to is the MIT-style license (stated in
1374 the COPYING file) which basically says you have to include the copyright
1375 notice in "all copies" and that you may not use the copyright holder's name
1376 when promoting your software.
1377
1378 You do not have to release any of your source code.
1379
1380 You do not have to reveal or make public any changes to the libcurl source
1381 code.
1382
Daniel Stenberg819dfdd2011-01-29 23:52:40 +01001383 You do not have to broadcast to the world that you are using libcurl within
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001384 your app.
1385
Daniel Stenberg819dfdd2011-01-29 23:52:40 +01001386 All we ask is that you disclose "the copyright notice and this permission
1387 notice" somewhere. Most probably like in the documentation or in the section
1388 where other third party dependencies already are mentioned and acknowledged.
1389
1390 As can be seen here: http://curl.haxx.se/docs/companies.html and elsewhere,
1391 more and more companies are discovering the power of libcurl and take
1392 advantage of it even in commercial environments.
Daniel Stenberg9a44fa82005-11-02 09:34:53 +00001393
1394
Daniel Stenberg9ac76292004-08-18 11:18:36 +000013957. PHP/CURL Issues
1396
1397 7.1 What is PHP/CURL?
1398
1399 The module for PHP that makes it possible for PHP programs to access curl-
Daniel Stenbergb6c876b2005-07-30 23:37:05 +00001400 functions from within PHP.
1401
1402 In the cURL project we call this module PHP/CURL to differentiate it from
1403 curl the command line tool and libcurl the library. The PHP team however
1404 does not refer to it like this (for unknown reasons). They call it plain
Daniel Stenberg844cbc72007-07-29 22:17:39 +00001405 CURL (often using all caps) or sometimes ext/curl, but both cause much
1406 confusion to users which in turn gives us a higher question load.
Daniel Stenberg9ac76292004-08-18 11:18:36 +00001407
Daniel Stenberge38a7882011-03-17 11:30:29 +01001408 7.2 Who wrote PHP/CURL?
Daniel Stenberg9ac76292004-08-18 11:18:36 +00001409
1410 PHP/CURL is a module that comes with the regular PHP package. It depends and
1411 uses libcurl, so you need to have libcurl installed properly first before
Daniel Stenberg844cbc72007-07-29 22:17:39 +00001412 PHP/CURL can be used. PHP/CURL was initially written by Sterling Hughes.
Daniel Stenberg9ac76292004-08-18 11:18:36 +00001413
1414 7.3 Can I perform multiple requests using the same handle?
1415
Daniel Stenbergee400f92004-08-19 06:31:29 +00001416 Yes - at least in PHP version 4.3.8 and later (this has been known to not
1417 work in earlier versions, but the exact version when it started to work is
1418 unknown to me).
Daniel Stenberg9ac76292004-08-18 11:18:36 +00001419
Daniel Stenbergee400f92004-08-19 06:31:29 +00001420 After a transfer, you just set new options in the handle and make another
1421 transfer. This will make libcurl to re-use the same connection if it can.