Change log for RCurl

1.2-0

Recognize more Content-Types as being text and so handle the (HTTP) response as text rather than binary for those situations.

1.1-0

Support for using default options for new curl handles taken from options("RCurlOptions").

1.0-0

dynCurlReader() (and hence getURLContent()) adds the Content-Type attribute to the resulting R object. getURLContent() allows the caller to specify the reader for the header and body via the header parameter.
getURLContent() allows the caller to specify the reader for the header and body via the header parameter.

0.99-0

Added a binary argument to getURLContent(), getForm() and postForm() to allow the caller to control whether the response returned by the Web server is treated as binary or text. If this is not specified, we examine the Content-Type field in the response's header and try to determine from that whether the content is binary or text. The set of application Content-Types recognized as being text is now retrieved from the R options vector via the element text.content.types. This allows users to change this set to recognize "new" types. Fixed a bug in setting the HTTPHEADER when a value contained a ':' and there was only one value being set. curlSetOpt() now detects this case better and also allows the caller to explicitly control this via the .forceHeaderNames parameter. getURLContent() was not honoring ... arguments for setting curl options.
The set of application Content-Types recognized as being text is now retrieved from the R options vector via the element text.content.types. This allows users to change this set to recognize "new" types. Fixed a bug in setting the HTTPHEADER when a value contained a ':' and there was only one value being set. curlSetOpt() now detects this case better and also allows the caller to explicitly control this via the .forceHeaderNames parameter. getURLContent() was not honoring ... arguments for setting curl options.
Fixed a bug in setting the HTTPHEADER when a value contained a ':' and there was only one value being set. curlSetOpt() now detects this case better and also allows the caller to explicitly control this via the .forceHeaderNames parameter. getURLContent() was not honoring ... arguments for setting curl options.
getURLContent() was not honoring ... arguments for setting curl options.

0.98-1

Added configure- and compile-time checking for different versions and enumerated constants so that this will install for older versions of libcurl. Goes all the way back to 7.14.0, i.e. 2005!

0.98-0

Added CFILE class and function to allow us to work with files on disk, e.g. for uploading, without reading them into R, and for speed to avoid using functions.

0.97-3

dynCurlReader() discards the original content for the header when it is a 100 status and so is ready to read the subsequent header after the continuation. Found by Steffen Durinck in biomaRt.: Found by Steffen Durinck in biomaRt.

0.97-2

getURL() example involving listing files in an FTP directory now handles newlines of the form \r\n on Windows. Thanks to Brian Ripley. Further tweaks for different versions of libcurl and the generated code mappings.
Further tweaks for different versions of libcurl and the generated code mappings.

0.97-1

Additional checks in the configuration for existence of specific enumeration constants to handle different versions of libcurl.

0.97-0

Added configuration-time tests for the existence of newly added enumerations in the options and corresponding #ifdef's within the code. This handles different versions of libcurl with different options. The code in CodeGeneration/generate.R can deal with different versions and programmatically create the code for the most recent version of libcurl it sees with support for older versions.

0.96-0

Updated the number of recognized curl options in curlPerform and higher-level functions. getCurlInfo() can return certificate information and single linked lists that are characters Introduced getCurlOptionTypes() which indicates the expected types of the different options. Added several C-level enumeration collections as R values. These are not exported as there are many of them. They can be accessed with RCurl:::name, e.g. RCurl:::CURLPROXY_HTTP_1_0 This involves bringing in Enumeration classes from RAutoGenRunTime. Configuration tests for recently added libcurl options in the CURLOPT enumerations and avoid them in compilation if they are not present.
getCurlInfo() can return certificate information and single linked lists that are characters Introduced getCurlOptionTypes() which indicates the expected types of the different options. Added several C-level enumeration collections as R values. These are not exported as there are many of them. They can be accessed with RCurl:::name, e.g. RCurl:::CURLPROXY_HTTP_1_0 This involves bringing in Enumeration classes from RAutoGenRunTime. Configuration tests for recently added libcurl options in the CURLOPT enumerations and avoid them in compilation if they are not present.
Introduced getCurlOptionTypes() which indicates the expected types of the different options. Added several C-level enumeration collections as R values. These are not exported as there are many of them. They can be accessed with RCurl:::name, e.g. RCurl:::CURLPROXY_HTTP_1_0 This involves bringing in Enumeration classes from RAutoGenRunTime. Configuration tests for recently added libcurl options in the CURLOPT enumerations and avoid them in compilation if they are not present.
Added several C-level enumeration collections as R values. These are not exported as there are many of them. They can be accessed with RCurl:::name, e.g. RCurl:::CURLPROXY_HTTP_1_0 This involves bringing in Enumeration classes from RAutoGenRunTime. Configuration tests for recently added libcurl options in the CURLOPT enumerations and avoid them in compilation if they are not present.: This involves bringing in Enumeration classes from RAutoGenRunTime.
Configuration tests for recently added libcurl options in the CURLOPT enumerations and avoid them in compilation if they are not present.

0.95-1

parseHTTPHeader() deals with fields in the header that contain multiple ':' characters. dynCurlReader() handles HTTP 100 status messages to Continue better.
dynCurlReader() handles HTTP 100 status messages to Continue better.

0.95-0

getURLContent() now uses a dynamic reader which processes the header and determines the Content-Type (and the encoding if text) and reads the body of the reply appropriately. getForm() now uses getURLContent() and so handles binary results and different character sets.
getForm() now uses getURLContent() and so handles binary results and different character sets.

0.94-1

Silly initialization omission for the readfunction C routine handler which caused the ftpUpload() to produce "infinitely" large files on the server. Thanks to Herve Fulchiron.

0.94-0

Added ftpUpload() function and small C routine and R function for READFUNCTION option callbacks. Support for QUOTE, POSTQUOTE, PREQUOTE options for FTP.
Support for QUOTE, POSTQUOTE, PREQUOTE options for FTP.

0.93-0

Added a reset() generic function and a method for resetting the contents of a CURLHandle to the original default values. Fixed bug in terminating the string in calls to the debug callback function.
Fixed bug in terminating the string in calls to the debug callback function.

0.92-0

Added getURLContent() as a top-level function which handles binary and text downloads by looking at the Content-Type field of the header. getURLContent() also raises errors for requests with a status in the "400" class (e.g. 404 for Not Found) and the errors have (S3) classes that allow them to be handled via tryCatch(). Added getBinaryURL() function as a convenience for downloading binary files. Binary content from POSTing or GETing forms can be done by mimicing the few curl settings illustrated in getBinaryURL(). Slightly improved error messages when unnamed options are passed to curlOptions(). Fixed a bug in reading binary files when enlarging the "raw" buffer. getForm() and postForm() now issue a warning if a curl option appears in the parameters for the form. This can be legitimate if the form happens to use a parameter with the same name as a curl option (see listCurlOptions()) and the error message can be silenced by explicitly providing a value for the .opts parameter in the call. The value can be list() or some actual curl options; the point is to indicate in the call that you have considered the parameters and the curl options. The 'statusMessage' field of the HTTP header now contains the entire error message rather than the first word. Thanks to Valerie Obenchain for identifying the problem. Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.
getURLContent() also raises errors for requests with a status in the "400" class (e.g. 404 for Not Found) and the errors have (S3) classes that allow them to be handled via tryCatch(). Added getBinaryURL() function as a convenience for downloading binary files. Binary content from POSTing or GETing forms can be done by mimicing the few curl settings illustrated in getBinaryURL(). Slightly improved error messages when unnamed options are passed to curlOptions(). Fixed a bug in reading binary files when enlarging the "raw" buffer. getForm() and postForm() now issue a warning if a curl option appears in the parameters for the form. This can be legitimate if the form happens to use a parameter with the same name as a curl option (see listCurlOptions()) and the error message can be silenced by explicitly providing a value for the .opts parameter in the call. The value can be list() or some actual curl options; the point is to indicate in the call that you have considered the parameters and the curl options. The 'statusMessage' field of the HTTP header now contains the entire error message rather than the first word. Thanks to Valerie Obenchain for identifying the problem. Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.
Added getBinaryURL() function as a convenience for downloading binary files. Binary content from POSTing or GETing forms can be done by mimicing the few curl settings illustrated in getBinaryURL(). Slightly improved error messages when unnamed options are passed to curlOptions(). Fixed a bug in reading binary files when enlarging the "raw" buffer. getForm() and postForm() now issue a warning if a curl option appears in the parameters for the form. This can be legitimate if the form happens to use a parameter with the same name as a curl option (see listCurlOptions()) and the error message can be silenced by explicitly providing a value for the .opts parameter in the call. The value can be list() or some actual curl options; the point is to indicate in the call that you have considered the parameters and the curl options. The 'statusMessage' field of the HTTP header now contains the entire error message rather than the first word. Thanks to Valerie Obenchain for identifying the problem. Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.
Slightly improved error messages when unnamed options are passed to curlOptions(). Fixed a bug in reading binary files when enlarging the "raw" buffer. getForm() and postForm() now issue a warning if a curl option appears in the parameters for the form. This can be legitimate if the form happens to use a parameter with the same name as a curl option (see listCurlOptions()) and the error message can be silenced by explicitly providing a value for the .opts parameter in the call. The value can be list() or some actual curl options; the point is to indicate in the call that you have considered the parameters and the curl options. The 'statusMessage' field of the HTTP header now contains the entire error message rather than the first word. Thanks to Valerie Obenchain for identifying the problem. Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.
Fixed a bug in reading binary files when enlarging the "raw" buffer. getForm() and postForm() now issue a warning if a curl option appears in the parameters for the form. This can be legitimate if the form happens to use a parameter with the same name as a curl option (see listCurlOptions()) and the error message can be silenced by explicitly providing a value for the .opts parameter in the call. The value can be list() or some actual curl options; the point is to indicate in the call that you have considered the parameters and the curl options. The 'statusMessage' field of the HTTP header now contains the entire error message rather than the first word. Thanks to Valerie Obenchain for identifying the problem. Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.
getForm() and postForm() now issue a warning if a curl option appears in the parameters for the form. This can be legitimate if the form happens to use a parameter with the same name as a curl option (see listCurlOptions()) and the error message can be silenced by explicitly providing a value for the .opts parameter in the call. The value can be list() or some actual curl options; the point is to indicate in the call that you have considered the parameters and the curl options. The 'statusMessage' field of the HTTP header now contains the entire error message rather than the first word. Thanks to Valerie Obenchain for identifying the problem. Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.
The 'statusMessage' field of the HTTP header now contains the entire error message rather than the first word. Thanks to Valerie Obenchain for identifying the problem. Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.
Errors from HTTP requests now have their own class and use the condition system in R (see tryCatch(), simpleError, etc.). The names of these error classes come from the HTTP specification and are gathered programmatically from the specification document. (See inst/HTTPErrors/). Unknown/non-matching error status values return a GenericHTTPError class. The others return a vector of class names containing a more specific class name (whose name is the status number) and the more general "HTTPError" class name.

0.9-4

Fix escaping in the split string used in findHTTPHeaderEncoding which gave rise to warnings about vector lengths in an if() condition in getEncoding().

0.9-3

Changes to remove some simple compiler warnings.

0.9-2

Fix for base64() computing whether to encode or not incorrectly due to lazy evaluation. Now we use the base64 encode and decode routines from the libcurl distribution with our own names on the routines to avoid synchronization problems. Fix in chunkToLineReader to report number of "characters" read and warning emitted in C code if full number of "characters" not consumed.
Now we use the base64 encode and decode routines from the libcurl distribution with our own names on the routines to avoid synchronization problems. Fix in chunkToLineReader to report number of "characters" read and warning emitted in C code if full number of "characters" not consumed.
Fix in chunkToLineReader to report number of "characters" read and warning emitted in C code if full number of "characters" not consumed.

0.9-1

Configuration-time check to see if Curl_base64_encode() in libcurl (unexported) has the new additional parameter and so requires us to use that..

0.9-0

Moved the tests/ directory to inst/examples/. This has some quite rich/advanced examples that should be available to people and also take some time to run during R CMD check. Allow for an .encoding parameter in getURL()/getURI() for explicitly specifying the encoding of the response from the HTTP. A mechanism that reads the HTTP response header and finds the Content-Type field and attempts to infer the encoding of the response. Note that this registers a handler routine for processing the header. This continues to work when an R function is provided as for the headerfunction option, but will not work correctly if a routine is provided for the headerfunction option. Updates to deal with encoding of strings. The basic text gathering function (used as the argument for write and the curl option writefunction) returns nchar(, "bytes") which may be more than the number of characters in an encoded string. Replaced internal calls to allocString() with mkCharLenCE() when available (i.e. R >= 2.8.0), or explicitly copy the string given to us from libcurl and create an encoded character string.: This has some quite rich/advanced examples that should be available to people and also take some time to run during R CMD check.
Allow for an .encoding parameter in getURL()/getURI() for explicitly specifying the encoding of the response from the HTTP. A mechanism that reads the HTTP response header and finds the Content-Type field and attempts to infer the encoding of the response. Note that this registers a handler routine for processing the header. This continues to work when an R function is provided as for the headerfunction option, but will not work correctly if a routine is provided for the headerfunction option. Updates to deal with encoding of strings. The basic text gathering function (used as the argument for write and the curl option writefunction) returns nchar(, "bytes") which may be more than the number of characters in an encoded string. Replaced internal calls to allocString() with mkCharLenCE() when available (i.e. R >= 2.8.0), or explicitly copy the string given to us from libcurl and create an encoded character string.
A mechanism that reads the HTTP response header and finds the Content-Type field and attempts to infer the encoding of the response. Note that this registers a handler routine for processing the header. This continues to work when an R function is provided as for the headerfunction option, but will not work correctly if a routine is provided for the headerfunction option. Updates to deal with encoding of strings. The basic text gathering function (used as the argument for write and the curl option writefunction) returns nchar(, "bytes") which may be more than the number of characters in an encoded string. Replaced internal calls to allocString() with mkCharLenCE() when available (i.e. R >= 2.8.0), or explicitly copy the string given to us from libcurl and create an encoded character string.: Note that this registers a handler routine for processing the header. This continues to work when an R function is provided as for the headerfunction option, but will not work correctly if a routine is provided for the headerfunction option.
Updates to deal with encoding of strings. The basic text gathering function (used as the argument for write and the curl option writefunction) returns nchar(, "bytes") which may be more than the number of characters in an encoded string. Replaced internal calls to allocString() with mkCharLenCE() when available (i.e. R >= 2.8.0), or explicitly copy the string given to us from libcurl and create an encoded character string.: The basic text gathering function (used as the argument for write and the curl option writefunction) returns nchar(, "bytes") which may be more than the number of characters in an encoded string.
Replaced internal calls to allocString() with mkCharLenCE() when available (i.e. R >= 2.8.0), or explicitly copy the string given to us from libcurl and create an encoded character string.

0.8-3

Support for CURLOPT_POST and using application/x-www-form-urlencoded as the Content-Type in POST'ing a form. This is controlled via the style parameter in postForm. Construct body of a form-urlencoded POST in R with the relevant escaping.
Construct body of a form-urlencoded POST in R with the relevant escaping.

0.8-1

Added code to support the new hashing of strings in R-devel (for what will be 2.6.0). Bug fix which caused segmentation faults when external pointer objects were used as options for curl. Allow dynamic symbol lookup in the RCurl DLL/SO to permit the use of routines such as R_curl_write_binary_data.
Bug fix which caused segmentation faults when external pointer objects were used as options for curl. Allow dynamic symbol lookup in the RCurl DLL/SO to permit the use of routines such as R_curl_write_binary_data.
Allow dynamic symbol lookup in the RCurl DLL/SO to permit the use of routines such as R_curl_write_binary_data.

0.7-0

Added support for base64 encoding and decoding using the code from libcurl (copyright See the file COPYING.: See the file COPYING.

0.7-0

Added mechanism and example for reading binary data from a request. This is not connected to R's connection mechanism as the API for that is not public and external extensions (i.e. via packages) are not feasible. (R's internals are not object oriented; one must work through the interpreted language even if working directly in compiled languages.) This is useful for handling gzip/bzip2 files, images, etc. To uncompress such in-memory data directly, see the Rcompression package. fileUpload() function and mechanism for specifying details about a file whose contents are to be included in a form submission via postForm.: This is not connected to R's connection mechanism as the API for that is not public and external extensions (i.e. via packages) are not feasible. (R's internals are not object oriented; one must work through the interpreted language even if working directly in compiled languages.)
This is useful for handling gzip/bzip2 files, images, etc. To uncompress such in-memory data directly, see the Rcompression package.
fileUpload() function and mechanism for specifying details about a file whose contents are to be included in a form submission via postForm.

0.6-4

Fix the problem identified by Seth Falcon of releasing/free'ing an R function object in the RCurl memory management. Added a type to the RCurlMemory structure so we know when we should R_Release() an object. Probably will also duplicate such functions when preserving them.: Added a type to the RCurlMemory structure so we know when we should R_Release() an object. Probably will also duplicate such functions when preserving them.

0.6-3

Introduced mechanism for converting options to target types, including enumerated values.: Works for netrc option and extensible for any of the values.
Added support for specifying an R function or C routine for the SSL_CTX_FUNCTION option.
Accept a logical value from the R function used for the write callback. FALSE indicates an error and TRUE means that the function processed the text successfully.
Fixed bug in memory management and garbage collection of the curl handles.

0.6-2

Further changes re postForm() with a curl handle provided.: Problem was NULL for httppost setting.

0.6-1

Fixed type in postForm() that caused error when a curl handle was specified.: Name matching in ... of curlSetOpt() caught the cur which should have been curl. Thanks to Jim McDonal for catching this one and using the curl handle mechanism for repeated calls.

0.6-0

Allow C routines to be passed as values for the CURL options that can be R functions. Use getNativeSymbolInfo(routine, package)$address to identify the routine. Support for concurrent, asynchronous HTTP requests using the curl_multi interface. See the examples in tests/ or on the Web: concurrent nestedHTML xmlParse
Support for concurrent, asynchronous HTTP requests using the curl_multi interface.: See the examples in tests/ or on the Web:

concurrent

nestedHTML

xmlParse

0.5-3

Fixed the SSL example in getURL to turn off verification of the peer, i.e. getURL('https://sourceforge.net', ssl.verifypeer = FALSE)

0.5-2

Fix for R-devel and counting of \0's in strings for the length.

0.5-1

When POSTing a form, only the first string in each element of the list was written to the body of the form. In other words, multi-valued elements such as for checkboxes with several elements selected were mishandled.

0.5-0

Internal correction for passing numbers as options.: Manifested itself with progress function not being called.

0.4-0

Use the return value from a CURLOPT_WRITEFUNCTION This allows the user to raise an error. Support the CURLOPT_PROGRESSFUNCTION CURL_CFLAGS and CURL_LIBS computed in configure so as to handle no-GNU versions of make.: This allows the user to raise an error.
Support the CURLOPT_PROGRESSFUNCTION CURL_CFLAGS and CURL_LIBS computed in configure so as to handle no-GNU versions of make.
CURL_CFLAGS and CURL_LIBS computed in configure so as to handle no-GNU versions of make.

0.3-0

Ensure that parameters for postForm are a list when passed to C code.

Duncan Temple Lang <duncan@wald.ucdavis.edu>

Last modified: Sat Aug 22 06:27:49 PDT 2009