Downloaded 54 times
Uploaded bynihiliad
1,220 views
Auto-loading of Drupal CCK Nodes
David Naughton presented on using drush and custom PHP classes to implement an Extract, Transform, Load (ETL) process for automatically loading citation data from various sources into Drupal on a regular basis. The ETL process extracts citations from sources using custom extractor classes, transforms the raw data into Drupal-compatible formats using transformer classes, and loads the transformed data into Drupal nodes using a loader class. Drush commands are used to schedule the ETL process and pass configuration parameters to the PHP classes from the command line, allowing flexible scheduling via cron. This approach avoids issues with PHP memory limits and timeouts compared to using hook_cron directly in Drupal.