Pelican Releases

[plugin] Fix bug where transfer plugin fails if there is no $HOME directory set

Director: Selectively enable client X509 authentication

Changelog

• 842c2a57 Update xrdcl-pelican to v0.9.4
  

Changelog

• [Director] e40950e3 Fix topology downtime integration by using downtime URL and not ns JSON
  

Changelog

• d29e1d2b Origins now have directreads on by default
  
• 6f5341f3 Pre Release: Update npm version
  
• a8189e09 Update S3 backend to v0.1.6
  

Changelog

• aebe31a6 Pre Release: Update npm version
  

• [Origin] Origins now have directress enabled by default
  

Changelog

• [Director]: Fix a memory explosion in the Director caused by unbound Prometheus logging.
  

Changelog

• [Director]: Bug fixes to stat capabilities in the Director
  
• [Director]: Increase stat timeouts from 300ms to 1s.
  

Changelog

• [Client]: Fixed a bug that could cause high-concurrency downloads to stall
  
• [Client]: Fixed destination filename for 'unpack' mode
  
• [Client]: Populate director information for stash:// URLs
  

Changelog

• [Origins]: Update S3 backend version to correctly handle S3 resource URLs with a configured path component
  

Changelog

• [Director/Client]: Add X-Pelican-[Authorization/Token-Generation] headers to origin redirects triggered by client requests. This fixes cases where pelican object put is unable to generate a token due to the missing headers.
  

Changelog

• [Servers] Make server startup timeout configurable
  

Changelog

• [Director]: Bug fixes in stat code so that the Director stats against the correct URL for authenticated Topology origins.
  

Highlights

Congratulations to @patrickbrophy for his first contribution to Pelican!

For Users

• [Client] Clients can now read the PELICAN_NEAREST_CACHE environment variable for determining which cache to use #1234
  
• [Client] Clients can now list a collection of objects and get statistics of an object #1393 #1400
  
• [Plugin] The plugin now advertises the ability to move pelican:// objects #1265
  
• [Client] Additional error handling has been introduced that helps users build custom clients on top of the Pelican golang libraries #1263
  
• [Client] Clients can now send a timeout value in their object requests, indicating to Pelican services the maximum time the client is willing to wait for requests #1299
  
• [Cache/Client] Caches now report to clients whether the data they returned came from the disk on the cache or from the origin #1301
  
• [All] Pelican now warns users about unrecognized configuration input #1325
  

For Admins

• [Cache] Caches no longer shutdown on startup if advertisements fail, allowing admins to fix registrations #1244
  
• [Director/Cache] The director can now filter caches marked as down in Topology #1260
  
• [Origin] Pelican can now create "XRoot" backends for adding xroot-only protocol servers to the federation #1285
  
• [Origin] HTTP backend export information has been added to Origin webpages #1291
  
• [Origin] Origins can now export Globus collections as one of their backends #1336
  
• [Director] The Director only responds to object requests with up to six Origin/Cache candidates #1304
  
• [All] Pelican images are now built on top of EL9 from the OSG23 repositories #1288
  
• [All] Servers now have a more permissive 5s timeout when checking for the existence of required remote resources #1328
  
• [Director] The Director now checks object availability among Origins for object requests sent to Origins #1283
  
• [All] Pelican now supports layered configuration through the specification of extra config directories in the root config using the ConfigLocations key #1313
  
• [All] Fixed a bug that prevented some PELICAN_* environment variables from being read correctly #1451
  

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.8.0...v7.9.2

Changelog

• d18dd643 Add config knob to enable pprof endpoints
  
• 2b1a1c2f Add config knob to turn off stat for the director
  
• c8982a6d Add pprof endpoints
  
• 3ca0f14d Add two Prometheus metrics for directorstat queries
  
• 26f8e39f Change to use EnableStat instead
  
• 559f64e9 Fix deadlock in recordAd and LaunchTTLCache
  
• aca7a484 Pre Release: Update npm version
  
• f49108fe Remove stat utils for caches as well
  

Changelog

• Correct typo in map name to fix ad sorting/filtering and add unit test with real topology data
  

Changelog

• Fix issue with filtering/consolidating multi-export topology origins
  

Changelog

• Fix panic in Director
  
• Improve Director's error response to clients
  

Changelog

Disable ZTN authentication on Pelican origins

Changelog

Bug fixes to restore missing collections-url when the Director is redirecting to a topology-only origin.

Changelog

• bb74abb7 Adjust timeout test to reflect new timeout value
  
• e0dd8794 Build xrootd-multiuser from source in dev container
  
• 37beb73f Cleanup unstopped ticker in WaitUntilWorking
  
• 0dead744 Fix bug w/ client not working for WithToken option
  
• 06865b24 Increase WaitUntilWorking transfer timeout and adjust error message
  
• ece8c4c7 Pre Release: Update npm version
  

Changelog

• a92d4954 Add an XRoot storage backend
  
• 9c09ab14 Aggregate gin routes for Prometheus metrics
  
• 19d1c86c Cleanup missed linter item
  
• 6364cea7 Incorporate review feedback
  
• 4a026005 Pre Release: Update npm version
  

Changelog

• 3d129f6e Concatenate multiple issuer names for the same issuer url
  
• f1a7028c Improve error reporting for cache self-test
  
• b0e78303 Improve scitoken generation error handling
  
• f10f7cad Pre Release: Update npm version
  
• d11c32d7 Pre Release: Update npm version
  
• 66d2dcee Pull sefl-test folder out from the director tests
  
• 8f5102c8 Use Cache.LocalRoot internally
  
• 3a8652c2 Use and to connect two issuer names
  
• 694b3524 Use externalWebUrl as the token issuer for self-tests
  

Changelog

Fixed Cache shutting down if advertisement fails #1244 Plugin advertises PluginVersion with -classad #1252

Changelog

• Fix director memory leak (https://github.com/PelicanPlatform/pelican/pull/1237)
  

Changelog

• Update S3 plugin in containers to fix segfault (#1207)
  

Note: This release only contains changes to Pelican Docker containers. For users who use binary or packaged version of Pelican, this release is the same as v7.7.5 release.