Pelican Logo
Pelican Platform

Pelican Releases


V7.10

Highlights

For Users
  • [Documentation] Updated documentation structure #1423
  • [Client] Stopped file transfers are now retryable errors #1101
  • [Client] General improvements to error messages within the client and the plugin, ensuring more accurate errors and removing redundancies
  • [Client] Put requests using the pelican client work now with Origins using OA4MP Issuers #1490
  • [Client] Retries metadata lookup failures #1514
  • [Client] Fixed naming issue with queries on get/copy #1541
For Admins
  • [Director] Director now supports intelligent server sorting method to consider distance, server load, and object availability #1470
  • [Director] Add object availability test for cache access #1454
  • [Director] Allow caches to fetch objects from other caches when there’s a cache miss #1457
  • [Origin/Cache/Registry] Site name is now populated in the Origin/Cache auto-registration process #1460
  • [Origin/Cache/Director] Origins and Caches now advertise their storage backend type to the director and are able to control if they want to receive director-based object transfer tests #1462

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.9.0...v7.10.0

[plugin] Fix bug where transfer plugin fails if there is no $HOME directory set

Director: Selectively enable client X509 authentication

Changelog
  • 842c2a57 Update xrdcl-pelican to v0.9.4
Changelog
  • [Director] e40950e3 Fix topology downtime integration by using downtime URL and not ns JSON
Changelog
  • d29e1d2b Origins now have directreads on by default
  • 6f5341f3 Pre Release: Update npm version
  • a8189e09 Update S3 backend to v0.1.6
Changelog
  • aebe31a6 Pre Release: Update npm version
  • [Origin] Origins now have directress enabled by default

V7.9

Highlights

Congratulations to @patrickbrophy for his first contribution to Pelican!

For Users
  • [Client] Clients can now read the PELICAN_NEAREST_CACHE environment variable for determining which cache to use #1234
  • [Client] Clients can now list a collection of objects and get statistics of an object #1393 #1400
  • [Plugin] The plugin now advertises the ability to move pelican:// objects #1265
  • [Client] Additional error handling has been introduced that helps users build custom clients on top of the Pelican golang libraries #1263
  • [Client] Clients can now send a timeout value in their object requests, indicating to Pelican services the maximum time the client is willing to wait for requests #1299
  • [Cache/Client] Caches now report to clients whether the data they returned came from the disk on the cache or from the origin #1301
  • [All] Pelican now warns users about unrecognized configuration input #1325
For Admins
  • [Cache] Caches no longer shutdown on startup if advertisements fail, allowing admins to fix registrations #1244
  • [Director/Cache] The director can now filter caches marked as down in Topology #1260
  • [Origin] Pelican can now create "XRoot" backends for adding xroot-only protocol servers to the federation #1285
  • [Origin] HTTP backend export information has been added to Origin webpages #1291
  • [Origin] Origins can now export Globus collections as one of their backends #1336
  • [Director] The Director only responds to object requests with up to six Origin/Cache candidates #1304
  • [All] Pelican images are now built on top of EL9 from the OSG23 repositories #1288
  • [All] Servers now have a more permissive 5s timeout when checking for the existence of required remote resources #1328
  • [Director] The Director now checks object availability among Origins for object requests sent to Origins #1283
  • [All] Pelican now supports layered configuration through the specification of extra config directories in the root config using the ConfigLocations key #1313

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.8.0...v7.9.0

Changelog
  • [Director]: Fix a memory explosion in the Director caused by unbound Prometheus logging.
Changelog
  • [Director]: Bug fixes to stat capabilities in the Director
  • [Director]: Increase stat timeouts from 300ms to 1s.
Changelog
  • [Client]: Fixed a bug that could cause high-concurrency downloads to stall
  • [Client]: Fixed destination filename for 'unpack' mode
  • [Client]: Populate director information for stash:// URLs
Changelog
  • [Origins]: Update S3 backend version to correctly handle S3 resource URLs with a configured path component
Changelog
  • [Director/Client]: Add X-Pelican-[Authorization/Token-Generation] headers to origin redirects triggered by client requests. This fixes cases where pelican object put is unable to generate a token due to the missing headers.
Changelog
  • [Servers] Make server startup timeout configurable
Changelog
  • [Director]: Bug fixes in stat code so that the Director stats against the correct URL for authenticated Topology origins.

Highlights

Congratulations to @patrickbrophy for his first contribution to Pelican!

For Users
  • [Client] Clients can now read the PELICAN_NEAREST_CACHE environment variable for determining which cache to use #1234
  • [Client] Clients can now list a collection of objects and get statistics of an object #1393 #1400
  • [Plugin] The plugin now advertises the ability to move pelican:// objects #1265
  • [Client] Additional error handling has been introduced that helps users build custom clients on top of the Pelican golang libraries #1263
  • [Client] Clients can now send a timeout value in their object requests, indicating to Pelican services the maximum time the client is willing to wait for requests #1299
  • [Cache/Client] Caches now report to clients whether the data they returned came from the disk on the cache or from the origin #1301
  • [All] Pelican now warns users about unrecognized configuration input #1325
For Admins
  • [Cache] Caches no longer shutdown on startup if advertisements fail, allowing admins to fix registrations #1244
  • [Director/Cache] The director can now filter caches marked as down in Topology #1260
  • [Origin] Pelican can now create "XRoot" backends for adding xroot-only protocol servers to the federation #1285
  • [Origin] HTTP backend export information has been added to Origin webpages #1291
  • [Origin] Origins can now export Globus collections as one of their backends #1336
  • [Director] The Director only responds to object requests with up to six Origin/Cache candidates #1304
  • [All] Pelican images are now built on top of EL9 from the OSG23 repositories #1288
  • [All] Servers now have a more permissive 5s timeout when checking for the existence of required remote resources #1328
  • [Director] The Director now checks object availability among Origins for object requests sent to Origins #1283
  • [All] Pelican now supports layered configuration through the specification of extra config directories in the root config using the ConfigLocations key #1313
  • [All] Fixed a bug that prevented some PELICAN_* environment variables from being read correctly #1451

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.8.0...v7.9.2

Changelog
  • d18dd643 Add config knob to enable pprof endpoints
  • 2b1a1c2f Add config knob to turn off stat for the director
  • c8982a6d Add pprof endpoints
  • 3ca0f14d Add two Prometheus metrics for directorstat queries
  • 26f8e39f Change to use EnableStat instead
  • 559f64e9 Fix deadlock in recordAd and LaunchTTLCache
  • aca7a484 Pre Release: Update npm version
  • f49108fe Remove stat utils for caches as well

V7.8

Highlights

For Users
  • [Client] Stopped file transfers are now retryable errors #1101
  • [Client] General improvements to error messages within the client and the plugin, ensuring more accurate errors and removing redundancies
  • [Client] The client can bypass the cache and download directly from the origin if a directread query parameter is set #1166
For Admins
  • [Documentation] Added documentation on how to get the public key of a running origin #1078
  • [Documentation] Added documentation on how to run pelican servers via docker containers #1089
  • [Origin] Pelican origin token creation now respects the issuer flag #1135
  • [Cache] Cache UI will now redirect to a login page for an unauthorized user #1103
  • [Origin/Cache] Improved “site name” handling #1176
  • [Director] Director JWKS cache no longer becomes invalid when the registry goes down #1119
  • [Director] Added a prometheus metric keep track of the total number of advertisements to the director #1133
  • [Director] Enable director login via OAuth #1150
  • [Cache] Allow the cache xrootd to have multiple data/meta mount locations #1191
  • [Director/Registry/Origin/Cache[ Read environment variables with PELICAN prefix for Pelican binaries with alias (stashcp and osdf) and deprecate alias-specific prefixes #1162
Changelog
  • Correct typo in map name to fix ad sorting/filtering and add unit test with real topology data
Changelog
  • Fix issue with filtering/consolidating multi-export topology origins
Changelog
  • Fix panic in Director
  • Improve Director's error response to clients
Changelog

Disable ZTN authentication on Pelican origins

Changelog

Bug fixes to restore missing collections-url when the Director is redirecting to a topology-only origin.

Changelog
  • bb74abb7 Adjust timeout test to reflect new timeout value
  • e0dd8794 Build xrootd-multiuser from source in dev container
  • 37beb73f Cleanup unstopped ticker in WaitUntilWorking
  • 0dead744 Fix bug w/ client not working for WithToken option
  • 06865b24 Increase WaitUntilWorking transfer timeout and adjust error message
  • ece8c4c7 Pre Release: Update npm version
Changelog
  • a92d4954 Add an XRoot storage backend
  • 9c09ab14 Aggregate gin routes for Prometheus metrics
  • 19d1c86c Cleanup missed linter item
  • 6364cea7 Incorporate review feedback
  • 4a026005 Pre Release: Update npm version
Changelog
  • 3d129f6e Concatenate multiple issuer names for the same issuer url
  • f1a7028c Improve error reporting for cache self-test
  • b0e78303 Improve scitoken generation error handling
  • f10f7cad Pre Release: Update npm version
  • d11c32d7 Pre Release: Update npm version
  • 66d2dcee Pull sefl-test folder out from the director tests
  • 8f5102c8 Use Cache.LocalRoot internally
  • 3a8652c2 Use and to connect two issuer names
  • 694b3524 Use externalWebUrl as the token issuer for self-tests
Changelog

Fixed Cache shutting down if advertisement fails #1244 Plugin advertises PluginVersion with -classad #1252

V7.7

Changelog

  • Fix director memory leak (https://github.com/PelicanPlatform/pelican/pull/1237)

Changelog

  • Update S3 plugin in containers to fix segfault (#1207)

Note: This release only contains changes to Pelican Docker containers. For users who use binary or packaged version of Pelican, this release is the same as v7.7.5 release.

CHTC Logo

Branding

This project is supported by National Science Foundation under Cooperative Agreement OAC-2331480. Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.