Pelican Logo
Pelican Platform

Pelican Releases


V7.10

Highlights

For Users
  • [Documentation] Updated documentation structure #1423
  • [Client] Stopped file transfers are now retryable errors #1101
  • [Client] General improvements to error messages within the client and the plugin, ensuring more accurate errors and removing redundancies
  • [Client] Put requests using the pelican client work now with Origins using OA4MP Issuers #1490
  • [Client] Retries metadata lookup failures #1514
  • [Client] Fixed naming issue with queries on get/copy #1541
For Admins
  • [Director] Director now supports intelligent server sorting method to consider distance, server load, and object availability #1470
  • [Director] Add object availability test for cache access #1454
  • [Director] Allow caches to fetch objects from other caches when there’s a cache miss #1457
  • [Origin/Cache/Registry] Site name is now populated in the Origin/Cache auto-registration process #1460
  • [Origin/Cache/Director] Origins and Caches now advertise their storage backend type to the director and are able to control if they want to receive director-based object transfer tests #1462

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.9.0...v7.10.0

Changelog
  • ca3d0abf Move sssd-client installation to final stage builder
Changelog
  • a7b05d8c Install sssd-client in dev/prod containers
Changelog
  • 156743fd Don't construct Pelican URLs for stashcp copies

[plugin] Fix bug where transfer plugin fails if there is no $HOME directory set

Director: Selectively enable client X509 authentication

Changelog
  • 842c2a57 Update xrdcl-pelican to v0.9.4
Changelog
  • [Director] e40950e3 Fix topology downtime integration by using downtime URL and not ns JSON
Changelog
  • d29e1d2b Origins now have directreads on by default
  • 6f5341f3 Pre Release: Update npm version
  • a8189e09 Update S3 backend to v0.1.6
Changelog
  • aebe31a6 Pre Release: Update npm version
  • [Origin] Origins now have directress enabled by default

V7.9

Highlights

Congratulations to @patrickbrophy for his first contribution to Pelican!

For Users
  • [Client] Clients can now read the PELICAN_NEAREST_CACHE environment variable for determining which cache to use #1234
  • [Client] Clients can now list a collection of objects and get statistics of an object #1393 #1400
  • [Plugin] The plugin now advertises the ability to move pelican:// objects #1265
  • [Client] Additional error handling has been introduced that helps users build custom clients on top of the Pelican golang libraries #1263
  • [Client] Clients can now send a timeout value in their object requests, indicating to Pelican services the maximum time the client is willing to wait for requests #1299
  • [Cache/Client] Caches now report to clients whether the data they returned came from the disk on the cache or from the origin #1301
  • [All] Pelican now warns users about unrecognized configuration input #1325
For Admins
  • [Cache] Caches no longer shutdown on startup if advertisements fail, allowing admins to fix registrations #1244
  • [Director/Cache] The director can now filter caches marked as down in Topology #1260
  • [Origin] Pelican can now create "XRoot" backends for adding xroot-only protocol servers to the federation #1285
  • [Origin] HTTP backend export information has been added to Origin webpages #1291
  • [Origin] Origins can now export Globus collections as one of their backends #1336
  • [Director] The Director only responds to object requests with up to six Origin/Cache candidates #1304
  • [All] Pelican images are now built on top of EL9 from the OSG23 repositories #1288
  • [All] Servers now have a more permissive 5s timeout when checking for the existence of required remote resources #1328
  • [Director] The Director now checks object availability among Origins for object requests sent to Origins #1283
  • [All] Pelican now supports layered configuration through the specification of extra config directories in the root config using the ConfigLocations key #1313

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.8.0...v7.9.0

Changelog
  • [Director]: Fix a memory explosion in the Director caused by unbound Prometheus logging.
Changelog
  • [Director]: Bug fixes to stat capabilities in the Director
  • [Director]: Increase stat timeouts from 300ms to 1s.
Changelog
  • [Client]: Fixed a bug that could cause high-concurrency downloads to stall
  • [Client]: Fixed destination filename for 'unpack' mode
  • [Client]: Populate director information for stash:// URLs
Changelog
  • [Origins]: Update S3 backend version to correctly handle S3 resource URLs with a configured path component
Changelog
  • [Director/Client]: Add X-Pelican-[Authorization/Token-Generation] headers to origin redirects triggered by client requests. This fixes cases where pelican object put is unable to generate a token due to the missing headers.
Changelog
  • [Servers] Make server startup timeout configurable
Changelog
  • [Director]: Bug fixes in stat code so that the Director stats against the correct URL for authenticated Topology origins.

Highlights

Congratulations to @patrickbrophy for his first contribution to Pelican!

For Users
  • [Client] Clients can now read the PELICAN_NEAREST_CACHE environment variable for determining which cache to use #1234
  • [Client] Clients can now list a collection of objects and get statistics of an object #1393 #1400
  • [Plugin] The plugin now advertises the ability to move pelican:// objects #1265
  • [Client] Additional error handling has been introduced that helps users build custom clients on top of the Pelican golang libraries #1263
  • [Client] Clients can now send a timeout value in their object requests, indicating to Pelican services the maximum time the client is willing to wait for requests #1299
  • [Cache/Client] Caches now report to clients whether the data they returned came from the disk on the cache or from the origin #1301
  • [All] Pelican now warns users about unrecognized configuration input #1325
For Admins
  • [Cache] Caches no longer shutdown on startup if advertisements fail, allowing admins to fix registrations #1244
  • [Director/Cache] The director can now filter caches marked as down in Topology #1260
  • [Origin] Pelican can now create "XRoot" backends for adding xroot-only protocol servers to the federation #1285
  • [Origin] HTTP backend export information has been added to Origin webpages #1291
  • [Origin] Origins can now export Globus collections as one of their backends #1336
  • [Director] The Director only responds to object requests with up to six Origin/Cache candidates #1304
  • [All] Pelican images are now built on top of EL9 from the OSG23 repositories #1288
  • [All] Servers now have a more permissive 5s timeout when checking for the existence of required remote resources #1328
  • [Director] The Director now checks object availability among Origins for object requests sent to Origins #1283
  • [All] Pelican now supports layered configuration through the specification of extra config directories in the root config using the ConfigLocations key #1313
  • [All] Fixed a bug that prevented some PELICAN_* environment variables from being read correctly #1451

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.8.0...v7.9.2

Changelog
  • d18dd643 Add config knob to enable pprof endpoints
  • 2b1a1c2f Add config knob to turn off stat for the director
  • c8982a6d Add pprof endpoints
  • 3ca0f14d Add two Prometheus metrics for directorstat queries
  • 26f8e39f Change to use EnableStat instead
  • 559f64e9 Fix deadlock in recordAd and LaunchTTLCache
  • aca7a484 Pre Release: Update npm version
  • f49108fe Remove stat utils for caches as well

V7.8

Changelog
  • Correct typo in map name to fix ad sorting/filtering and add unit test with real topology data
Changelog
  • Fix issue with filtering/consolidating multi-export topology origins
Changelog
  • Fix panic in Director
  • Improve Director's error response to clients
Changelog

Disable ZTN authentication on Pelican origins

Changelog

Bug fixes to restore missing collections-url when the Director is redirecting to a topology-only origin.

Changelog
  • bb74abb7 Adjust timeout test to reflect new timeout value
  • e0dd8794 Build xrootd-multiuser from source in dev container
  • 37beb73f Cleanup unstopped ticker in WaitUntilWorking
  • 0dead744 Fix bug w/ client not working for WithToken option
  • 06865b24 Increase WaitUntilWorking transfer timeout and adjust error message
  • ece8c4c7 Pre Release: Update npm version
Changelog
  • a92d4954 Add an XRoot storage backend
  • 9c09ab14 Aggregate gin routes for Prometheus metrics
  • 19d1c86c Cleanup missed linter item
  • 6364cea7 Incorporate review feedback
  • 4a026005 Pre Release: Update npm version
Changelog
  • 3d129f6e Concatenate multiple issuer names for the same issuer url
  • f1a7028c Improve error reporting for cache self-test
  • b0e78303 Improve scitoken generation error handling
  • f10f7cad Pre Release: Update npm version
  • d11c32d7 Pre Release: Update npm version
  • 66d2dcee Pull sefl-test folder out from the director tests
  • 8f5102c8 Use Cache.LocalRoot internally
  • 3a8652c2 Use and to connect two issuer names
  • 694b3524 Use externalWebUrl as the token issuer for self-tests
Changelog

Fixed Cache shutting down if advertisement fails #1244 Plugin advertises PluginVersion with -classad #1252

CHTC Logo

Branding

This project is supported by National Science Foundation under Cooperative Agreement OAC-2331480. Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.