Pelican Releases
V7.10
Highlights
For Users
- [Documentation] Updated documentation structure #1423
- [Client] Stopped file transfers are now retryable errors #1101
- [Client] General improvements to error messages within the client and the plugin, ensuring more accurate errors and removing redundancies
- [Client] Put requests using the pelican client work now with Origins using OA4MP Issuers #1490
- [Client] Retries metadata lookup failures #1514
- [Client] Fixed naming issue with queries on get/copy #1541
For Admins
- [Director] Director now supports intelligent server sorting method to consider distance, server load, and object availability #1470
- [Director] Add object availability test for cache access #1454
- [Director] Allow caches to fetch objects from other caches when there’s a cache miss #1457
- [Origin/Cache/Registry] Site name is now populated in the Origin/Cache auto-registration process #1460
- [Origin/Cache/Director] Origins and Caches now advertise their storage backend type to the director and are able to control if they want to receive director-based object transfer tests #1462
Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.9.0...v7.10.0
v7.10.7
[plugin] Fix bug where transfer plugin fails if there is no $HOME directory set
v7.10.6
Director: Selectively enable client X509 authentication
v7.10.5
Changelog
- 842c2a57 Update xrdcl-pelican to v0.9.4
v7.10.4
Changelog
- [Director] e40950e3 Fix topology downtime integration by using downtime URL and not ns JSON
v7.10.3
Changelog
- d29e1d2b Origins now have directreads on by default
- 6f5341f3 Pre Release: Update npm version
- a8189e09 Update S3 backend to v0.1.6
v7.10.2
Changelog
- aebe31a6 Pre Release: Update npm version
v7.10.1
- [Origin] Origins now have directress enabled by default
V7.9
Highlights
Congratulations to @patrickbrophy for his first contribution to Pelican!
For Users
- [Client] Clients can now read the PELICAN_NEAREST_CACHE environment variable for determining which cache to use #1234
- [Client] Clients can now list a collection of objects and get statistics of an object #1393 #1400
- [Plugin] The plugin now advertises the ability to move
pelican://
objects #1265 - [Client] Additional error handling has been introduced that helps users build custom clients on top of the Pelican golang libraries #1263
- [Client] Clients can now send a timeout value in their object requests, indicating to Pelican services the maximum time the client is willing to wait for requests #1299
- [Cache/Client] Caches now report to clients whether the data they returned came from the disk on the cache or from the origin #1301
- [All] Pelican now warns users about unrecognized configuration input #1325
For Admins
- [Cache] Caches no longer shutdown on startup if advertisements fail, allowing admins to fix registrations #1244
- [Director/Cache] The director can now filter caches marked as down in Topology #1260
- [Origin] Pelican can now create "XRoot" backends for adding xroot-only protocol servers to the federation #1285
- [Origin] HTTP backend export information has been added to Origin webpages #1291
- [Origin] Origins can now export Globus collections as one of their backends #1336
- [Director] The Director only responds to object requests with up to six Origin/Cache candidates #1304
- [All] Pelican images are now built on top of EL9 from the OSG23 repositories #1288
- [All] Servers now have a more permissive 5s timeout when checking for the existence of required remote resources #1328
- [Director] The Director now checks object availability among Origins for object requests sent to Origins #1283
- [All] Pelican now supports layered configuration through the specification of extra config directories in the root config using the
ConfigLocations
key #1313
Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.8.0...v7.9.0
v7.9.9
Changelog
- [Director]: Fix a memory explosion in the Director caused by unbound Prometheus logging.
v7.9.8
Changelog
- [Director]: Bug fixes to
stat
capabilities in the Director - [Director]: Increase
stat
timeouts from 300ms to 1s.
v7.9.7
Changelog
- [Client]: Fixed a bug that could cause high-concurrency downloads to stall
- [Client]: Fixed destination filename for 'unpack' mode
- [Client]: Populate director information for stash:// URLs
v7.9.6
Changelog
- [Origins]: Update S3 backend version to correctly handle S3 resource URLs with a configured path component
v7.9.5
Changelog
- [Director/Client]: Add X-Pelican-[Authorization/Token-Generation] headers to origin redirects triggered by client requests. This fixes cases where
pelican object put
is unable to generate a token due to the missing headers.
v7.9.4
Changelog
- [Servers] Make server startup timeout configurable
v7.9.3
Changelog
- [Director]: Bug fixes in
stat
code so that the Director stats against the correct URL for authenticated Topology origins.
v7.9.2
Highlights
Congratulations to @patrickbrophy for his first contribution to Pelican!
For Users
- [Client] Clients can now read the PELICAN_NEAREST_CACHE environment variable for determining which cache to use #1234
- [Client] Clients can now list a collection of objects and get statistics of an object #1393 #1400
- [Plugin] The plugin now advertises the ability to move
pelican://
objects #1265 - [Client] Additional error handling has been introduced that helps users build custom clients on top of the Pelican golang libraries #1263
- [Client] Clients can now send a timeout value in their object requests, indicating to Pelican services the maximum time the client is willing to wait for requests #1299
- [Cache/Client] Caches now report to clients whether the data they returned came from the disk on the cache or from the origin #1301
- [All] Pelican now warns users about unrecognized configuration input #1325
For Admins
- [Cache] Caches no longer shutdown on startup if advertisements fail, allowing admins to fix registrations #1244
- [Director/Cache] The director can now filter caches marked as down in Topology #1260
- [Origin] Pelican can now create "XRoot" backends for adding xroot-only protocol servers to the federation #1285
- [Origin] HTTP backend export information has been added to Origin webpages #1291
- [Origin] Origins can now export Globus collections as one of their backends #1336
- [Director] The Director only responds to object requests with up to six Origin/Cache candidates #1304
- [All] Pelican images are now built on top of EL9 from the OSG23 repositories #1288
- [All] Servers now have a more permissive 5s timeout when checking for the existence of required remote resources #1328
- [Director] The Director now checks object availability among Origins for object requests sent to Origins #1283
- [All] Pelican now supports layered configuration through the specification of extra config directories in the root config using the
ConfigLocations
key #1313 - [All] Fixed a bug that prevented some
PELICAN_*
environment variables from being read correctly #1451
Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.8.0...v7.9.2
v7.9.1
Changelog
- d18dd643 Add config knob to enable pprof endpoints
- 2b1a1c2f Add config knob to turn off
stat
for the director - c8982a6d Add pprof endpoints
- 3ca0f14d Add two Prometheus metrics for director
stat
queries - 26f8e39f Change to use
EnableStat
instead - 559f64e9 Fix deadlock in
recordAd
andLaunchTTLCache
- aca7a484 Pre Release: Update npm version
- f49108fe Remove
stat
utils for caches as well
V7.8
Highlights
For Users
- [Client] Stopped file transfers are now retryable errors #1101
- [Client] General improvements to error messages within the client and the plugin, ensuring more accurate errors and removing redundancies
- [Client] The client can bypass the cache and download directly from the origin if a directread query parameter is set #1166
For Admins
- [Documentation] Added documentation on how to get the public key of a running origin #1078
- [Documentation] Added documentation on how to run pelican servers via docker containers #1089
- [Origin] Pelican origin token creation now respects the issuer flag #1135
- [Cache] Cache UI will now redirect to a login page for an unauthorized user #1103
- [Origin/Cache] Improved “site name” handling #1176
- [Director] Director JWKS cache no longer becomes invalid when the registry goes down #1119
- [Director] Added a prometheus metric keep track of the total number of advertisements to the director #1133
- [Director] Enable director login via OAuth #1150
- [Cache] Allow the cache xrootd to have multiple data/meta mount locations #1191
- [Director/Registry/Origin/Cache[ Read environment variables with PELICAN prefix for Pelican binaries with alias (stashcp and osdf) and deprecate alias-specific prefixes #1162
v7.8.9
Changelog
- Correct typo in map name to fix ad sorting/filtering and add unit test with real topology data
v7.8.8
Changelog
- Fix issue with filtering/consolidating multi-export topology origins
v7.8.7
Changelog
- Fix panic in Director
- Improve Director's error response to clients
v7.8.6
Changelog
Disable ZTN authentication on Pelican origins
v7.8.5
Changelog
Bug fixes to restore missing collections-url
when the Director is redirecting to a topology-only origin.
v7.8.4
Changelog
- bb74abb7 Adjust timeout test to reflect new timeout value
- e0dd8794 Build xrootd-multiuser from source in dev container
- 37beb73f Cleanup unstopped ticker in WaitUntilWorking
- 0dead744 Fix bug w/ client not working for WithToken option
- 06865b24 Increase
WaitUntilWorking
transfer timeout and adjust error message - ece8c4c7 Pre Release: Update npm version
v7.8.3
Changelog
- a92d4954 Add an XRoot storage backend
- 9c09ab14 Aggregate gin routes for Prometheus metrics
- 19d1c86c Cleanup missed linter item
- 6364cea7 Incorporate review feedback
- 4a026005 Pre Release: Update npm version
v7.8.2
Changelog
- 3d129f6e Concatenate multiple issuer names for the same issuer url
- f1a7028c Improve error reporting for cache self-test
- b0e78303 Improve scitoken generation error handling
- f10f7cad Pre Release: Update npm version
- d11c32d7 Pre Release: Update npm version
- 66d2dcee Pull sefl-test folder out from the director tests
- 8f5102c8 Use
Cache.LocalRoot
internally - 3a8652c2 Use
and
to connect two issuer names - 694b3524 Use externalWebUrl as the token issuer for self-tests
v7.8.1
Changelog
Fixed Cache shutting down if advertisement fails #1244 Plugin advertises PluginVersion with -classad #1252
V7.7
v7.7.7
Changelog
- Fix director memory leak (https://github.com/PelicanPlatform/pelican/pull/1237)
v7.7.6
Changelog
- Update S3 plugin in containers to fix segfault (#1207)
Note: This release only contains changes to Pelican Docker containers. For users who use binary or packaged version of Pelican, this release is the same as v7.7.5 release.