Pelican Logo
Pelican Platform
About
Software
Community
OSDF

Pelican Releases

V7.13

Pelican v7.13.0

Breaking Changes
Registry Upgrade Requirement

Pelican v7.13 Director is not compatible with older versions of the Registry. The Registry must be upgraded before upgrading the Director to ensure proper functionality.

New Features and Enhancements
Client
  • Improved detection and retry logic for clients that start transfers while the Director is down #1890
  • Added new prestage functionality in the client #1923
Cache, Director, Origin, Registry
  • Added pelican user and group along with some default directories for RPM installations #1856
  • Added a "restart" button in each server's web UI #1869
  • Added configuration knobs to increase server memory performance by limiting Prometheus cardinality #1887
  • Created a new config parameter, Server.HealthMonitoringPublic, to make the server's health monitoring endpoint public #1936
Cache
  • Disabled redirects for HTTP caches #1915
  • Added experimental patches that modify a cache's ability to monitor resources and keep track of purgeable objects #1926
Director
  • Created a Prometheus metric in the Director to track rejected cache/origin advertisements #1885
Origin
  • Enabled server-side key refreshing so that origins/caches can update their keys in the Registry #1748
Bugs Fixed
Director
  • Fixed issue with director tests failing due to the token being created using the director URL instead of the discovery URL #1936
Full Changelog

Compare v7.12.4...v7.13.0

V7.12

Pelican v7.12.0

Breaking Changes

[Cache] Corrected previously unsafe creation of namespace, meta and data directories in caches in #1709. This change may result in cache data invalidation, and will likely require manual intervention during upgrades. Failure to adjust the data hierarchy of existing caches could result in unintended data leaks or zombie data that can't be cleaned by the cache. If this affects you, please make sure you understand update requirements before beginning your upgrades.

New Features and Enhancements

[All] The config parameter Server.TLSCertificate has been deprecated in favor of Server.TLSCertificateChain to more clearly convey the contents of the file pointed to. The deprecated parameter should continue to function for the time being, but may removed in a future release. [All] Added a CLI tool pelican config for displaying and interacting with Pelican configuration in #1693. [All] Standardized and improved RPM packaging in #1666. [Director] Gave Directors the ability to collect Prometheus metrics for GeoIP resolution failures in #1772. [Director] Servers now advertise their version to the Director in #1753. [Director] Started displaying namespace capabilities in the Director in #1737. [Director] Improved Prometheus metrics for tracking the number of currently-advertising servers in #1684. [Director] Gave the ability for the Director to persist origin/cache downtime labels between restarts in #1673. [Origin] Gave S3 origins the ability to specify sentinel files in #1791. [Plugin] Allowed the plugin to detect when it is named pelican_plugin in addition to pelican_xfer_plugin in #1733.

Bugs Fixed

[Client] Cleaned up display of progress bars for object gets in the client in #1814. [Client] Fixed bug where object ls against namespaces that do not support listings caused nil pointer panics in #1710. [Client] Added additional client checks to prevent creation of empty objects with directory uploads in #1707. [Director] Fixed over-collection of server redirects in the Director's Prometheus database in #1743. [Director] Fixed OSDF Director startup bug that caused erroneous warnings/errors mentioning the proj label in #1708.

New Contributors

@alexandertuna made their first contribution in #1730 @mwestphall made their first contribution in #1791 @georgezzeng made their first contribution in #1727

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.11.8...v7.12.0

Bugs Fixed
  • [Caches] - Rebuilt containers to ingest xrdcl-pelican v1.0.5, which comes with additional segfault bugfixes.
  • [Origins] - Rebuilt containers to ingest upstream bugfixes for S3/HTTP origins.
Bugs Fixed
  • [Cache Containers] - Grabbed patched version of xrootd 5.7.2 to mitigate further segfault bugs related to caches that are handling many concurrent requests for non-existent objects.
Bugs Fixed

[Cache] - Fixed a broken dependency for our cache containers that prevented caches from fetching non-cached objects from origins. [Cache] - Updated an underlying library version to prevent caches from segfaulting when non-existent objects are requested. [Client] - Added extra handling for client PUTs to accept XRootD's new HTTP 201 response.

Known Bugs

[Director/Cache] - This release contains a known bug where the Director's test utility fails for caches. This shouldn't affect the cache's ability to function, but will result in the cache showing errors in the Director's Web interface.

NOTE

Containerized versions of this release were dead on arrival due to a broken dependency for xrdcl-pelican.

Bugs Fixed
  • [Servers] Restored the functionality of various tickers that had been erroneously stopped, preventing XRootD servers from refreshing some files like scitokens/auth config and preventing some metrics from being scraped by Prometheus.
  • [Caches] Updated caches' underlying version of xrdcl-pelican from 0.9.4 to 1.0.2, which prevents a segfault in caches whenever a non-existent object is requested.
Bugs Introduced
  • [Caches] The directorTest functionality will fail in caches due to the new xrdcl-pelican version until updates can be made in Directors. These test failures are limited in scope and should not affect the rest of the cache's functionality, but may generate excess noise in logs.

V7.11

Highlights

For Users
  • [Client] The client now supports object sync commands, which recursively syncs source and destinations #1586 #1691
  • [Client] ls -l and the -L flag for logging have switched behavior – ls -l now enables listings and -L is now the logging flag #1598
For Admins
  • [Director] The Director will now only enable x509 authentication for given selected prefixes #1563 #1624
  • [Origin] Issuer config has now been added to Origin webpages #1584
  • [Origin] Tokens are now auto generated if the issuer is available 1591
  • [Origin] Now allow HTTP backends for an Origin #1597
  • [Origin] Bug fixes for S3 origins with multiple virtual-style bucket exports #1601
  • [Director] GeoIP resolution failures are now recorded as Prometheus metrics #1608
  • [Director] Clients whose GeoIP resolution fails are now temporarily assigned a location within the continental US to improve followup cache selection. #1620
  • [Director/Origin] Prometheus metrics are now displayed on the Origin and Director Web UI #1623
  • [Registry] Admins can now delete a namespace from the Registry using the webpage #1626
  • [Director] There is now a director redirect metric displayed which keeps track of the number of redirects to an origin or a cache #1632
  • [All] Length of Prometheus metric retention is now configurable #1640
  • [Origin] S3 Origin performance/reliability enhancements #1681

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.11.0...v7.10.0

Bugs Fixed

Restored the functionality of various tickers that had been erroneously stopped, preventing XRootD servers from refreshing some files like scitokens/auth config.

Changelog
  • 03a49337 Updating fronend version number
Changelog
  • 95c363ca Fixed missing newline
  • f5e30f6d Fixing linter error that was added during rebase
  • 15b75c79 Removed calling the x509 test script until we can fix the functionality
  • 14634ae5 Removed the tsl defer functionality from the cache until we can fix it on the xrootd end
  • ebc49ff8 Update version frontend to 7.11.8
Changelog
  • 9810cbdf Bump frontend version to 7.11.7
  • d7857861 Fixed macos failing tests:
  • 62b413db Pinning the xrootd build in macos to a specific tag
  • e6771978 Revert "Removed new metrics that seem to causing Prometheus to use a very lar…"
  • 8353dd2a Revert "Removed the "network" labels from the metrics"
Changelog
  • 2dce0176 Removed new metrics that seem to causing Prometheus to use a very large amount of memory
  • b935faca Updated frontend version number
Changelog
  • be21bd24 Adjust ownership/perms of /usr/local ahead of time for MacOS test runner
  • a6be79ea Fixed linter error in director/sort.go
  • 61a30f29 Format
  • 15729b6d Prettier Format
  • e052a6fd Redirect app to root on success password
  • a5b49958 Remove the use of index.d.ts files
  • fa7cf4db Removed the "network" labels from the metrics
  • 7503842f Uniform Error Handling
  • 3d66971f Uniform Error Handling
  • 1a8af8f1 Uniform Error Handling
  • 24bad1be Update Error Handling
  • 31cbad2f Update MacOS GHA test env to fix deprecation error
  • 593323b8 Updated the web-ui package version
Changelog
  • c9cd02d5 Fixes an issue where a misplaced defer ticker.Stop() stopped the re-advertisement of caches/origins
  • 4ee13c06 Updated front-end version
Changelog
  • 5d333660 Revert "Switch to use new Caps struct but still handle old JSON from Director"
  • 26238933 Revert "Unmarshal Capabilities correctly in all structs that use them"
  • b3df1c87 Update the version number
Changelog
  • 7a096d57 Unmarshal Capabilities correctly in all structs that use them
  • 8629adaa Update the version number
Changelog
  • bc54370a Comment-out all origin export config
  • fa87b928 Drop old default origin port
  • 74888b40 First pass at default config.d based configuration
  • 50db1e25 Fix nil pointer bug caused by trying to list namespaces with no coll URL
  • 826da111 Move Pelican federation-facing config to an example file
  • c514ab57 Move Topology specific configuration to example file
  • 43d9b0d0 Move common OSDF config to the federation-level config dir
  • 9f9a09d0 Move common debugging configs to editable example file
  • b3861d18 Move multiuser origin config to an example file
  • 8dad09d8 Move origin export config to an example file
  • d83b4c4c Move web UI config to example file
  • a91a4335 Remove prescriptive cache / origin locations
  • 3beae08d Updated version to 7.11.1
CHTC Logo
Morgridge Logo

Branding

Contact Us

This project is supported by National Science Foundation under Cooperative Agreement OAC-2331480. Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.