Pelican Logo
Pelican Platform

Release

v7.1.2

Download

What's Changed

  • Allow Pelican to run in some settings where $HOME is not defined @jhiemstrawisc in https://github.com/PelicanPlatform/pelican/pull/238

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.1.1...v7.1.2

Pelican v7.19.5

Pelican v7.19.5 fixes a Cache bug that results in unresponsive Caches.

Bugs Fixed

  • [Cache]: Upgraded the containerized xrdcl-pelican dependency to v1.5.6 to fix a Cache thread deadlock in #2688

Changelog

  • c3a376bb89d145d0192d5998fe9943c5589ff9e1 Changed version to 7.19.5

Changelog

  • 75177fc35a7de651097a57aac9f9f15cb2188cc9 Bump xrdcl-pelican to 1.5.6
  • 59645888b146ef4471dc22fd6cb550ba9f45c848 Update version to v7.19.4

Changelog

  • 9d16c1383a0e36ef7fe5447668d8ec49a2fb155f Bump version to 7.18.3-rc.2
  • c61daff790210ffeeacc99e1bb7a8e46bc20d934 Resolve merge conflict

Pelican v7.19.3 Release Notes

Bugs Fixed

  • [Client] Fixed a deadlock bug #2655
  • [Cache] Increased the monitoring eviction interval from 60ns to 60s #2662

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.19.2...v7.19.3

Changelog

  • 55720a7815fac903e2c9afac7a3e58a96df2f55a Fixed default to be 60s NOT 60ns
  • 53ef22d128961e7bd112c0bb3caa8d12c879ca0b Updated the version to v7.19.3-rc.1

Pelican v7.19.2 Release Notes

New Features and Enhancements

  • [Client] Prevent overwriting of objects on upload #2480
  • [Logging] Logs now don’t include ANSI color codes when going to non-terminals #2529
  • [Client] New error classification for slow origins #2559
  • [Origin] Added in a collections API to create mutable groupings of data #2550
  • [Client] Added --pack flag to get and put in the CLI #2549

Bugs Fixed

  • [Client] Fixed the race condition causing the failed to verify size bug #2533
  • [Client] Fix deadlock where results channel is not read after cancellation #2536
  • [Client] Fixed an issue where checksum requirements on put failed when not required #2546
  • [Client] Fix segfault in object get with pack=auto when destination directory doesn't exist #2561

Notes for Admins

  • Bumped xrdcl-pelican version to 1.5.4
  • Bumped XRootD to v5.8.4-1.2
  • [Federation Admin] Before upgrading Registry, finish the cleanup for site name, as explained in the “for Registry admin” section in #2558

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.19.1...v7.19.2

Bugs Fixed

  • [Cache] Use xrdcl-pelican 1.5.4 to fix deadlocks in Cache

Do Not Use This Release

This version contains inappropriate token issuer URL for Director <--> Origin/Cache health tests. Please use the latest version in Pelican v7.19 series instead.

Changelog

  • 33e5dc8355a1c682ac7d168e9f50bace9a9f6350 Bump xrdcl-pelican to v1.5.3
  • 2f65f78d989680446a34bd30678b8c744bea2662 Comment out the Federation.DiscoveryUrl from /etc/pelican/config.d/10-federation.yaml from the pelican-server RPM
  • fd034ac3f64739facdb281c0791ea5ee4ec6fb39 Updated xrdcl-pelican to 1.5.4
  • 8b45ce3a2365d8fa1aadd17c4a7fea0a2bf25029 Use namespace prefix token issuer as X-Pelican-Token-Generation issuer

Changelog

  • 2373c765267987d8b645584fdc9b0bd5120eda60 Bump version to 7.18.2-rc.3
  • bfb71350b2b069d36e7a7dc82e05cd5555c0ca43 Upgrade xrdcl-pelican version to 1.5.4

Changelog

  • 116a50ee3ab0afbd75053771f69aae51ebf82598 Bump version to 7.18.2-rc.2
  • 6f4796fe91be7826655f10789cf74f80c764ccf0 Upgrade xrdcl-pelican version to 1.5.3

Changelog

  • 812dfa62e8613c390db45600da82b05172af12fa Bump version to 7.18.2-rc.1
  • a5fa4ae7bfe0e614e083b2695c5a9dfc247976ca Remove xrdcl-pelican requirements

Pelican v7.19.0 Release Notes

New Features and Enhancements

  • [Client] Prevent overwriting of objects on upload #2480
  • [Logging] Logs now don’t include ANSI color codes when going to non-terminals #2529
  • [Client] New error classification for slow origins #2559
  • [Origin] Added in a collections API to create mutable groupings of data #2550
  • [Client] Added --pack flag to get and put in the CLI #2549

Bugs Fixed

  • [Client] Fixed the race condition causing the failed to verify size bug #2533
  • [Client] Fix deadlock where results channel is not read after cancellation #2536
  • [Client] Fixed an issue where checksum requirements on put failed when not required #2546
  • [Client] Fix segfault in object get with pack=auto when destination directory doesn't exist #2561

Notes for Admins

  • Bumped xrdcl-pelican version to 1.5.1
  • [Federation Admin] Before upgrading Registry, finish the cleanup for site name, as explained in the “for Registry admin” section in #2558
  • Bumped XRootD to v5.8.4-1.2

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.18.1...v7.19.0-rc.1

Bugs Fixed

  • [Client] pelican object put now only fails during the checksum process if we required a checksum in the transfer
  • [CLI] pelican config tool now takes environment variables into account
  • [Cache] DropPrivileges is now ready to used in Cache
  • [Client] Client doesn't stall during shutdown

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.18.0...v7.18.1

Changelog

  • f33ecdb2809cc76032f9d19fd89f4d70e2d4cbc9 Bump version to v7.18.0-rc.3
  • 4026b5e66bd32a35d85b24e4934712c12a3a055e Clean up response body and leaky goroutine
  • d93f2549138349771d5794a1ea6466fce341a842 Make solution more robust and add regression test

Changelog

  • c13235568e1d7608660dccf019e21585af4f79ec Bump XRootD to v5.8.4-1.2 and install xrdcl-pelican from repos
  • 2df6f9a5fadbc91abfc8abe79d746e80d428412e Bump version to 7.18.0-rc.2
  • 01679887a354ef8308853bae85f557bae750ee84 Check the ver claim to start with either scitoken:2.0 or scitokens:2.0
  • fa829c29e9b732c06874db2b4ba036da9e3ea43d Fix "Unable to find scitoken config file" errors during Pelican startup
  • 9aac245f1f0aca36003823f775a12e7a3cd19cf7 Fix "acc_AuthFile: Unable to find authfile-cache-generated" errors
  • 8c9926800c683d9775161b0c0d1fdaba7d060cb8 Fix "no route to host" error
  • e5d2ffb327aac3cb6978a6bd3fd9ee3d6d14970d Fix permissions error in TLS file maintenance
  • 454bab5dea7dcdf64e163b6bc90d5b362cf62914 Hint for hidden param
  • 4b8c6752424e9b3e7eaafd18d1a1f35b8f36f0b0 Improve user experience when encountering a deprecated config in pelican config get command
  • 02cacf0601cc0bcf56d92be7c6855d6e5cc9316d Let users to choose between broad discovery (substring) and precise targeting (exact match) when retrieving configuration parameters.
  • 6c481492fc25eb232756d3ea4da0405c77eca7f3 Test EmitAuthfile first run

Changelog

  • ba44efc40a019ba7cfe88014071789bfff58e5fc Bump webUI to 7.17.3-rc.3
  • b8bf6190d9fc44eab627cdbdfc094f03de660beb Check the ver claim to start with either scitoken:2.0 or scitokens:2.0

Pelican v7.18.0-rc.1 Release Notes

New Features and Enhancements

  • [Client] Introduced client transfer statistics reporting. #2436
  • [Origin] S3 tracing can now be enabled via Logging.Origin.Oss configuration #2410
  • [Broker] Allow connection broker to be used for director-to-cache communications #2378
  • [Origin] Added S3 file cache Prometheus metrics #2433
  • [Client] Added checksum support to pelican object put #2415
  • [Client] Keyring errors are now set to the Debug log level #2420
  • [Client] Marked certain transient errors as retryable, including invalid chunk headers, unexpected EOFs, and TLS connection failures during uploads. #2442
  • [Director,Origin,Cache] Enabled web client to GET authenticated files, PUT all files, and interactively list objects #2468 #2467
  • [Origin] Add support for regular expressions to the built-in token issuer's authorization templates #2462
  • [Packaging] Update OA4MP #2444
  • [Packaging] ​​Bump XRootD release to 5.8.3-1.3 #2474

Bugs Fixed

  • [Client] Fixed how tokens are deemed as acceptable #2455
  • [LocalCache] Fixed local cache cleanup bugs. #2432
  • [Director] Fix not-found logic when querying against caches and origins #2392
  • [Director] Fix link depth header for listings #2437
  • [Director] High Availability Director Bug Fixes #2400
  • [Packaging] Fix pelican-server binary panic and upgrade xrdhttp-pelican to v0.0.7 #2476

Notes for Admins

  • Bumped XRootD to 5.8.3-1.3 and upgraded xrdhttp-pelican to v0.0.7.
  • Native packages now require XRootD ≥ 5.8.2.

Full Changelog: v7.17.2...v7.18.0

Changelog

  • cb6d11df050276986424d795c64fee0c1f022981 Bump webUI to 7.17.3-rc.2
  • 78a67c47dad1ee6905274d6ad0f1c9539cecf230 Install xrootd-lotman and lotman from osg repos

Changelog

  • 3439fb17961379312a81fb4c839d33178862e39a Bump webUI to 7.17.3-rc.1
  • 84dfba80e7b6034a21862e87c2bfde79798c795e Bump xrootd-lotman to 0.0.5 to handle negative blocks

Bugs Fixed

  • [Director]: Prevent Director's web UI crash from non-semantic versions
  • [Origin]: Actually make use of Origin.ScitokensNameMapFile in SciTokens configuration generated for XRootD

Bugs Fixed

Pelican v7.16.7

Bugs Fixed

  • [Cache]: Fixed various bugs related to Lotman storage accounting in Lotman-enabled caches

Changelog

  • 9fd0db176c33b9d678a7921f9d41459b0c9f62c6 Bump frontend version for v7.16.7-rc.1
  • e4ecbf85e34290ead49bd695187fdff72b066701 Correctly scope permission modification of LotHome directory

Pelican v7.17.0-rc.2

New Features and Enhancements

Bugs Fixed

  • [Cache]: Correct LotHome directory permissions

Notes for Admins

  • Replace pelican generate keygen with pelican key create command. They co-exist and do the same thing for now so that we have time to update docs. Note that they both generate new private key file as private-key.pem (no more newly generated *.jwk files from now on). If the private key file at the given location (but no public key file exists), this command will just use the existing private key file to derive the public key file.
  • Accept *.jwk key files in IssuerKeysDirectory; though still recommend using *.pem because the key file is a PEM-formatted file

Pelican v7.17.0-rc.1

New Features and Enhancements

  • [Client]: New pelican token create command for on-demand JWT generation #2314
  • [Client]: Client uses token issuer as selection criteria during token selection process, also displays which token it chooses #2219, #2348
  • [Client]: SciTokens-profile JWTs are now accepted in addition to wlcg profile #2223
  • [Client]: Friendlier message when pelican get is run without a destination #2351
  • [Origin/Cache]: Graceful shutdown a server, waiting some time for in-flight transfers before exit #2318
  • [Origin/Cache]: Persist an Origin/Cache’s registered name #2300
  • [Origin/Cache]: Server ads now carry a status field containing degraded state when concurrency limits are exceeded #2338
  • [Origin/Cache]: Collect XRootD CPU-utilisation metric in monitoring #2225
  • [Origin/Cache]: Added XRootD logging on the open, close, and transfer events #2277
  • [Origin]: Concurrency limits can now be enforced in OSS throttle mode #2276
  • [Servers]: Login cookies (and generated tokens) now last 16 hours #2255, #2396
  • [Registry]: Automatically adds the current user as security contact when creating a new namespace #2132
  • [Registry]: Namespace list refreshes automatically after edits #2269
  • [Director]: Service-version graphs added to the Director dashboard #2402
  • [Documentation]: Origin documentation overhaul #2298
  • [Documentation]: Update FAQ section in Pelican Docs #2089, #2261
  • [All]: Startup warning if the deprecated IssuerKey file is still in use #2228
  • [Packaging]: New pelican-client-debug RPM for easier troubleshooting #2317
  • [Packaging]: Container images rebased on XRootD 5.8.3-1.2, xrdcl-pelican 1.2.3 and xrootd-s3-http 0.4.1 #2283, #2340, #2342, #2368, #2399
  • [Plugin]: Improved error propagation when servers return HTTP error codes #2344

Bugs Fixed

  • [Client]: Fixed Windows client’s ability to request and save tokens #2267
  • [Client]: Fixed checksum validation and corrected downloaded-size comparisons #2259, #2275
  • [Client]: Repaired rate/progress calculations #2322
  • [Client]: Aligned runPut proxy logic with downloadHttp behaviour #2372
  • [Director]: Downtime toggles now work reliably and downtime history tests are no longer flaky #2280
  • [Director]: Stopped unintentionally extending TTL on every serverAds.Get() call #2290
  • [Director]: Geo-location widget hidden from non-admin users #2272
  • [Registry]: Properly handle trailing slashes in namespace registration and advertisement #2270
  • [Origin/Cache]: Fixed self-test failures and permission-denied errors in drop-privileges mode #2120, #2291
  • [Origin/Cache]: Restored debug logging from XRootD framework itself #2387
  • [Origin/Cache]: Uses the proper name when requesting federation tokens #2343

Notes for Admins

  • Deprecated key path – A clear warning is now emitted if IssuerKey is still set; please migrate to the new directory-based key layout #2228
  • Name – When a new origin/cache registers, its admin needs to specify its name by setting Xrootd_Sitename in the config. For all servers in the federation, if their name in the local config is different from the registered one, Pelican will still use the registered one and throw a warning in the logs. #2300
  • Container images – Official images are now based on XRootD 5.8.3-1.2 #2399

New Contributors

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.16.6...v7.17.0-rc.0

Pelican v7.16.6

Bugs Fixed:

  • [Client]: Fixed part of an issue related to pelican object puts being proxied through an HTTPs proxy by allowing the client to ignore those proxies.
  • [Cache]: Fixed a bug that prevented Caches from obtaining a valid Federation Token when the service was registered using the Xrootd.Sitename configuration parameter.
  • [Origin/Cache]: Updated the containerized XRootD version to 5.8.3-1.2, which among other things comes with additional segfault fixes.
  • [Origin]: Bumped containerized xrootd-s3-http plugin to v0.4.1, which comes with bug fixes related to data corruption coming from the Origin and deadlocks that blocked transfers from completing.

Pelican v7.16.6-rc.2

Bugs Fixed

  • [Origin/Cache]: Updated the containerized XRootD version to 5.8.3-1.2, which among other things comes with additional segfault fixes

Pelican v7.16.6-rc.1

Bugs Fixed:

  • [Cache]: Fixed a bug that prevented Caches from obtaining a valid Federation Token when the service was registered using the Xrootd.Sitename configuration parameter.
  • [Client]: Fixed part of an issue related to pelican object puts being proxied through an HTTPs proxy by allowing the client to ignore those proxies.

Pelican v7.16.5

Bugs Fixed

  • [Caches]: Updated containerized dependencies (xrdcl-pelican v1.2.3 and xrootd v5.8.2-1.5) to pull in fixes for additional segfaults triggered by high-concurrency cache failures.

Pelican v7.16.4

Bugs Fixed

  • [Client]: Corrected an issue that caused calculated download rates to tend toward 0, causing long transfers to terminate
  • [Client]: Fixed incorrect calculation in the client's EWMA download progress bars
  • [Client]: Fixed a bug that prevented Client.MinimumDownloadSpeed from taking effect unless a deprecated config option MinimumDownloadSpeed was also set

New Features and Enhancements

  • [Client]: Added the ability for clients to log their transfer progress at a defined interval using the Logging.Client.ProgressInterval config option (default 1m)

Pelican v7.16.3

Bugs Fixed

  • [Origin/Cache]: Updated Pelican container images to use XRootD 5.8.2-1.3, which contains fixes for a potential segfault related to the "Close does not refer to an open file" error message.

Pelican v7.16.2

Note: This release failed to generate container artifacts. The issue has been corrected and this bugfix will be released as v7.16.3

Bugs Fixed

  • [Origin/Cache]: Updated XRootD to 5.8.2-1.3 to fix potential segfault related to "Close does not refer to an open file" error message.

Changelog

  • 4b148ca647200af4000003565e76e7fddb87b22a Bump frontend version for v7.16.2-rc.2
  • ee370712de2edad37075570b59ff15e86f7c042f Bump purego version to v0.8.3

Changelog

  • 4d103c12a50778980332ec3d7d5aa223a9e52d52 Build and package a version of pelican that includes debugging symbols
  • e294ba6af579487109f02591240e5094670228ce Install 'delve' into the dev container image
  • d8dc5c8851c15e9bd0b9cbc719a09757faed7662 Updated version is ".goreleaser.yml" for pelican-debug
  • 2d8132bd2543461634bc3275f5e2a6c5a4f717b6 Updated version to 7.15.4

Pelican v7.16.1

Bugs Fixed

  • [Director]: Corrected an issue that prevented the Director from forgetting about some Origins/Caches in #2290
  • [Director]: Fixed a bug that impacted some types of server downtime filtering and prevented the Director from receiving the proper updates to these configurations in #2280
  • [All]: Fixed RPM packaging issues involving unavailable dependencies for some platforms in #2286

Pelican v7.16.1-rc.1

Bugs Fixed

  • [Director]: Corrected an issue that prevented the Director from forgetting about some Origins/Caches in #2290

Pelican v7.15.3

Bugs Fixed

[Cache] Fixed throttling in the cache [Cache] Updated xldcl-pelican to 5.8.1 to prevent caches from seg faulting, this is an urgent fix for caches. [Cache/Origin] Fixed bug in metric collections

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.15.2...v7.15.3

Changelog

  • 0d7af64fe464ea914acfa0881ee8cf4419344b53 Bump frontend version for v7.16.0-rc.2
  • c07e2d8753ad79202161adbe4cf9405f9587c117 Correctly compare the total local size with the total downloaded size
  • 9f31e6facf56533196a0b1ba1814bb6cacdc85d3 Remove downtime toggles on Director
  • 749abb95f270c92673d8aa357d03937c107d1b0f Update XRootD release to 5.8.1-1.5 to pick up libXrdOss
  • 089bdc6b3e1d925384d6063d06ebdb577cb25440 Use throttle in OSS mode when applying concurrency limits

Changelog

  • 9f0e8991b67de5d7322d0ca906d485d63ecc4fdd Add doc string and change log level
  • 0cdfcecc52000f614c07c626bffc21d4cbb403e3 Fixed Server IO stat collection

Changelog

  • cf0d09775ba12cbc4ecc33eea08172b37838ea0d Updating xrootd to 5.8.1

Changelog

  • 62e00623bdc02caf31d385a1e30198b356e8b7cf Add checksum output to stat
  • 421c862a089680ba24ed55176ccbe6376fa3e94e Add unit test coverage for checksums
  • 2f423a61b46c5ca2f7745b10a1bd108867de86a9 Bump web-ui version to 7.16.0-rc.1
  • fe7a9d9278e253ea9f4f1186f44749985e51a07a Bump xrdcl-pelican version to v1.2.1
  • 68a7e6c764ef7979ea3b965c22d029b646056a2b Don't build scitokens unit tests on MacOS
  • d16353864aef8062351c20e7ca9a9a108d3f1755 Fix e2e checksum failure in testSyncDownloadPartial by deleting origin file/xattrs
  • df46d3aea5e70e2fbdea677fb0781798f19db2ab Fixups from code review.
  • 3d9de6e16f83f7cee44d89fa6a5cdd369baa422f For Windows, ensure that credentials file is closed before renaming it
  • b9328a54834fcc686a3c4ff574ccf143284cff21 Improve handling of checksums
  • 3f129834e545df8901a6c9bb9d94121c9c5b3ef5 Improve the ClassAd string printer to handle deeply nested ClassAds.
  • d3a689944867cc1339926ea0dc22b422b0a82691 Pin scitokens version for MacOS env
  • f397c29fdaea009fe7da688c55dcd5649484075d Print output to standard error, not standard in
  • f39199d50e099fad1e9ebd89f59139b2ecc913b2 Record checksum results in developer data

Pelican v7.15.2

Bugs Fixed

  • [Cache] XRootD now uses xldcl-pelican v1.2.0 which contains bug fixes for the cache

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.15.1...v7.15.2

Changelog

  • e28adaf400f307c6b83f59bfafb1b580571f1153 Attempting to build from source instead
  • 85065b8507ebb1525793e76a5e5f12f7f5edb768 Updated version in osx-install

Changelog

  • 0dbf8b70a3147441c85f787cd49d7253ab3f8fef Proper xrdcl-pelican version
  • 0b70ea68480c55b78426afdd7ee0a2fc9045b005 Properly updated the dockerfile this time for xrdl-pelican

Pelican v7.15.1

Bugs Fixed

  • [Origin] Made Origin throttling configurable #2186
  • [Origin] Enabled multiuser origins to cache public keys for validating tokens #2184
  • [Client] Now sanity checks size for client GETs #2177

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.15.0...v7.15.1

Changelog

  • b5d84f05f6f8dd774427963fac2b4fa297d83bdb Update version in frontend
  • f75ae33248445a436b7d87b5561f24eb789b593b Updated xrdcl-pelican version in the Dockerfile

Changelog

  • b50b92f14d218b29ad540c277d88bcde15f843b8 Always use input issuer in test util func for
  • fe6efc9d6b5d6d524317dd0ab581da29bc465738 Fix metrics scraping by accepting fed tokens for Director service discovery
  • 436962363ebe0df66e045c6eb9478abd255e9bdd Updated the version number
  • 0e3927335bd0b55e394cc5d5a1d2621d081828c2 Use fed discovery struct to construct federation metadata

Changelog

  • f0636f862c3005d619eaea40df7d8e08cf37763c Align token endpoints with REST API best practices
  • e92d39ea04fc84805d101d634c6e2f791f22d137 Fix the auth token generation process for api token tests when we put the endpoints behind auth middleware - When the auth token is not provided in those negative test cases, the returned status code should be 401 StatusUnauthorized instead of 403 StatusForbidden
  • 97d87a4ae6683a827c8646ac9dd11a6a517e36de Move token endpoints behind auth
  • f55286dee51da7f214e5c32e5db2a6c125de752d doDiscovery will fall back to fed.DirectorEndpoint

Changelog

  • 0ddfa48275daac4c0f02f0f1c8d0fcf140ce6451 Add version to the director cards
  • fc935a223717e1da80f8703d93b353d8cecad2b4 Allow the Linux PR testing workflow to be triggered manually
  • 08193ed8f84aeeaa412895659a231f826fb798e5 Build and push the test container for release candidates
  • af4cae38297df3edeb571488a4af10052c9c549f Correctly record the start time for uploads

Bugfix

  • Install sssd-client into both origin container images #2102

Operation & Bugfix

  • Fix index out of bound error in origin servers #2082
  • Update XRootD version from 5.7.2 to 5.7.3 c555c47b

Changelog

  • 82b91181d0d28c70973f58b97c99af94a19adfcd Fix index out of bound error in attrs.Files
  • d36924a6fce8db50c1ad4bfb5cec33147839bd74 Update frontend version tag to 7.14.1-rc.1

Bug fixes

  • [Cache, Origin] - Rebuilt containers to include newer version of xrootd: xrootd-5.7.3-1.3.purge.osg24 which contains additional bug fixes.

Pelican v7.14.0-rc.1

New Features and Enhancements

Director

  • Support using IP address to query the geo location of a server in Director container #2059

Bugs Fixed

  • Fix container building process: Properly install pelican-server into /usr/local/sbin #2053
  • Resolve the excessive use of xrootd user #2057 #2062

Changelog

  • 269c7727 Bump frontend version to v7.13.0-rc.2

Bugs Fixed

  • [Caches] - Rebuilt containers to ingest xrdcl-pelican v1.0.5, which comes with additional segfault bugfixes.
  • [Origins] - Rebuilt containers to ingest upstream bugfixes for S3/HTTP origins.

Changelog

  • 4218471c Force installation of latest xrdcl-pelican for v7.12.4-rc.2 release

Changelog

  • 46984203 Switch xrootd-s3-http plugin to be built from source

Updated tag to reflect correct numbering scheme (should be rc.X, not rcX as was done with rc0).

Bugs Fixed

  • [Cache Containers] - Grabbed patched version of xrootd 5.7.2 to mitigate further segfault bugs related to caches that are handling many concurrent requests for non-existent objects.

Bugs Fixed

[Cache] - Fixed a broken dependency for our cache containers that prevented caches from fetching non-cached objects from origins. [Cache] - Updated an underlying library version to prevent caches from segfaulting when non-existent objects are requested. [Client] - Added extra handling for client PUTs to accept XRootD's new HTTP 201 response.

Known Bugs

[Director/Cache] - This release contains a known bug where the Director's test utility fails for caches. This shouldn't affect the cache's ability to function, but will result in the cache showing errors in the Director's Web interface.

Changelog

  • f41446f9 Accept 200 or 201 on uploads
  • aa0c9da8 Adjust integration test to allow a 201 response
  • adb341f2 Update version for v7.12.2-rc.1 release

NOTE

Containerized versions of this release were dead on arrival due to a broken dependency for xrdcl-pelican.

Bugs Fixed

  • [Servers] Restored the functionality of various tickers that had been erroneously stopped, preventing XRootD servers from refreshing some files like scitokens/auth config and preventing some metrics from being scraped by Prometheus.
  • [Caches] Updated caches' underlying version of xrdcl-pelican from 0.9.4 to 1.0.2, which prevents a segfault in caches whenever a non-existent object is requested.

Bugs Introduced

  • [Caches] The directorTest functionality will fail in caches due to the new xrdcl-pelican version until updates can be made in Directors. These test failures are limited in scope and should not affect the rest of the cache's functionality, but may generate excess noise in logs.

Changelog

  • 8ba28bb0 Add cache to config components in docs
  • d8d13455 Fix logic for handling deprecated configuration parameters
  • 85d36fd5 Fix submodule initialization ordering for S3/HTTP plugins in dev/prod containers
  • 23246693 Update frontend version to 7.12.0-rc.4
  • 2bd558ff Use alma9 container for building prod pelican-server binaries

Pelican v7.12.0 Highlights For Users [Client] Fixed bug where object ls against namespaces that do not support listings caused nil pointer panics in #1710 [Client] Added additional client checks to prevent creation of empty objects with directory uploads in #1707 [All] Added a CLI tool pelican config for displaying and interacting with Pelican configuration in #1693 [Plugin] Allowed the plugin to detect when it is named pelican_plugin in addition to pelican_xfer_plugin in #1733 [Client] Cleaned up display of progress bars for object gets in the client in #1814

For Admins [All] Packaging standardization/improvements in #1666 [Director] Improved Prometheus metrics for tracking the number of currently-advertising servers in #1684 [Director] Fixed OSDF Director startup bug that caused erroneous warnings/errors mentioning the proj label in #1708 [Director] Gave the ability for the Director to persist origin/cache downtime labels between restarts in #1673 [Director] Fixed over-collection of server redirects in the Director's Prometheus database in #1743 [Director] Namespace capabilities are now displayed by the Director in #1737 [Cache] Corrected previously unsafe creation of namespace, meta and data directories in caches in #1709. This change may result in cache data invalidation, and will likely require manual intervention during upgrades. [Director] Gave Directors the ability to collect Prometheus metrics for GeoIP resolution failures in #1772 [Origin] Gave S3 origins the ability to specify sentinel files in #1791 [Director] Servers now advertise their version to the Director in #1753 [Registry/XRootD Servers]

New Contributors

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.11.8...v7.12.0-rc.3

Changelog

  • 03a49337 Updating fronend version number

Changelog

  • 95c363ca Fixed missing newline
  • f5e30f6d Fixing linter error that was added during rebase
  • 15b75c79 Removed calling the x509 test script until we can fix the functionality
  • 14634ae5 Removed the tsl defer functionality from the cache until we can fix it on the xrootd end
  • ebc49ff8 Update version frontend to 7.11.8

Changelog

  • 9810cbdf Bump frontend version to 7.11.7
  • d7857861 Fixed macos failing tests:
  • 62b413db Pinning the xrootd build in macos to a specific tag
  • e6771978 Revert "Removed new metrics that seem to causing Prometheus to use a very lar…"
  • 8353dd2a Revert "Removed the "network" labels from the metrics"

Changelog

  • 2dce0176 Removed new metrics that seem to causing Prometheus to use a very large amount of memory
  • b935faca Updated frontend version number

Changelog

  • be21bd24 Adjust ownership/perms of /usr/local ahead of time for MacOS test runner
  • a6be79ea Fixed linter error in director/sort.go
  • 61a30f29 Format
  • 15729b6d Prettier Format
  • e052a6fd Redirect app to root on success password
  • a5b49958 Remove the use of index.d.ts files
  • fa7cf4db Removed the "network" labels from the metrics
  • 7503842f Uniform Error Handling
  • 3d66971f Uniform Error Handling
  • 1a8af8f1 Uniform Error Handling
  • 24bad1be Update Error Handling
  • 31cbad2f Update MacOS GHA test env to fix deprecation error
  • 593323b8 Updated the web-ui package version

Changelog

  • c9cd02d5 Fixes an issue where a misplaced defer ticker.Stop() stopped the re-advertisement of caches/origins
  • 4ee13c06 Updated front-end version

Changelog

  • 5d333660 Revert "Switch to use new Caps struct but still handle old JSON from Director"
  • 26238933 Revert "Unmarshal Capabilities correctly in all structs that use them"
  • b3df1c87 Update the version number

Changelog

  • 7a096d57 Unmarshal Capabilities correctly in all structs that use them
  • 8629adaa Update the version number

Changelog

  • bc54370a Comment-out all origin export config
  • fa87b928 Drop old default origin port
  • 74888b40 First pass at default config.d based configuration
  • 50db1e25 Fix nil pointer bug caused by trying to list namespaces with no coll URL
  • 826da111 Move Pelican federation-facing config to an example file
  • c514ab57 Move Topology specific configuration to example file
  • 43d9b0d0 Move common OSDF config to the federation-level config dir
  • 9f9a09d0 Move common debugging configs to editable example file
  • b3861d18 Move multiuser origin config to an example file
  • 8dad09d8 Move origin export config to an example file
  • d83b4c4c Move web UI config to example file
  • a91a4335 Remove prescriptive cache / origin locations
  • 3beae08d Updated version to 7.11.1

Changelog

  • a116a69f Adding back in poller fix to make macosx more reliable
  • 7b2ca77b Adjusted pelican_protocol.patch
  • ecd6906a Update version to 7.10.12

Changelog

  • 5f47b175 Update s3 backend to include new multi_curl handler

Changelog

  • a7b05d8c Install sssd-client in dev/prod containers

Changelog

  • 156743fd Don't construct Pelican URLs for stashcp copies

[plugin] Fix bug where transfer plugin fails if there is no $HOME directory set

Director: Selectively enable client X509 authentication

Changelog

  • 842c2a57 Update xrdcl-pelican to v0.9.4

Changelog

  • [Director] e40950e3 Fix topology downtime integration by using downtime URL and not ns JSON

Changelog

  • d29e1d2b Origins now have directreads on by default
  • 6f5341f3 Pre Release: Update npm version
  • a8189e09 Update S3 backend to v0.1.6

Changelog

  • aebe31a6 Pre Release: Update npm version

  • [Origin] Origins now have directress enabled by default

This release modifies the creation of Pelican sub-RPMs to allow compatibility with osdf-client.

This patch fixes authentication headers in the director so that pelican object copy can determine issuer metadata for some namespaces dynamically.

What's Changed

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.1.1...v7.1.2

What's Changed

Full Changelog: https://github.com/PelicanPlatform/pelican/compare/v7.1.0...v7.1.1