You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Need the following changes to create_tarball.sh (they were introduced in EESSI#496 and thus used in #306; the latter will be reduced after merging #307) or changes to init scripts won't be included in tarballs and those changes cannot be ingested via the standard procedure.
diff --git a/create_tarball.sh b/create_tarball.sh
index a619df9..2d77acf 100755
--- a/create_tarball.sh+++ b/create_tarball.sh@@ -51,6 +51,11 @@ if [ -d ${eessi_version}/scripts ]; then
find ${eessi_version}/scripts -type f | grep -v '/\.wh\.' >> ${files_list}
fi
+# also include init, which is also copied by install_scripts.sh+if [ -d ${eessi_version}/init ]; then+ find ${eessi_version}/init -type f | grep -v '/\.wh\.' >> ${files_list}+fi+
if [ -d ${eessi_version}/software/${os}/${cpu_arch_subdir}/modules ]; then
# module files
find ${eessi_version}/software/${os}/${cpu_arch_subdir}/modules -type f | grep -v '/\.wh\.' >> ${files_list}
Need changes to install_scripts.sh as well. See commit ecb936e
New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_307/163325
date
job status
comment
Apr 07 09:25:25 AM UTC 2024
submitted
job id 163325 awaits release by job manager
Apr 07 09:25:37 AM UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:26:38 AM UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-163325.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712481959.tar.gzsize: 0 MiB (253635 bytes) entries: 3 modules under 2023.06/software/linux/aarch64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/5762052
date
job status
comment
Apr 07 09:25:25 UTC 2024
submitted
job id 5762052 awaits release by job manager
Apr 07 09:25:42 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:26:43 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5762052.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712481954.tar.gzsize: 0 MiB (263046 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/broadwell/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/broadwell
New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9167
date
job status
comment
Apr 07 09:25:26 UTC 2024
submitted
job id 9167 awaits release by job manager
Apr 07 09:25:59 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:30:02 UTC 2024
running
job 9167 is running
Apr 07 09:32:07 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9167.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712482264.tar.gzsize: 0 MiB (262695 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9168
date
job status
comment
Apr 07 09:25:30 UTC 2024
submitted
job id 9168 awaits release by job manager
Apr 07 09:26:00 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:30:04 UTC 2024
running
job 9168 is running
Apr 07 09:32:09 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9168.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712482264.tar.gzsize: 0 MiB (262569 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/generic/software
New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/11097008
date
job status
comment
Apr 07 09:25:47 AM UTC 2024
submitted
job id 11097008 awaits release by job manager
Apr 07 09:26:33 AM UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:27:34 AM UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11097008.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712482009.tar.gzsize: 0 MiB (263291 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/5762074
date
job status
comment
Apr 07 09:47:48 UTC 2024
submitted
job id 5762074 awaits release by job manager
Apr 07 09:48:47 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:49:48 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5762074.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712483339.tar.gzsize: 0 MiB (263054 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/broadwell/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/broadwell
New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_307/163328
date
job status
comment
Apr 07 09:47:48 AM UTC 2024
submitted
job id 163328 awaits release by job manager
Apr 07 09:48:42 AM UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:49:43 AM UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-163328.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712483345.tar.gzsize: 0 MiB (253637 bytes) entries: 3 modules under 2023.06/software/linux/aarch64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9169
date
job status
comment
Apr 07 09:47:49 UTC 2024
submitted
job id 9169 awaits release by job manager
Apr 07 09:48:14 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:49:17 UTC 2024
running
job 9169 is running
Apr 07 09:50:20 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9169.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712483356.tar.gzsize: 0 MiB (262696 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9170
date
job status
comment
Apr 07 09:47:53 UTC 2024
submitted
job id 9170 awaits release by job manager
Apr 07 09:48:15 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:49:19 UTC 2024
running
job 9170 is running
Apr 07 09:50:21 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9170.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712483359.tar.gzsize: 0 MiB (262571 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/generic/software
New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/11097020
date
job status
comment
Apr 07 09:48:03 AM UTC 2024
submitted
job id 11097020 awaits release by job manager
Apr 07 09:48:40 AM UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 09:49:41 AM UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11097020.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712483337.tar.gzsize: 0 MiB (263293 bytes) entries: 3 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/5762085
date
job status
comment
Apr 07 10:00:50 UTC 2024
submitted
job id 5762085 awaits release by job manager
Apr 07 10:01:53 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 10:02:54 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5762085.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712484123.tar.gzsize: 0 MiB (264714 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/broadwell/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/broadwell
New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_307/163336
date
job status
comment
Apr 07 10:00:51 AM UTC 2024
submitted
job id 163336 awaits release by job manager
Apr 07 10:01:48 AM UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 10:02:49 AM UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-163336.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712484135.tar.gzsize: 0 MiB (255251 bytes) entries: 4 modules under 2023.06/software/linux/aarch64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9171
date
job status
comment
Apr 07 10:00:52 UTC 2024
submitted
job id 9171 awaits release by job manager
Apr 07 10:01:25 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 10:02:29 UTC 2024
running
job 9171 is running
Apr 07 10:03:32 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9171.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712484149.tar.gzsize: 0 MiB (264348 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9172
date
job status
comment
Apr 07 10:00:55 UTC 2024
submitted
job id 9172 awaits release by job manager
Apr 07 10:01:27 UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 10:02:31 UTC 2024
running
job 9172 is running
Apr 07 10:03:34 UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9172.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712484152.tar.gzsize: 0 MiB (264266 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/generic/software
New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/11097025
date
job status
comment
Apr 07 10:01:01 AM UTC 2024
submitted
job id 11097025 awaits release by job manager
Apr 07 10:01:46 AM UTC 2024
released
job awaits launch by Slurm scheduler
Apr 07 10:02:48 AM UTC 2024
finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11097025.out ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712484122.tar.gzsize: 0 MiB (264956 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
Checklist before starting deployment (setting bot:deploy label):
Check if the SPDX license identifier is provided
not needed, only internal script was updated
Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
Assess if all requested changes are sound (checking files changed on GitHub.com)
Verify that all easyconfig/s being built are included with the EB version used (if not why not)
no easyconfigs were used
Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)
NOTE, we would only need one tarball since it is for init which is architecture independent! We'll use all tarballs anyhow, because they also include updates to the Lmod cache.
at least one tarball for each architecture has been uploaded
at least one tarball for each architecture has been staged
for each staged tarball was a PR for approval/rejection opened
for each architecture one and only one tarball has been approved
for each architecture one and only one tarball was ingested
ingest failed with error
�[31mERROR: no architecture directory found in the tarball!�[0m
all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
no need to rerun as all tests have passed
has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)
command & log
command
cd /cvmfs/pilot.nessi.no/versions/2023.06 ; \
ls -l \
init/eessi_env* \
software/linux/*/generic/.lmod/cache/* \
software/linux/x86_64/*/*/.lmod/cache/*
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Simply uses the commit in EESSI#475
Need the following changes to
create_tarball.sh(they were introduced in EESSI#496 and thus used in #306; the latter will be reduced after merging #307) or changes toinitscripts won't be included in tarballs and those changes cannot be ingested via the standard procedure.Need changes to
install_scripts.shas well. See commit ecb936eAlso need changes to
ingest-tarball.shon the Stratum 0 (see EESSI/filesystem-layer#186).