Singularity, which has been developed under the guidance of Sylabs since inception, is an ecosystem with multiple players. Of those players, the SingularityCE project will continue to provide the core development for Singularity and SIF.
Reno, NV – (May 18, 2022) – Sylabs, the global leader in providing tools and services for performance-intensive container technology, today announced that it has released SingularityCE 3.10. The newest update makes significant steps towards full OCI compatibility, giving Singularity the ability to natively run OCI-based container workflows. The release also adds functionality for resource limits using cgroups to give developers more control over the environments in which Singularity is being run.
“OCI-based container workflows are being increasingly adopted in HPC environments, and while Singularity has had a level of compatibility with OCI images, it often took extra steps that weren’t necessarily user-friendly,” said Adam Hughes, Chief Technology Officer at Sylabs. “Singularity users are telling us that what they really want is to simply be able to run any OCI image with Singularity without any issue. Our goal is to make Singularity the runtime you use to containerize HPC workloads, regardless of whether that’s in an OCI format to start with, or whether you’re using Singularity all across the chain. We want our users to feel like Singularity is able to cover the range of their needs for HPC and OCI-based workflows. Singularity users shouldn’t have to jump through hoops for compatibility across their workflows.”
Features of the 3.10 release include:
- Support for unprivileged cgroups v2 resource limits and systemd cgroups management. Allows non-root users on modern Linux distributions to apply resource limits to containers with SingularityCE directly, rather than needing to rely on a job scheduler/resource manager to do so.
- New command-line flags to set resource limits. Users can now easily apply CPU, memory, IO, and other limits on their containers from the command line, with flags compatible with the Docker CLI. No cgroups configuration files are required.
- A new `–no-eval` flag makes SingularityCE treat environment variables and command line arguments the same way as Docker and other OCI runtimes, improving compatibility. This feature has been added to the `–compat` mode which provides a simple way to enable various Docker/OCI compatibility options with a single flag.
- Experimental unprivileged SIF mounts with squashfuse. Run native SIF container images within an unprivileged user namespace, and without having to extract them to disk.
- The `singularity oci` commands now use `runc` to execute containers in the OCI lifecycle. This is the first step in progressively introducing greater OCI compatibility to SingularityCE under our roadmap to 4.0.
- Support for remote builds that contain a ‘%files’ section in the definition.
“These new features are big steps toward better compatibility with the OCI world, which will give Singularity greater utility across the entire spectrum of workloads,” said Dave Trudgian, Software Engineer at Sylabs and the lead developer within the Singularity ecosystem. “The release also introduces the ability for all users to apply RAM, CPU, and other resource limits directly to individual containers. This is very useful when developing and testing scientific software on your laptop or desktop. Benchmarking tasks becomes easier, and you can avoid your workstation grinding to a halt. It also allows balancing the needs of multiple containers within a single HPC job, optimizing for overall productivity.”
The SingularityCE 3.10 Release is available immediately, with download and documentation information available at http://sylabs.io/singularity/.
Sylabs is the global leader in providing professional tools and services for high performance container runtime technology. Sylabs makes high performance computing more accessible to researchers, scientists, and engineers using Singularity, the most advanced open source container runtime technology for performance-intensive applications and environments. As the most active contributor to the Singularity ecosystem, through both the community edition and Sylabs’ enterprise-supported and professional implementations, Sylabs is dedicated to enabling cutting-edge research and facilitating rapid scientific discovery to solve some of humanity’s greatest challenges. For more information about Singularity runtime technology, including SingularityCE (Community Edition), Singularity Container Services, SingularityPRO, and Singularity Enterprise, visit http://sylabs.io.
Overview This long awaited feature allows copying local files into remote builds via the %files section of the Singularity def file the same way as you would if you were building locally with singularity build. No special command-line arguments or other user actions...
Now that SingularityCE 3.10 has shipped, let’s take a look at what’s in a release, and who makes it happen. Our goal is that SingularityCE should be a true community project that is accessible to both users and developers. At each sixth-month release, going forward,...