The Linux Foundation Projects
Skip to main content
search
Category

Blog

Jul 13
help wanted sign

Help Wanted: Intent-Based Pipelines

By Blog, Community

Contributed by Justin Abrahms, eBay

Drawing a software delivery pipeline is a task that takes a couple of developers 30 minutes and a whiteboard.

We start our build, we do some testing, try it out in staging and… when we’re happy… publish it to production. Going from there to a working pipeline that’s modeled in the way that you want either requires a large framework investment that’s likely company-specific (Amazon, Google), using a SaaS provider (CloudBees, CircleCI), or writing a bunch of Kubernetes YAML / Bash scripts.

At the Interoperability SIG, we’ve been discussing what it might look like to have a simplified DSL for expressing the outcomes of a pipeline, without getting so tied into the mechanisms of telling the system how to do it. This is an illustrative (but not particularly battle-hardened) example:

meta:
  # Channel which will get updates on deploys. One message for each release and
  # Information in the thread as it progresses through the pipeline.
  slackChannel: myapp-deploys

  # Who to complain to when this breaks.
  owners: your-ldap-or-equivalent-group-here

build:
  # Explicitly not setting up a jenkins instance. Framework should do this, if necessary.
  type: docker
  # ...or...
  # command: mvn package

deploy:
  default:  # These apply to all stages below, unless they're overridden
    cores: 100m
    memory: 300Mb
    ramp:
      # deploy to 1% then 10% then 100% as a rollout strategy. There will be
      # a few options available.
      rolloutStrategy: ONE_TEN_ALL
      bakeTime: 5m
  dev:
    rollout:
      regions: dev-west-1a
  staging:
    rollout:
      regions: dev-west-1a
  prod:
    rollout:
      regions: prod-west-1a, prod-west-1b, prod-west-2a, prod-west-2c
      # Starting from 1, deploy to 2x the regions of the last deploy, so 1,2,4,8,16.
      strategy: GEOMETRIC
    approvals:
      - metricsValidator:
          promql: sum(increase(failure[5m])) > 5
          onResults: rollback

Something like the above would allow us to simplify the expression of what we want the shape of our pipeline to be, but without having to become experts in Tekton or Argo or any of the other great tools for accomplishing this. This will hopefully allow more developers to engage with CI/CD pipelines and have a more active role in the quality of their software.

Join the Conversation

If this sounds like something you’re interested in, we’d love to discuss it with you during one of our regular, open-to-anyone meetings or give #sig-interoperability a ping in slack.

Jun 08
cdCon 2022 community days

Community Days at cdCon 2022 on June 9-10

By Blog, Staff

We’re happy that our communities have the opportunity to meet in-person and virtually at cdCon.

June 9 and 10 are splashed with events hosted by the community! Some are in-person only, others also include virtual attendance.

  • CDEvents
  • Jenkins
  • Jenkins X
  • Shipwright
  • Spinnaker
  • Tekton
  • and GraphQL

In-person cost is only $15 for access to all events!

Jun 07
State of Continuous Delivery Report june 2022

CD Foundation Announces State of CD in 2022 Report, Opens Third Annual cdCon with New Project CDEvents, New Members

By Announcement, Blog

CD Foundation veteran Fatih Degirmenci joins as General Manager

San Francisco, June 7, 2022 – The Continuous Delivery Foundation (CDF), the open source software foundation that seeks to improve the world’s capacity to deliver software with security and speed, today announced its State of CD Report in 2022, a new project called CDEvents building a vendor-neutral specification for defining the format of event data, new members, and more. The announcement comes at the start of CDF’s third annual cdCon (June 7-8, 2022). cdCon 2022 is being run as a hybrid event from Austin, TX.

State of CD Report in 2022

A key function of CDF is providing vendor-neutral data on key DevOps and development metrics showing where continuous delivery stands in 2022 and beyond. The Continuous Delivery Report Series started last year; this is the third report in the series. 

Key findings include:

  • As of Q1 2022, less than a quarter (23%) of developers are not involved in any DevOps-related activities, indicating continued growth in the adoption of practices that increase an organization’s ability to deliver software at high velocity.
  • 47% of developers use either continuous integration or deployment but only one in five use both continuous integration and deployment approaches to automate all building, testing, and deployment of code to production.
  • There is an increase in DevOps adoption in every development sector. Mobile app development has now even leapfrogged desktop development, such is its shift in embracing DevOps approaches.

The full report is available for free. View the Report (PDF)

New Project CDEvents Hosted by CD Foundation

CDF recently announced it is hosting the CDEvents project, a vendor-neutral specification for defining the format of event data to provide interoperability across services, platforms and systems. Today’s CI/CD systems do not talk to each other in a standardized way. Defining a standard set of specifications is critical in solving the interoperability issues across the continuous delivery (CD) ecosystem. Having a common format for events in the CD space will enable an ecosystem of tools to collect, store, visualize and analyze events across CD platforms. This will cover use cases like measuring DevOps metrics and performance and visualizing end-to-end workflows, from the initial development all the way to operations and remediation flows. The current release of the CDEvents specification is available here.

cdCon Kicks Off Today in Austin, TX

cdCon is a two-day virtual event running June 7-8, 2022, focusing on improving the world’s capacity to deliver software with security and speed. This year’s sessions are grouped into 3 channels: Technology Teams, Enterprise Leadership, and Open Source Communities. cdCon is sponsored by IBM, JFrog, Armory, CircleCI, OpsMx, Camunda, Capital One, CloudBees, Cloudsmith, Cloud Native Computing Foundation, Liquibase, Spacelift, and more. 

The full cdCon schedule is available here

“We’re excited to have our first physical event in two years. The pandemic has shown more than ever how important continuous delivery is to industries as they navigate industry and global changes. cdCon generates passionate participation and is a great platform for connecting with peers and understanding best practices,” said Fatih Degirmenci, Continuous Delivery Foundation General Manager. “CDF is committed to providing a clear path for companies to participate in a vendor-neutral structure that can greatly improve organizations’ abilities to deliver software securely and quickly. Come join us at cdCon, there’s still time to register and participate virtually!”

Keynotes include industry experts and well-known specialists like Isaac Cory Doctorow, Science Fiction Author, Activist, and Journalist; Joe Sepi, Program Director of Open Tech, IBM; Melissa McKay, Developer Advocate, JFrog; Michael Stahnke, Vice President of Platform, CircleCI; Gopal Dommety, CEO, OpsMx; Brian Behlendorf, General Manager, Open Source Security Foundation; Grace Francisco, Vice President, Developer Relations Strategy & Experience, Cisco; Stephen Atwell, Principal Product Manager, Armory; Isaac Mosquera, Principal GTM Leader, Serverless, AWS; and Fatih Degirmenci, Continuous Delivery Foundation General Manager, The Linux Foundation.

CD Foundation Welcoming New Members

Cloudsmith, Spacelift, Stackhawk and Tenable are joining the CD Foundation as new members. They join premier members AWS, Armory, CloudBees, Fujitsu, Google Cloud, Huawei, JFrog, Netflix, and Red Hat, as well as the broader open source CI/CD community, in helping to strengthen the growth and evolution of continuous delivery models. 

Cloudsmith

Cloudsmith is a cloud-native, global, universal artifact management platform for engineers looking to set up a secure artifact repository in 60 seconds. Cloudsmith is a Belfast-headquartered startup that has raised $15 million in Series A funding. This is the largest ever Series A funding round in Northern Ireland.

“We are delighted to join the CD Foundation. How companies deliver software securely and quickly is key to their success, and we believe joining will provide even more value to our customers by connecting us to the broader community of continuous delivery companies and developers around the world,” said Lee Skillen, Co-Founder & CTO, Cloudsmith. “The future of cloud-native software delivery, artifact management and the whole supply chain is critical to industries everywhere, so we are excited to contribute our knowledge of continuous packaging to it.”

Spacelift

Spacelift focuses on collaborative infrastructure for modern software teams to manage cloud, infrastructure, or services. Its platform uses Terraform, CloudFormation, Pulumi, and Kubernetes offering features such as runtime configuration, version management, and state management. They are backed by Insight Partners, Blossom Capital, Hoxton Ventures and Inovo Venture Partners.

“We are excited to join the CD Foundation. Spacelift provides a collaboration and automation layer for infrastructure as a code, and we focus on openness, flexibility, and customization. We believe this fits well with the CD Foundation, and by contributing to the direction of open-source CI/CD development through the CD Foundation, our customers will benefit,” said Sean O’Dell, Head of Developer Relations at Spacelift. “By inviting infrastructure, security, compliance, and platform teams to collaborate on and approve workflows and policies, you can improve your infrastructure delivery platform.”

StackHawk

StackHawk helps developers find and fix application security bugs as part of software delivery. StackHawk makes security part of the developer workflow by running automated security testing in CI/CD and notifying developers immediately about new security issues as they emerge. StackHawk recently announced it has raised $20.7 million as part of a series B funding round. 

“With the rapid pace of software development, security teams are finding it more difficult to test for vulnerabilities on an ongoing basis. At StackHawk, we are placing the ability to resolve vulnerabilities in the hands of the developer, and we see the CD Foundation as a key partner to helping us expand our reach and more broadly address this issue of shifting security left in the development cycle,” said Joni Klippert, co-founder and CEO at StackHawk. “We see the CD Foundation’s ability to guide changes in software development as a strength that will help drive the reduction in security vulnerabilities that make it to deployment.”

Tenable

Tenable is a cybersecurity company known as the creator of the vulnerability scanning software Nessus. Approximately 40,000 organizations around the globe rely on Tenable to understand and reduce cyber risk. Tenable customers include approximately 60 percent of the Fortune 500, approximately 40 percent of the Global 2000, and large government agencies. 

“As security is a critical component of open source software development and delivery, Tenable will provide expertise and guidance to the CD Foundation,” said Glen Pendley, chief technology officer, Tenable. “The CD Foundation is uniquely positioned to help steer the course of security-focused development in the continuous delivery space. Tenable looks forward to collaborating with this community to enable end users to influence better solutions that drive value for our customers.”

New General Manager Lead

CI/CD open source community leader Fatih Degirmenci has joined the CDF as its new General Manager. Fatih is not new to the CD Foundation. He participated in the very first public meeting during the Open Source Leadership Summit in California in March 2019 when the CD Foundation was announced. Since then, he’s been heavily involved in the community including special interest groups (SIG) like the Interoperability SIG and Software Supply Chain SIG. He also served on the Technical Oversight Committee (TOC) as an end-user representative.

Fatih will work closely with the eight CDF-hosted projects CDEvents, Jenkins, Jenkins X, Ortelius, Shipwright, Screwdriver, Spinnaker, and Tekton, and help members and the wider Continuous Delivery CI/CD community improve their software development security and speed when creating cloud-native, legacy infrastructure, mobile, IoT, and bare-metal applications. 

Additional CDF Resources

About the Continuous Delivery Foundation

The Continuous Delivery Foundation (CDF) seeks to improve the world’s capacity to deliver software with security and speed. The CDF is a vendor-neutral organization that is establishing best practices of software delivery automation, propelling education and adoption of CD tools, and facilitating cross-pollination across emerging technologies. The CDF is home to many of the fastest-growing projects for CD, including Jenkins, Jenkins X, Tekton, and Spinnaker. The CDF is part of the Linux Foundation, a nonprofit organization. For more information about the CDF, please visit https://cd.foundation

The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our trademark usage page: https://www.linuxfoundation.org/trademark-usage Linux is a registered trademark of Linus Torvalds.