Skip to main content
  • Log in
  • Manage Cookies
Eclipse Foundation
Download
  • Projects
  • Working Groups
  • Members
  • Community
    • Marketplace
    • Events
    • Planet Eclipse
    • Newsletter
    • Videos
    • Blogs
  • Participate
    • Report a Bug
    • Forums
    • Mailing Lists
    • Wiki
    • IRC
    • Research
  • Eclipse IDE
    • Download
    • Learn More
    • Documentation
    • Getting Started / Support
    • How to Contribute
    • IDE and Tools
    • Newcomer Forum
  • More
      • Community

      • Marketplace
      • Events
      • Planet Eclipse
      • Newsletter
      • Videos
      • Blogs
      • Participate

      • Report a Bug
      • Forums
      • Mailing Lists
      • Wiki
      • IRC
      • Research
      • Eclipse IDE

      • Download
      • Learn More
      • Documentation
      • Getting Started / Support
      • How to Contribute
      • IDE and Tools
      • Newcomer Forum
    • Search

  1. Home
  2. Blogs
  3. Denis Roy's blog
  4. Choosing servers for Kubernetes

Choosing servers for Kubernetes

Wednesday, July 7, 2021 - 16:14 by Denis Roy

The Eclipse Foundation jumped on the Kubernetes bandwagon a few years ago, for the same reasons as everyone else. Our need at the time was for a scalable/fault tolerant solution for our Jenkins-based CI system. We started small by repurposing older hardware, and with early successes, the cluster grew out of a combination of new iron and more repurposed servers.

As cluster usage grew, we started receiving feedback about slow and fluctuating build times. You see, we'd typically purchase hardware for low I/O, parallel operations - lots of CPU cores, lots of RAM, for those hundreds of web requests per second we typically handle. As it turns out, although these machines can handle thousands of simultaneous short-lived connections, they suck at single-threaded operations that run for 20 minutes.

For new hardware, we moved away from the "big iron" model, choosing instead smaller units with fewer CPU cores, but much faster ones, and faster memory busses. To save money up-front, we'd equip them with inexpensive HDDs, with the understanding that local I/O wasn't much of a thing. Now, I know what you're thinking: HDDs? Duh, get SSDs, it's a no-brainer. Our release engineers Mikaël and Fred have been pleading the case for SSDs in build machines for years. I had simply underestimated the impact of local disk I/O - either when multiple disk-intensive pods were scheduled at the same time, or when images were pulled to the local node for spin-up. An 8-minute build was a 27-minute build later on, for no obvious reasons.

 

We've since been retrofitting all our worker nodes with SSDs with, obviously, much success. The fast machines are now fast --  consistently, and the older iron performs adequately well. And with some benchmarking (thanks for the data and image, Mikaël Barbero), we're able to identify worker nodes that are simply outclassed, such as third-from-the-left "okdnode-12", which is headed for a permanent retirement.

With the targeted use of labels, we can reserve older hardware for typical website applications where slower core speed is appropriate for those short-lived connections.

We're doing our best to provide Eclipse projects with a reliable, performant, expandable and consistent platform for running builds, without breaking the bank. It's a learning curve for sure, and we're getting there.

  • Denis Roy's blog

Eclipse Foundation Blogs

  • Wayne Beaton (820 posts)
  • Mike Milinkovich (319 posts)
  • Ivar Grimstad (243 posts)
  • Benjamin Cabé (131 posts)
  • Tanja Obradovic (60 posts)
  • Thabang Mashologu (37 posts)
  • John Kellerman (27 posts)
  • Paul Buck (22 posts)
  • Brian King (19 posts)
  • Frédéric Desbiens (19 posts)
  • Christopher Guindon (15 posts)
  • Gael Blondelle (14 posts)
  • Mikaël Barbero (14 posts)
  • Hailley Seed (10 posts)
  • Denis Roy (9 posts)
  • Hudson Kelly (8 posts)
  • Michael Plagge (4 posts)
  • Serina El Salibi (3 posts)
  • Shabnam Mayel (3 posts)
  • Shanda Giacomoni (3 posts)
  • Jacob Harris (2 posts)
  • Clark Roundy (2 posts)
  • Paul White (1 posts)
  • Stephanie Swart (1 posts)
  • Karla Ferrer (1 posts)
  • Sharon Corbett (1 posts)

Recent blog posts

  • DEVIES Award to Jakarta EE 10
  • Jakarta EE track at Devnexus 2023!!!!
  • Hashtag Jakarta EE #161
  • Jakarta EE Community Update - 2022 in Review
  • jChampionsConf 2023
  • Eclipse Cloud DevTools Contributor Award: Theia Developers for Detachable Views
  • Hashtag Jakarta EE #160
  • THAT Conference 2023
  • European Cyber Resiliency Act: Potential Impact on the Eclipse Foundation
  • Hashtag Jakarta EE #159
More

Eclipse Foundation

  • About Us
  • Contact Us
  • Sponsor
  • Members
  • Governance
  • Code of Conduct
  • Logo and Artwork
  • Board of Directors
  • Careers

Legal

  • Privacy Policy
  • Terms of Use
  • Copyright Agent
  • Eclipse Public License
  • Legal Resources

Useful Links

  • Report a Bug
  • Documentation
  • How to Contribute
  • Mailing Lists
  • Forums
  • Marketplace

Other

  • IDE and Tools
  • Projects
  • Working Groups
  • Research@Eclipse
  • Report a Vulnerability
  • Service Status

Copyright © Eclipse Foundation. All Rights Reserved.

Back to the top