Embrace Cloud Computing with an OpenStack-based Private Cloud

中小型组织如何拥抱云计算

刘希斌Chief Architect

瞬联软件科技CIeNET Technologies

04/12/2023 2

1. Challenges

我们面临的问题

CIeNET PROPRIETARY

04/12/2023 3

We face common IT problems with other SMEs!

About Us• CIeNET Technologies （瞬联软件科技）• A leading consulting and software company founded in 2000• Telecom, enterprise, mobile & internet software development• 1,900+ R&D engineers

Honors• 2012 IAOP Global Outsourcing 100 Top 75 “Leader”• 2011, 2010 and 2009 IAOP Global Outsourcing 100• 2011 Diverse Supplier Development Program (Accenture) • 2010 Minority Global Technology Firm of the Year (US DOC)• 2011, 2010 and 2009 China Sourcing Top 100 (Gartner)• 2009 and 2008 Top 100 China Software Export Enterprise

CIeNET PROPRIETARY

04/12/2023 4

CTO Questions

???

What is cloud

computing?

What are they doing with cloud

computing?

Why do I need cloud

computing in our

organization?

What if I don’t adopt cloud

computing in our

organization?

What’s the cost to

deploy cloud computing?

Can I make money from

cloud computing?

什么是云计算？

大家都用云计算做什么？

我为什么需要云计算？

不部署云计算会怎么样？

部署云计算很贵吗？

我能利用云计算赚钱吗？

CIeNET PROPRIETARY

04/12/2023 5

Several FACTS we discovered that you may not know about your organization or also need to deal with …

We have a lot of computers （我们有很多机器）• Server, Blade, Workstation, Desktop PC, Laptop PC

Computer resource utilization is low （每台机器的使用率很低）• Average utilization < 10%

Old computers are idle （旧机器闲置）• They are put aside rather than being utilized

Computer software installation is done manually （软件手动安装）• Repetitive work (repeated installations) and added overhead for IT maintenance

We use a lot of commercial software licenses （好多商业软件！）• It’s expensive

We’ve installed some virtualization software （已经尝试使用虚拟化软件）• Not centrally managed

CIeNET PROPRIETARY

04/12/2023 6

Several CONSTRAINTS we are aware of which may also be your constraints …

Lack disposable budget for new equipment （我们没有额外的预算）• Economic slowdown and increased efficiency demands

Need for an increase in productivity and shorter TTM （需要提高效率缩短上市时间）

• Competition!

Reluctant to put all data in public cloud （数据暂时不想放在公有云里）• Security and IPR concerns and not ready for it yet

Limited bandwidth for IT department （ IT 部门的工作已经非常饱和）• It’s all about cost

Need rich applications for collaboration （企业协作需要更多的应用）• Enterprise 2.0 …

CIeNET PROPRIETARY

04/12/2023 7

2. Solution

简单易行的解决方案

CIeNET PROPRIETARY

04/12/2023 8

Virtual Machine

Management (Computing)

Development and Deployment

Platform

Storage Service

Enterprise Applications

CIeNET PROPRIETARY

04/12/2023 9

Why OpenStack?

Open Active PopularEasy

CIeNET PROPRIETARY

04/12/2023 10

Embrace Cloud Computing: A Strategic Plan （拥抱云计算策略）

Build IT infrastructure with cloud technologies

– Cut IT costs– Simplify IT operations

Develop/test with cloud platform

– Speed up Development

Deploy and use cloud-based services

– Quickly meet business needs– Improve efficiency

Provide cloud-based services to public

– Generate revenue from cloud

IT 基础设施

开发环境

使用云服务

提供云服务

CIeNET PROPRIETARY

04/12/2023 11

3. Practices

我们的实践

CIeNET PROPRIETARY

04/12/2023 12

Guideline: Don’t Over-Engineer in the Beginning初始阶段不要过度设计

We don’t buy extra hardware: 没有购买新硬件 Not all applications need a powerful CPU and large memory to support

high transaction rates.

We haven’t implement HA ：暂不实施高可用 Not all applications need 24x7 availability.

We only backup data for controller nodes: 仅备份控制节点 Not all data need extremely high security.

We don’t engineer for extremely concurrent usage of all users: 不考虑所有用户同时使用等极端情况Not all user will use the system at same time

CIeNET PROPRIETARY

04/12/2023 13

Re-use Resources已有资源利用High End Computers: 少数“中高端”机做控制节点和计算节点

Control Node and Computing NodeEG:

DELL R510, Xeon E5 2420 1.9G, 16G RAM, 500G * 7, 1Gb NICHP DL380, 2 4-core Intel® Xeon® X5550 ， 16GB RAM ， 1Gb NIC

Low End Computers: 大量普通机器做存储StorageEG ：

DELL 980/990, Intel i5 3.20GHz 4G RAM 500G * 4, 100Mb NICDELL 320, Intel Core2 1.80GHz 2G RAM 80G * 10, 100Mb NIC

CIeNET PROPRIETARY

04/12/2023 14

The Infrastructure 我们搭建的基础设施

Storage Node

OpenStack IaaS Software

KVMVirtualization

KVMKVM

Compute Node

Users

CIeNET PROPRIETARY

04/12/2023 15

Controller:HP DL380

Computer:DELL R510 ／

980 Storage:DELL 980/990

／ 320

CIeNET PROPRIETARY

04/12/2023 16

Software Version: 软件版本Ubuntu 12.04 64-bitVirtualization: QEMU-KVM-1.0

Openstack Essex ReleaseController

nova-network nova-api nova-volumeCompute Node

nova-network nova-api nova-computeStorage

Swift Proxy, Swift Object, Swift Container, Swift

CIeNET PROPRIETARY

04/12/2023 17

Beyond OpenStack: Put Development Platform Inside 整合内部开发平台

Make internal development and testing environment as a standard image. Developers can now easily access a development environment

with just the push of a button. All dependent software is included. （开发者点击鼠标就能获得想要的开发环境）

Make environment management very easy.

CIeNET PROPRIETARY

Java Dev. Env.

Android Compile Env.

Dev. Config. Management

Auto Test Framework

04/12/2023 18

Beyond OpenStack: Develop Enterprise Net Disk Module 开发企业网盘模块

Storage Node

OpenStack IaaS Software

KVMVirtualization

KVMKVM

Compute Node

CIeDISK Module SaaS Software

CIeNET PROPRIETARY

04/12/2023 19

CIeDISK Module: 我们开发的企业网盘－”瞬盘”模块User File Management 基于用户的文件管理Group Sharing 群组分享Multiple Files Upload 多文件上传Online Photo Gallery 在线照片库MAC/Windows/Tablet Clients 多客户端

CIeNET PROPRIETARY

04/12/2023 20

Planning 规划

Computers

Floating IP addressesAllocate enough floating IP addresses for virtual machines

Some issues we metPartitioning:

We should give var and tmp partitions a large amount of space since var is used for instance disk and tmp is used for snapshot generation

CIeNET PROPRIETARY

04/12/2023 21

Installation 安装

Manual InstallationWith modified OpenStack installer script

Chef/Puppet/JUJU are not used

CIeNET PROPRIETARY

04/12/2023 22

Network 网络

Network Manager: VLAN

We use 100Mb NIC

Issues we met: If floating IP and fixed IP are in same subnet, NAT translation will

fail

Some defects we met (but resolved in latest releases): Floating IPs are not released

How: Terminate an instance and show floating listsResolve: Clean the floating IPs timely

Floating IP List shows Missing InstanceReason: Delete zombie instance from databaseResolve: Set the delete status

CIeNET PROPRIETARY

04/12/2023 23

Volume 卷

To save user data after VM is terminated

Controller node needs to have enough disk space

Some defects we met:Can't create new volume:

According to the official document, tgt and iscsitarget should both be installed and started, but actually, they are conflicting services

Resolve: Stop iscsitarget

CIeNET PROPRIETARY

04/12/2023 24

Resource Quota 资源限额

Balance between user needs and system performance

The limits we set:Virtual Machine:

Provide limited flavors: (CPU/RAM/Root Disk)cloud.large 2 1024 0

cloud.small 1 512 0

TAS.large 2 2048 15GB

TAS.small 1 1024 15GB

Storage:Per user quota: 1GBFile Size: < 50MB

CIeNET PROPRIETARY

04/12/2023 25

Filtering and Scheduling 结点选择

Chance: With this method, a compute host is chosen randomly across availability zones

This is the default configuration, but will easily cause the system to be overloaded

Simple: With this method, hosts whose load is least are chosen to run the instance

Choose this configuration

CIeNET PROPRIETARY

04/12/2023 26

OA&M 监控管理

ZenossPhysical node level, not inside VM

CIeNET PROPRIETARY

04/12/2023 27

Operation Results 内部运营效果

Launched and running internallyHardware resource utilization

10% 60%Re-used old idle hardwareNew development machine launch efficiency improved

4 hours 10 minutesFile/Picture sharing

Transactions increased by 30X quarterlyPersonal space utilization

Average: 10%

CIeNET PROPRIETARY

04/12/2023 28

OpenStack-based Infrastructure Summary 关键点

OpenStack + New Modules + Customizations OpenStack + 新开发模块 + 定制化

Low cost 低成本- Open source - Re-use existing, under-utilized hardware and old PCs

Manageable 可管理 - Easy, Private, Secure, Full Control, and Extensible

CIeNET PROPRIETARY

04/12/2023 29

4. Moving to the Next Stage

未来展望

CIeNET PROPRIETARY

04/12/2023 30

More features will be implemented depending on the needs: 添加功能High AvailabilityLDAP integration (Single Sign-On)OA&MAuto InstallationSystem growth with more servers

Deploy PaaS (Cloud Foundry) and Provide Server Running Environment 部署内部“平台即服务”

OpenStack-based Feature Development 继续基于 OpenStack 开发内部云功能

CIeNET PROPRIETARY

CIeNET is the pioneer of doing development around Cloud Foundry and extending Juju for cloud software deployment

04/12/2023 31

The future working environment 未来的办公环境展望Everything is in the cloud 存储在云端Mobile 移动化Sharing among groups 基于群组的分享

Our groupware on PC and mobile devices 群组软件Group task management software has been developed and is

in alpha release now 群组任务管理Share everything in a mobile environment 分享任何东西License sharing in the cloud

OpenStack-based Mobile Office &Collaboration 移动办公与协作

CIeNET PROPRIETARY

04/12/2023 32

Our Private Cloud 我们的企业私有云全景

Storage Node

OpenStack IaaS Software

KVMVirtualization

VMwareXen

Virtual Machine Nodes

CIeDISK SaaS SoftwareCloud FoundryPaaS Software

Collaboration …

CIeNET PROPRIETARY

Developers

Users

Portal

04/12/2023 33

We realized that more features are required 功能缺失 from OpenStack and we would like to work on it:OpenStack monitor moduleInstance resource extensionDefine flavors for different projectsEmbedded HAServer usage report/statistics

CIeNET has started submitting bug fixes to the OpenStack Open Source Project 开始代码提交

We would like to share more and partner with all community participants 与所有社区参与者合作共享

Contribute to the Community 回报社区

CIeNET PROPRIETARY

04/12/2023 34

Thank You! Contact Us: Weibo: 刘希斌： @LiuXibin孙琦： @RaySun瞬联软件 : @CIeNET

CIeNET:business@cienet.com.cn

CIeNET PROPRIETARY