Condor Colinux

8/9/2019 Condor Colinux

1/17

Sumanth J.V, RCF/UNL, Condor Week 2006 1

Running Condor in a Virtual

Environment with coLinux

Sumanth J.V([email protected])

University of Nebraska - Lincoln


2/17

Theimagecannotb edisplayed.Yourcomputer may nothaveenough memorytoopen theimage,or theimagemayhavebeen corrupted.Restartyour

computer,and then open thefileagain.Ifthe red x stillappears,you may have

todeletetheimageand then insertitagain. Sumanth J.V, RCF/UNL, Condor Week 2006 2

Motivation

Most of the machines on campus run

Microsoft Windows.

Most researchers jobs require a UNIX

environment.


3/17




Initial Solution

Many machines can dual boot Linux and

Windows.

Reboot to Linux

During after hours.

Patched GRUB.

Improvements Can we achieve better utilization?

Can we be less intrusive?


4/17




Next Solution

Virtualization

Allows for better utilization and is less

intrusive.

Picking a virtualization solution

VMWare

Cooperative Linux


5/17

Theimagecannotb edisplayed.Yourcomputer may nothaveenough memorytoopen theimage,or theimagemayhavebeen corrupted.Restartyourcomputer,and then open thefileagain.Ifthe red x stillappears,you may have


VMWare

Full system emulator.

Guest OS runs unmodified.

Emulation can be resource hungry intercepts most of the guest-kernel-to-application

communications.

has to model a complete set of virtual hardware

devices. VMWare itself requires significant memory.

At the time of deployment, VMWare was not free.


6/17



coLinux

Allows the Linux kernel to run natively.

As a Windows device driver.

No bridgebetween the host kernel and the guestkernel.

Guest can run at near native speeds.

Allocate memory only for kernel and its forkedprocesses.

Windows service for guest OS startup.

Requires a patched Linux kernel.

Requires manual configuration.


7/17



coLinux Internals

Theimage cannotbe displayed.Your computer may nothaveenough memory toopen theimage,or the imagemay havebeen corrupted. Restartyour computer,and then open thefileagain.If thered x stillappears,you may havetodeletethe imageand then insertit again.

Copyright - Dan Aloni


8/17

Theimagecannotb edisplayed.Yourcomputer may nothaveenough memorytoopen theimage,or theimagemayhavebeen corrupted.Restartyourcomputer,and then open thefileagain.Ifthe red x stillappears,you may havetodeletetheimageand then insertitagain. Sumanth J.V, RCF/UNL, Condor Week 2006 8

Performance

Platform Time (min:sec)

Native Linux 39:23

coLinux 39:26

VMWare 40:53

POV-Ray execution time

Source: Build a heterogeneous cluster with coLinux and

openMosix - IBM developerWorks


9/17

Theimagecannotb edisplayed.Yourcomputer may nothaveenough memorytoopen theimage,or theimagemayhavebeen corrupted.Restartyourcomputer,and then open thefileagain.

Ifthe red x stillappears,you may havetodeletetheimageand then insertitagain. Sumanth J.V, RCF/UNL, Condor Week 2006 9

Condor on coLinux

How to determine NonCondor load

average?

How to determine keyboard/mouse activity?

What about networking?


10/17



Windows Monitoring Service

Monitors CPU load and coLinux load

Difference approximates NonCondor load.

Monitors Keyboard/Mouse idle time.

Makes this information available to

coLinux.

The monitoring service binds to the virtualnetworking device.


11/17



coLinux Networking

Bridged Networking

Uses WinPcap.

Advantage: Simple setup.

Disadvantage: Requires a real IP. NAT

Uses a TAP-Win32 networking device.

Windows performs the NAT.

coLinux does not have a real IP.

Requires GCB or OpenVPN to handle inbound connections.

OpenVPN does not open up as many ports as GCB and workswith Windows and other OSs too.

Other apps services like NFS can also work behind a NAT withOpenVPN


12/17



coLinux Networking

All coLinux installs have the same local IP

e.g 192.168.0.40.

How to identify nodes in a large install?

Change MAC address of TAP-Win32 device to

contain real hosts IP. E.g. 00:11:81:5D:44:04

on host 129.93.68.4.

Set hostname on coLinux based on MAC

address. E.g. node-68-4 on 129.93.68.4.


13/17



Configuring Condor

host_stats.sh

A simple script (on coLinux) to connect to the

monitoring service. Prints out the Total Load, Condor Load and

keyboard/mouse idle time.

+RVW2V/RDG

&R/LQX[/RDG

+RVW2V.H\ERDUG,GOH


14/17



Configuring Condor

condor_config

Setup STARTD_CRON to periodically execute

host_stats.sh Suitably edit UWCS policy.

GCB stuff.

Why not install Condor on Windows also?


15/17



Automation ofInstalls

gen_xml.exe

Determines the name of the required real network adapter.

Generates MAC address for virtual network device based on

hosts IP.

Writes coLinuxs XML file.

Non-Interactive coLinux install.

Setup Windows services.

Unzip disk images. Can perform complete install by popping in an install CD.

Template of this CD will be made available.


16/17



Acknowledgements

PRISM (Priority Research In Simulation &

Modeling)

Information Services

Computer Science & Engineering

Research Computing Facility


17/17



Thank You

Questions/Comments?

Contact for more details/updates

[email protected]

Documents

Condor Colinux