1

Commodity and High-Speed Internet Access in American Research Universities

Henning Schulzrinnehgs@cs.columbia.edu

Dept. of Computer Science, Columbia University

Internet2 Fall Member MeetingAtlanta, GeorgiaNovember 1, 2000With material borrowed from Internet2 and Abilene

presentations

2

Overview

Background on American university “hierarchy’’ Typical local network configuration Regional networks, GigaPOPs Internet2: vBNS, Abilene, … On-going efforts

3

American Education Hierarchy

Research I institutions: PhD-granting Large (gov’t funded) research

programs Private (Columbia, Harvard, Yale,

NYU) or public (UMass, UC)

Four-year institutions – generally, do not grant PhDs (but BS, BA)

4

American Education Hierarchy

Two-year (“community”) colleges -> butte.cc.ca.us K-12: kindergarten through high-school (“secondary education”) Special category: HBCU = historically black colleges and universities – special programs for research and connectivity

5

2000 Carnegie Foundation Classification

Doctoral/Research Extensive (> 50 Dr./year)

Doctoral/Research Intensive (> 10 Dr./year)

Master’s Colleges & Universities I, IIBaccalaureate Colleges (Liberal Arts, General)Associate’s CollegesSpecialized (Theological, medical, E&T, business, art/music/design, law, teachers)

6

US Universities & Colleges

Classification Public Total %

D/R Ext. 102 151 3.8%

D/R Int. 64 110 2.8%

MS I 249 496 12.6%

MS II 23 115 2.9%

BS Lib. Arts 26 228 5.8%

BS General 50 321 8.1%

BS/Assoc. 15 57 1.4%

Assoc. 1,025 1,669 42.3%

Specialized 79 794 20.2%

Total 1,643 3,941 100.0%

7

US Colleges and Universities

0

200

400

600

800

1000

1200

public private profit

D/ R E

D/ R I

MS I

MS I I

BS Lib.

BS Gen.

BS/ Ass.

Assoc.

8

Research I Networking

Originally, all connected to ARPAnet and NSFnet Still partially subsidized by NSF, but for high-speed connectivity only Commodity Internet paid for by normal operational funding

9

University Network

Typically, 10-100 Mb/s switched in newer installations Possibly per-jack maintenance $ Student fees for computing

10

Example: Columbia University Network

1000Fx

11

University Network Connection

Each university chooses independently (except for state systems)

Regional network

Internet2

Internet

OC3-OC12

nOC1-T3-OC3

e.g., NYSERnet

e.g., Applied TheoryVia GigaPOP

12

University Network Connectivity

Policies differAutomatic routing via commodity or Internet2

Some, only selected labs or hosts

1 brooklyn (128.59.16.64) 1 ms 1 ms 1 ms

2 mudd-edge-1.net.columbia.edu (128.59.16.1) 2 ms nyser-gw.net.columbia.edu (128.59.1.4) 1 ms 1 ms

3 nn2k-gw.net.columbia.edu (128.59.1.6) 1 ms 1 ms 1 ms

4 199.109.5.6 (199.109.5.6) 2 ms 2 ms 1 ms

5 199.109.5.2 (199.109.5.2) 2 ms 2 ms 2 ms

6 wash-nycm.abilene.ucaid.edu (198.32.8.45) 7 ms 7 ms 6 ms

7 vbns-abilene.abilene.ucaid.edu (198.32.11.10) 9 ms 9 ms 9 ms

8 jn1-so7-0-0-1.wor.vbns.net (204.147.136.137) 9 ms 10 ms 9 ms

9 jn1-at1-0-0-17.cht.vbns.net (204.147.132.130) 14 ms 13 ms 13 ms

10 border1-rt-at6-0-0.gw.umass.edu (128.119.3.129) 28 ms 21 ms 22 ms

11 cs-gw-ext-i2.cs.umass.edu (128.119.3.146) 24 ms 22 ms 23 ms

12 kernighan.cs.umass.edu (128.119.240.46) 25 ms 28 ms 24 ms

13

Example: NYSERnet

14

University Challenges

Universal connectivity: Ethernet in every dorm room and lecture hall Wireless networks (802.11b) VoIP Multimedia conferencing Napster

www.internet2.edu

16

Internet2

“Internet2 is a consortium being led by over 180 universities working in partnership with industry

and government to develop and deploy advanced network applications and technologies,

accelerating the creation of tomorrow's Internet. Internet2 is recreating the partnership among

academia, industry and government that fostered today´s Internet in its infancy. The primary

goals of Internet2 are to:

Create a leading edge network capability for the national research

community

Enable revolutionary Internet applications

Ensure the rapid transfer of new network services and applications to the

broader Internet community.

17

Internet2 Universities184 Universities as of February 2001

18

Internet2 Partnerships

Internet2 universities are recreating the partnerships that fostered the Internet in its infancy Industry Government International

Participation fee $20,000 per annum

19

Internet2 Corporate Partners

3ComAdvanced Network &

ServicesAlcatelAmeritechAT&TCisco SystemsIBMITC^DeltacomLucent Technologies

MarconiWorldComMicrosoftNewbridge NetworksNetcom SystemsNortel NetworksQwest

CommunicationsSBC CommunicationsWCI Cable

20

Additional Participation

Over 70 Internet2 Corporate MembersOver 30 Affiliate MembersOver 30 International Partners

21

Internet2 Goals

Enable new generation of applications

Re-create leading edge R&E network capability

Transfer technology and experience to the global production Internet

22

Why Internet2?

The Internet was not designed for: Millions of users Congestion Multimedia Real time interactionBut, only the Internet can: Accommodate explosive growth Enable convergence of information

work, mass media, and human collaboration

23

Internet2 Focus Areas

Advanced Network InfrastructureMiddlewareEngineeringAdvanced ApplicationsPartnerships

24

Internet2Backbone Networks

GigaPoPOne

Internet2 Network Architecture

GigaPoPTwo

GigaPoPFour

GigaPoPThree

25

Network Architecture

Internet2 InterconnectCloud

GigaPoPOne

Regional Network

University C

CommercialInternetConnections

University B

University A

26

Internet2 GigaPoPs27 as of January 2001

27

Internet2 Backbone Networks

Donna Cox,Robert Patterson, NCSA

28

Advanced Applications

Distributed computationVirtual laboratoriesDigital librariesDistributed learningDigital videoTele-immersionAll of the above in combination

29

Virtual Laboratories

Real-time access to remote instruments

University of Pittsburgh,Pittsburgh Supercomputing Center

3-D Brain Mapping

30

Virtual Laboratories

Real-time access to remote instruments

University of North Carolina, Chapel Hill

Distributed nanoManipulator

31

Virtual Laboratories

Mauna Kea Observatories

AURAUniversity of Hawaii

32

Virtual Laboratories

Space Physics & Aeronomy Research Collaboratory (SPARC)

University of MichiganNSF

33

Tele-immersionShared virtual reality

University of Illinois at Chicago

Virtual Temporal Bone

Images courtesy Univ. of Illinois-

Chicago

34

Tele-cubicles and the CAVE

Source: University of Illinois-Chicago

35

National Networks

Internet2 Backbone Networks vBNS Abilene

Federal Backbone Networks DREN ESnet NREN SuperNet …

36

Abilene – October, 2000

Inflection point in network development OC-48c (2.5 Gb/s) IP-over-SONET backbone 53 current and pending connections in 32

states Second OC-48c connection: SoX

175 participants in 47 states and D.C. Ongoing strong partnership

Cisco, Nortel, Qwest, Indiana Univ., ITECs (NC and OH)

Increasing backbone utilization Characteristic exponential growth O(OC-12c) peak utilization on some links Traffic doubling time: 7 months

37

Seattle

Kansas City

Denver

Cleveland

New York

Atlanta

Houston

Abilene Core – autumn 2000

Sacramento

Los Angeles

Denver

Indianapolis

Washington

38

Abilene Weather Map

39

Abilene annual connection fees

Previous New

OC-3c $110,000 ($110,000) SONET & ATM

OC-12c

$320,000 $270,000 SONET

$280,000 ATM/1 PVC &

1 BGP peering

$290,000 ATM

OC-48c

$495,000 $430,000 SONET

40

Summary

Universities and state university systems are largely independent But mostly cluster into regional networks (from NSFnet days) and Internet2 vBNS (1995-2000) -> Abilene, …