N01 cloud computing_and_gae

Embed Size (px)

DESCRIPTION

 

Citation preview

1

Cloud ComputingandGoogle App Engine @jangsunjin

Mobile Phone: (+82) 010-4585-1770 E-Mail: [email protected]

Smart TVhttp://www.softwareinlife.com ()

1Paradigm shift ?If computers of the kind I have advocated become the computers of the future, then computing may someday be organized as a public utility just as the telephone system is a public utility... The computer utility could become the basis of a new and important industry.

John McCarthy, speaking at the MIT Centennial in 1961

John McCarthywas responsible for the coining of the term "Artificial Intelligence" in his 1955 proposal for the 1956Dartmouth Conferenceand is the inventor of theLispprogramming language.http://en.wikipedia.org/wiki/John_McCarthy_(computer_scientist) 2Utility ComputingUtility Computingis the packaging ofcomputing resources, such as computation, storage and services, as a metered service similar to a traditionalpublic utility(such aselectricity,water,natural gas, ortelephone network). http://en.wikipedia.org/wiki/Utility_computing

This model has the advantage of a low or no initial cost to acquire computer resources; instead,computational resourcesare essentially rented - turning what was previously a need to purchase products (hardware, software and network bandwidth) into a service.

3ServiceIs software a product or a service?So from the legal perspective software is really a product. I mean, a service. Sorry for this lapse.http://en.wikipedia.org/wiki/Service_(economics)http://se.ethz.ch/~meyer/publications/softdev/product-service.pdf

, .

, , , , , , , .

1960 . . .

. , . .

. . , . .

. , . . , , .

. . . '' '' . .

. . . .

(StarCraft) .19983 31, 4 9 . , (Terran) (Zerg), (Protoss) .[1] : 1998 150 ,[2]2007 950 ,[3]20092 1100 .[4]1998 ,[5] , , .[6] 450 [7], .[8] LG[9] . [10] , , . 1.13 .[11] : .

(Sector) ,, . , . .(Terran): (Terran Confederation) (United Earth Directorate, UED) " " (Terran Dominion) . , (Infested Kerrigan) . , , (Jim Raynor) , , .(Zerg): (The Overmind:) . (Tassadar) , . , , , .(Protoss): , (Dark Templar: ) (Conclave) , . (Tassadar) , - . , . (Aiur) . (Zeratul) , (Aldaris), (Raszagal) (Fenix) (Artanis) . (space opera) , .[12]

[] [20], . .[21] . ' ' , , . . [] , . ' ' '' , ' ' . . . 2 3 . . , 1.15 , 1 1.5 . 2 3 . , , . P () .

4SaaSSoftware as a serviceis software that isdeployedover the internet and/or is deployed to run behind a firewall on a local area network or personal computer. http://en.wikipedia.org/wiki/Software_as_a_Service

ASP(Application Service Provider)

ASP(Application Service Provider) ' ' . ISP(Internet Service Provider, , KT/ ) , . ASP , , SaaS(Software As A Service) .SaaS ASP '' , '' . ASP , ASP SaaS ' / ' .

With SaaS, aproviderlicenses an application to customers either as aserviceon demand, through a subscription, in a "pay-as-you-go" model, or (increasingly) at no charge when there is opportunity to generate revenue from streams other than the user, such as from advertisement or user list sales.

5SaaS, PaaS, IaaSApplicationsRuntimesSecurityDatabasesServersVirtualizationHardwareStorageNetworkingApplicationsRuntimesSecurityDatabasesServersVirtualizationHardwareStorageNetworkingApplicationsRuntimesSecurityDatabasesServersVirtualizationHardwareStorageNetworkingSoftware(as a Service)Platform(as a Service)Infrastructure(as a Service)Managed by VendorSaaS Platform Structure

SaaS SaaS Metadata Multi-Tenant

, , , ( ) UI

7Network Traffic1 EB = 1,000,000,000,000,000,000 B = 1018bytes = 1 billion gigabytes = 1 million terabytes

Exabytes per Month of Mobile Data Traffic by 2015High-End Devices Can Multiply TrafficThe Network is the computerThe network will truly be the computer.Google's CEO, Eric Schmidt, The Economist, 2006

Gilders Law: Bandwidth grows at least three times faster than computer power.George F. Gilder

http://googlesystem.blogspot.com/2006/11/network-will-truly-be-computer.htmlhttp://en.wikipedia.org/wiki/George_Gilder

, , , 4 .

1." "?

TR(Transistor) 18 2 Cost .

* " " ?

,

Chip , Text, . "System on Chip" sytem . .

* ?

(Gordon Moore) CPU , .70 80 CPU 8086/8088 22,000 . 90 5,700,000 CPU 20 260 . 82 8088 CPU 22,000 TR , 97 5,700,000 TR , (97 -82)12/18 = 10 , 22,000 2^10=22,528,000. 5,700,000 4 .

, 10 CPU .

" 1 50 " CPU .

2." "?

12 3 .

* " ?

(DVD,CD ) Internet . Life Cycle (, SOHO, Mobile office, ) . EOD(Entertainment On Demand) .

. . 1966 Kao . 10 1970 50~100Mbps , 2.5Gbps . ,1Gbps 1 200 2,500,000 .

3.(Metcalf's law) ?

, .

* " " ?

Total solution . [Hardware + Contents +Service] Proto . , AV IT . Bluetooth,IEEE1394 .

*

(Robert Mecalf) '80 '3Com' . . 2~3 , , / (, , , , , ) . ., . .

" " , " 100 2 ", . .

4.(Coase's Law) ?

, .

* ?

(Downsizing) . 2 . , , .

*

(Coase) 1991 . . . .

cf. ?

. (map) . . , . .Source :http://handeum.chonnam.ac.kr/SpecialDoc/Digitial_Law.htm

9The Network EffectMetcalfe's law: Network value rises by the square of the number of terminals.Robert Metcalfe

Metcalfe's law characterizes many of the network effects of communication technologies and networks such as the Internet, social networking, and the World Wide Web.

http://en.wikipedia.org/wiki/Robert_Metcalfehttp://en.wikipedia.org/wiki/Metcalfe's_law , .

." . 5 10 . 12 66 ...."

(ARPANET) . MIT MAC . MIT MIP(Interface Messenger Protocol) . . . (X-PARC) . . . .1959 1970 500 40 . .

. (ALOHANet) . . . . . 1 . 400km. . . , . , 80 . 2 . .1973 5 22. (alto Ethernet)' . ' ' . (Ring) . .

(3Com) . . 6 1979 '(3Com)' . 16 2 . . (Computers),(Communication), (Compatibility) 3Com .3M 3Com ? .'' 1993 . 35mm .

DEC,(Intel),(Xerox) DIX ,IBM . IBM 60 . . 19654 . 18 2 . . ' ' IT . . , '(critical mass)' . . . . AOL- . (ARPANET) '(APRA NetGuy)' . ,, . . . 2.0 .,,, 2.0 . . 2001 (VC) , .2010 4. HP 27 10Cloud ComputingCloud computingdescribes computation, software, data access, and storage services that do not require end-user knowledge of the physical location and configuration of the system that delivers the services.http://en.wikipedia.org/wiki/Cloud_Computing

5 . . 5 .? ? : , ? ? SLA ?

? , , . . , . , . ., . . , . . . , . . , , . . . . SAP . . . . (Excellent Management Systems) . , , . . . IT ( ) . . , . , . . . , , . . , HIPAA . . IT . , , . IT . IT . IT , . (X ) X ? . ?, . ., ( ) , . ., . . . 6 .

11Key Benefit of Cloud ComputingEconomic Element Pay-as-you-go Pay-as-you-grow Utility based payment Lower TCO

Architectural Element Simple, development Abstract environment Easy & Agile Development Device & Location Independent 24x7 Support(SLA) Secure Storage Management Highly Automated

Strategic Element Focus on your core business Reliability & Scalability Lower Capital ExpenditureGreater business flexibility:A cloud model gives you the ability to respond to business demands more effectively and helps ensure employees have on-demand access to critical business information, customers, partners, and each other, using nearly any device, from virtually anywhere. The result: They can give priority to the most critical business tasks first.Greater resource agility:The management burden of anticipating and building out excess capacity IT infrastructure decreases. The resultless management, maintenance, and deployment time, with the additional benefit of greater scalability to more easily handle peaks in demand.Managed costs:From a financial perspective, you can manage costs as a capital expense or an operational expense depending on what works best for your business.Smaller carbon footprint:At the same time, using off-premises IT infrastructure has the additional value of decreasing your environmental impact through a reduction in the physical resources required to run on-premises systems.Increased Mobility:Employees can access information from wherever they are, instead of having to remain at their desks.Reduced work load and maintenance:IT pros need not to worry anymore about hardware, and latest software upgrades.Safe and Secure network:Security could improve due to centralization of data, increased security-focused resources, etc.,Security is often as good as or better than under traditional systems, in part because providers are able to devote resources to solving security issues that many customers cannot afford. The complexity of security is greatly increased when data is distributed over a wider area and / or number of devices.

12Key Factor of Cloud ComputingCostScalabilityFlexibilityAvailabilityPortabilityCollaboration

http://www.b10wh.com/2009/02/the-size-of-the-company-does-not-reflect-on-utilization-of-cloud-computing/VSSecurityPrivacySLAReduce run time and response timeFor applications that use the cloud essentially for running batch jobs, cloudcomputing makes it straightforward to use 1000 servers to accomplish a task in1/1000 the time that a single server would require.

Minimize infrastructure riskIT organizations can use the cloud to reduce the risk inherent in purchasing physicalservers. Will a new application be successful? If so, how many servers are neededand can they be deployed as quickly as the workload increases? If not, will a largeinvestment in servers go to waste? If the applications success is short-lived, willthe IT organization invest in a large amount of infrastructure that is idle most of thetime?

13Capacity vs Usage

, . .- : . . , .- : . . . .- : . RFP . .- : , 0.10 . . , ? .1. . , .2. EC2 . 24 . , . , 100 . 100 EC2 . 3 . IT . , 100.3. EC2 . . EC2 . . . , .

14Category of Cloud ComputingPublic Cloud The public cloud is standardized cloud computing where all resources like applications and storage is made available to general public over the internet by services provider itself, which offers it free of cost or pay-per use basis.

Hybrid Cloud Hybrid cloud can be defined as use of both physical hardware and virtualized cloud server instance together to provide a single common service. Two separate clouds joined together or combination of virtualized cloud server instances used together with real physical hardware is also known as Combined cloud.

Private Cloud Private cloud provides hosted services to a limited number of people, may be within the cooperation, behind a firewall and it is also called internal cloud.

Cloud Ecosystem

. PaaS ."PaaS , , . () . ." PaaS IaaS . IaaS DB . .

" . IT . 5 10 , , , ." . , . . ." . . ( ) . ."

16Wikinomics4 Key principlesOpennessPeeringSharingActing Globally

17Cloud Computing 18

http://open.blogs.nytimes.com/2008/05/21/the-new-york-times-archives-amazon-web-services-timesmachine/The New York Times Archives + Amazon Web Services = TimesMachine 1851 9 1980 12 PDF 130 1100 S3 4TB

EC2 Hadoop PDF 100 Hadoop 24 : 240 IT 14 1.5TB PDF S3 .

TimesMachineis a collection of full-page image scans of the newspaper from 18511922 (i.e., the public domain archives). Organized chronologically and navigated by a simple calendar interface, TimesMachine provides a unique way to traverse the historical archives of The New York Times. Topics ranging from the Civil War to the sinking of the Titanic to the first cross-country auto race to womens fashions in the 20s are just a few electronic flips away. And of course, theres the advertisements.

This all adds up to terabytes of data, in a less-than-web-friendly format. Soreusing the EC2/S3/Hadoop method I discussed back in November, I got to work writing a few lines of code. UsingAmazon Web Services,Hadoopand our own code, we ingested 405,000 very large TIFF images, 3.3 million articles in SGML and 405,000 xml files mapping articles to rectangular regions in the TIFFs. This data was converted to a more web-friendly 810,000 PNG images (thumbnails and full images) and 405,000 JavaScript files all of it ready to be assembled into a TimesMachine. By leveraging the power of AWS and Hadoop, we were able to utilize hundreds of machines concurrently and process all the data in less than 36 hours.

18Cloud Computing Market

2010 Virtualization and Cloud Computing Survey by ZenossGoogle App Engine Google App Engine Google // Cloud Computing .

SDKAPIOperating systemApp RuntimeFault toleranceLoad balancingHardwareNetworkingVertical ScalabilityHorizontal ScalabilityGoogle App Engine .

GAE

Google App Engine

GAE

Release: 2008.04GAE SDK 1.4.2Python 2.5.2C .DjangoWebapp

Google App Engine

Java Python Release: 2009.08GAE SDK 1.4.2JDK 1.6EJB JavaEE .Thread .Servlet(JSP)Google Web Toolkit(GWT)

Java SDKhttp://java.sun.com/javase/downloads/index.jsp

Google Web Toolkithttp://code.google.com/intl/ko-KR/webtoolkit/

Eclipse IDEhttp://www.eclipse.org/downloads/

Google Plugin for Eclipse, for Eclipse 3.5 (Galileo): http://dl.google.com/eclipse/plugin/3.5GAE for Java

Java Data Objects (JDO)Java Persistence API (JPA)Java Server Faces (JSF) 1.1 - 2.0**Java Server Pages (JSP) + JSTL***Java Servlet API 2.4JavaBeans Activation Framework (JAF)Java Architecture for XML Binding (JAXB)JavaMailGAE for Java XML processing APIs including DOM, SAX, and XSLTHTTP Session support (need to enable explicitly)JRuby (Ruby)Jython (Python)Quercus (PHP)Rhino (JavaScript)Spring Framework**: JSF 1.2 and JSF 2.0 should also work if you set the com.sun.faces.enableMultiThreadedStartup context parameter to false to your web.xml file.*** JSP session beans are not supported; to enable EL parsing, add to your JSP.http://groups.google.com/group/google-appengine-java/web/will-it-play-in-app-engine Enterprise Java Beans (EJB)JAX-RPCJAX-WSJava Database Connectivity (JDBC)**Java EE Connector Architecture (JCA)Java Management Extensions (JMX)Java Message Service (JMS)Java Naming and Directory Interface (JNDI)GAE for Java Remote Method Invocation (RMI)Apache POIICEFacesHibernate

http://groups.google.com/group/google-appengine-java/web/will-it-play-in-app-engine sandbox - - - Socket JSR .GAE for Java

Google App Engine 29Google App Engine SDK

Admin Console29Google App Engine 30

30Google Apps MarketplaceThe Google Apps Marketplace offers products and services designed for Google users, including installable apps that integrate directly with Google Apps. Installable apps are easy to use because they include single sign-on, Google's universal navigation, and some even include features that integrate with your domain's data.http://www.google.com/enterprise/marketplace/

Gmailis a free,advertising-supportedwebmail,POP3, andIMAP[1]service provided byGoogle.[2][3]Gmail was launched as an invitation-onlybeta releaseon April 1, 2004[4]and it became available to the general public on February 7, 2007, though still in beta status at that time.[5]The service was upgraded from beta status on July 7, 2009, along with the rest of theGoogle Appssuite.[6][7]As of November 2010, it had 193.3 million users monthly.[8]31GAE

XMLGoogle App Engine http://code.google.com/appengine/33

33Eclipse GWT Plugin Eclipse 3.6 (Helios)http://dl.google.com/eclipse/plugin/3.6Eclipse 3.5 (Galileo)http://dl.google.com/eclipse/plugin/3.5Eclipse 3.4 (Ganymede)http://dl.google.com/eclipse/plugin/3.4Eclipse 3.3 (Europa)http://dl.google.com/eclipse/plugin/3.3

34

34Google App Engine (1/2)http://appengine.google.com35

35Google App Engine (2/2)36

36GAE 37

37GAE (1/2)38

38GAE (2/2)39

39Google App Engine (1/3)40

40Google App Engine (2/3)41

41Google App Engine (3/3)42

42 (C. R. Morris and C. H. Ferguson, 1993) .

(Open System) (Proprietary Architecture) . ServiceServiceServiceServiceServiceServiceServiceServiceServiceServiceNewServiceServiceScalabilityConfigurableMulti-tenant efficient Proprietary Service Architecture Service Based Open SystemSaaSServiceJang, Sun-Jin ([email protected])

.http://code.google.com/p/devmento-gae-seminar/