Upload
mikhaelsmirnov
View
452
Download
0
Embed Size (px)
Citation preview
3. Big Data. NoSQL BD. NoSQL.
big data? (.big data) - , , , , 2000- , Business Intelligence.
, GoogleTrends big data.* - *
big data? ;GPS- ;, ; ; ; .
big data . , , . , 2 2 .2. . , . , . - .3. . . , . BigData- , .
big data SQL BD . ? 5 , .
BD Google 2004 , MapReduce. : https://ru.wikipedia.org/wiki/MapReduce Google: http://research.google.com/archive/mapreduce.html
MapReduce . ( ) BD
,
6
!!
7
big data MapReduceMapReduce , Google .
:http://habrahabr.ru/post/103467/:http://habrahabr.ru/company/bitrix/blog/218003/ :http://habrahabr.ru/post/74792/ :https://msdn.microsoft.com/ru-ru/magazine/mt147240.aspx :http://www.ibm.com/developerworks/ru/library/bd-mapreduce/index.html
8
MapReduce. MR .
MapReduce.
MapReduce. Map. Map. map(), . . .
map() -. .. , , -. , , reduce.
MapReduce. Map. . . Python - Map :
def, , - (!):the quick brown fox jumps over the lazy dog
MapReduce. Shuffle. Shuffle. . map map. reduce. Map shuffle. Map Shuffle. : http://datacentric.ru/#blog, :
.
MapReduce. Reduce. Reduce. , shuffle, reduce(). reduce . , reduce(), MapReduce-., Reduce , .
Reduce :
MapReduce. Reduce. Reduce :
BigData MapReduce , Data Scientist . MR , IT .
bigdata - : http://www.slideshare.net/Data-Centric_Alliance/big-data-is-the-new-oil
BigData:http://www.slideshare.net/Data-Centric_Alliance/ss-55342365
MapReduce. MR . Big Data MapReduce Hadoop Apache.
, MapReduce Hadoop . . Hadoop, : http://habrahabr.ru/company/dca/blog/268277/
big data NoSQL .
NoSQL(not only SQL, SQL), , , , , SQL. NoSQL ACID BASE: (basic availability)- ( ). (soft state)- , , . (eventual consistency)- , .
noSQL 1. .2. .3. .4. ( ).5. : SQL .6. 7. : .
noSQL -
-
-1. - - : major keys minor keys;- .
2. : Smith/John/-/phonenumber/home- major key: 1 (Smith/John) - ();- minor key: 0 (phonenumber/home) , major key .
3. : 555 5555- , ;- , , .
-{Smith/Bob/-/phonenumber/home: 555 5555}{Smith/Bob/-/phonenumber/mobile: 333 3333}
Smith Bob phonenumber home: 555 5555 mobile: 333 3333Major keyMinor keyValue ()
, . -, , , .
(-) ( ) , () .1. Column () - (key-value).2. Column Family ( ) - , , , , .3. Keyspace ( ) - .4. SuperColumn () - , .
users:{ "1": { "firstName": "John", "lastName": "Smith", "phoneNumbers": { "home": "555 5555", "mobile": "333 3333"} }, "2": }
Get ({firstName, lastName}, "1)
- XML ., (). (). . , , () . -, . () .
JSON (JavaScript Object Notation).
- . JSON. JSON :- :, {}. , :. - .()- . []. . ,,,, :true, falsenull. - , . , \.
JSONXML
NoSQL