What’s New in SAS 9 Rick LangstonTitle Microsoft PowerPoint - wisug20042 Created Date...

What’s New in SAS 9

Rick LangstonSAS Institute Inc.

Platform R&D Division

Rick.Langston@sas.com

Outline

� The Billy Ts

� So many things, so little time

� ANYDATE

� MP/Connect

� DATA step

� Threads and PROC SUMMARY

Outline continued

� ODS

� Release Schedule

� Summary (not PROC SUMMARY)

Billy T. ?

William T.?

Four Pillars

� Usability

� Scalability

� Interoperability

� Manageability

The Intelligence Value Chain

SAS ® 6.09 Usability Experience…circa 1990

SAS ® Usability Experiences Today

Usability – SAS ® 9SAS® Web Report Studio

Usability – SAS ® 9SAS® Enterprise Guide 2.0

� Compatible withSAS V8 & SAS 9

� New analytictasks

� More controls� New Graph styles� New extensibility

features

Q Import XML documentsto SAS ® data sets

Q Export SAS ® data setsto XML documents

Q XML Map extensionsadd flexibility & powerto schema definitions

Q Java ® GUI maps XMLto SAS ® data & vice-versa

Java-based SAS ® XML Mapper client

Interoperability in SAS® 9SAS ® XML Mapper

So many things...

� Not enough time for everything!

� SQL improvements

� OLAP

� SPDS

� SAS Management Console

� Metadata Servers

“ANYDATE” informats

O ANYDTDTE, ANYDTDTM, ANYDTTME

O Handles most acceptable input d/t/dt informats

O mdy ambiguities handled

1 data _null_;2 input x: anydtdte20.; list; put x=date9.; cards;

x=01JAN20023 01jan2002x=31DEC20024 12/31/2002x=01MAY20025 may2002x=01JAN20026 01jan2002:12:34:56x=01JAN20027 2002-jan-01x=01JAN20028 2002001

11 options datestyle=mdy;12 data _null_;13 input x: anydtdte20.; list; put x=date9.; cards;

x=02JAN200314 01/02/03x=31DEC200215 12/31/2002x=31DEC200216 31/12/2002x=19MAR195517 55/03/19x=19MAR195518 19/03/55

19 run;20

21 data _null_;22 input x: anydtdtm20.; list; put x=datetime.; cards;

x=01JAN02:12:34:5623 01jan2002:12:34:56x=01JAN02:00:00:0024 01jan2002x=01JAN60:12:34:5625 12:34:56

28 data _null_;29 input x: anydttme20.; list; put x=time8.; cards;

x=12:34:5630 01jan2002:12:34:56x=0:00:0031 01jan2002x=12:34:5632 12:34:56

New in Connect

� MP connect is not new, but we are still “gettingthe word out”

� PIPES are new….

� hook your job steps together without using work files

signon mp1 sascmd="!sascmd";signon mp2 sascmd="!sascmd";

rsubmit mp1 wait=no;libname temp ’c:\temp’;data newbig; set sashelp.class; do index = 1 to 10000; rand = put(100000 * uniform(123), Z6.0); output; end; run;proc sort data=newbig out=temp.bigsort; by rand;run;endrsubmit;

rsubmit mp2 wait=no;libname temp ’c:\temp’;data newbig2; set sashelp.class; do index = 1 to 10000; rand = put(100000 * uniform(567), Z6.0); output; end;run;proc sort data=newbig2 out=temp.bigsort2; by rand;run;endrsubmit;

waitfor _all_ mp1 mp2;

signoff mp1;

signoff mp2;

SAS9 Common BI Infrastructure

SAS ServersOpen Metadata (OMS) Workspace Server Stored Process Data Storage

SAS Foundation Services

System Mgmt InformationUser EventConnection

SAS Query and Reporting Services

Business Metadata ReportingQuery

JNI – Interfaces

Windows Based BI ToolsSAS®

EnterpriseGuide

SAS®Information

DeliveryPortal

SAS®AppDevStudio

Dev Env.

SAS® WebReport Studio

SAS® Information Map Studio

Java Based BI Tools

SAS® ETL StudioSAS® Management Console

Portal

Re-usable COM ComponentsSAS Java Components

SAS®Add-in forMS Office

SAS 9.1.3 Shipping!

libname temp ’c:\temp’;data temp.merged; merge temp.bigsort(in=mp1) temp.bigsort2(in=mp2); by rand; if mp1 and mp2;run;

proc datasets library=temp kill; run; quit;

signon mp1a sascmd="!sascmd";signon mp1b sascmd="!sascmd";

signon mp2a sascmd="!sascmd";signon mp2b sascmd="!sascmd";

rsubmit mp1a wait=no; libname pipe1 sasesock ":pipe1"; data pipe1.newbig; set sashelp.class; length rand $8; do index = 1 to 10000; rand = put(100000 * uniform(123), Z7.0); output; end; run;endrsubmit;

rsubmit mp1b wait=no; libname pipe1 sasesock ":pipe1"; libname pipe2 sasesock ":pipe2"; proc sort data=pipe1.newbig out=pipe2.bigdata1; by rand; run;endrsubmit;

rsubmit mp2a wait=no; libname pipe3 sasesock ":pipe3"; data pipe3.newbig; set sashelp.class; length rand $8; do index = 1 to 10000; rand = put(100000 * uniform(123), Z7.0); output; end; run;endrsubmit;

rsubmit mp2b wait=no; libname pipe3 sasesock ":pipe3"; libname pipe4 sasesock ":pipe4"; proc sort data=pipe3.newbig out=pipe4.bigdata2; by rand; run;endrsubmit;

libname pipe2 sasesock ":pipe2";libname pipe4 sasesock ":pipe4";

data merged; merge pipe2.bigdata1(in=mp1) pipe4.bigdata2(in=mp2); by rand; if mp1 and mp2;run;

signoff mp1a;signoff mp1b;

signoff mp2a;signoff mp2b;

New in the DATA step

� New Functions

� Perl Regular Expressions

� DATA step Hash Tables

String Concatenation Functions

call symput(’pat’ ||

trim(left(put(total,BEST12.))) ||

trim(left(put(bycount,BEST12.))),

’pattern’||

trim(left(put(total,BEST12.))) ||

trim(left(put(bycount,BEST12.))) ||

’ c=pink v=solid ;’);

call symput(cats(’pat’, total, bycount),

cats(’pattern’, total, bycount,

’ c=pink v=solid ;’));

String Concatenation Functions

a = cat("x ", 12.3, " y");

b = catt("x ", 12.3, " y");

c = cats("x ", 12.3, " y");

d = catx("/","x ",12.3," y");

/* "x 12.3 y" */

/* "x12.3 y" */

/* "x12.3y" */

/* "x/12.3/y" */

Sorting Values

data s;

array v[50];

set a;

call sortq(of v1-v50);

data s;

array v[50];

set a;

call sortq(of v50-v1);

Median and Percentile

� y = median(5,8,0,3,4);

� /* y is 4 */

� lower_quartile = pctl(25,2,4,1,3);

� /* lower_quartile is 1.5 */

PUT to LOG == PUTLOG

data _null_;

file names;

input lastName $;

put lastName;

if lastName =: ’J’ then

putlog ’NOTE: J last name, ’ lastName;

datalines;

Harris

#1 SASWARE Ballot ItemInteger Ranges

� data a;

� array arrA[10] (1:10);

� array arrB[10];

� retain arrB (2*1:5);

� if x in (1 2 5:10) then

� put ’X in range’;

� if x in arrA then

� put ’X in arrA’;

Perl Regular Expressions

Search for prior character one or more times.

Search for one or more “A”s.

Search for a digit character.

Search for a word character, alphanumeric plus _.

Search for character in the range between A and Z.

Search for an “A”.

Search for a “B”.

Typical start and end delimiter./

Perl Regular Expressions

� /abc/

� xyzabc123

� xyzab123c

� /abc+\d/

� xyzabcccc5123

� xyzabcz

Data Validation

� Validate U.S. phone numbers that look like:

� (919) 677-8000

� Regular Expression:

� /$[2-9]\d\d$ ?[2-9]\d\d-\d\d\d\d/

Data Validation – The Code

data _null_;

if _N_ = 1 then do;

retain re;

re = prxparse("/$[2-9]\d\d$ ?[2-9]\d\d-\d\d\d\d/");

input first last phone & $16.;

if ^prxmatch(re, phone) then

putlog "NOTE: Invalid, " first last phone;

datalines;

Thomas Archer (919)319-1677

Lucy Mallory 800-899-2164

Tom Joad (508) 852-2146

Laurie Jorgensen (252)152-7583

Data Extraction

� Use parentheses to group part of the regularexpression:

� /$([2-9]\d\d)$ ?([2-9]\d\d-\d\d\d\d)/

Area CodeSubmatch #1

Local Phone NumberSubmatch #2

Data Extraction – The Code

re = prxparse("/$([2-9]\d\d)$ ?([2-9]\d\d-\d\d\d\d)/");

if prxmatch(re, phone) then do;

call prxposn(re, 1, pos, len);

areacode = substr(phone, pos, len);

call prxposn(re, 2, pos, len);

localphone = substr(phone, pos, len);

Search and Replace

� s/(\w+) \1 /\1 /

Search and Replace – The Code

data _null_;

x = ’it it happened at at SUGI’;

re = prxparse(’s/(\w+) \1 /\1 /’);

call prxchange(re, -1, x);

put x=;

/* x=it happened at SUGI */

Hash Table – Creating and Adding Data

declare Hash ht();

ht.defineKey("ISBN");

ht.defineData("author", "title");

ht.defineDone();

ISBN="0679722769";

author="Joyce"; title="Ulysses";

rc=ht.add();

Hash Table – Finding Data

ISBN="0679722769";

rc = ht.find();

if rc = 0 then

putlog "Found " author title;

Hash Table – Loading from a Dataset

data purchased_books;

if _N_ = 1 then do;

declare Hash ht(dataset: "books");

ht.defineKey("ISBN");

ht.defineData("author", "title", "price");

ht.defineDone();

length author title $ 64 price 8;

set purchased_ISBNs;

if ht.find() = 0;

This looks a lot like…

� SET with KEY=

� MERGE with BY

� Custom Format withPUT

data m;

set ids;

set data key=id;

data m;

merge ids data;

by key;

data m;

set ids;

data = put(ids, $LOOKUP.);

Hash Table – Performance

Real Time to Perform Lookup

Hash Table 3.43s Load and Search 3.43s

MERGE with BY 9.18s Sort Data Sets 7.58s Search 1.60s

SET with KEY= 47.85s Build Index 3.06s Search 44.79s

Format and PUT() 22.84s Build Format 16.03s Search 6.81s

Hash Tables – V9 Experimental

� So send in yourcomments!

� suggest@sas.com

� Embryonic…

� Java Object Class

PROC SUMMARY and threads

� What are threads?

� Dividing the work

� PROC SUMMARY groups by classes

� Each thread handles classes

� Internally a completely new implementation

� Example

PROC SUMMARY and threads

[procdata temp; input group value; cards;2 61 11 32 41 22 5;proc summary; class group; var value;

Threads

� Group 1 gets a thread and a buffer of obs

� Group 2 gets the same

� Each thread computes the statistics

� Brought back together for the output

Threads and I/O

� Will CPU outrun the I/O processing?

� No - the other way around

� Big Unix machines maximize their I/O buffering

� We need threads to keep up with the I/O

More to come for threads

� SUMMARY, SORT are the first Base apps

� REG, GLM in SAS/STAT

� More procs will come

� Also used in client/server applications

ODS Updates

� MARKUP/Tagsets

� HTML4

� Style Templates/DOCUMENT

� Page X of Y

� Text insertion

� PDF enhancements

ODS MARKUP� TAGSET templates

� YOU have the power

� Available in 8.2 experimentally

"ODS MARKUP: The Power of Choice & Change"

by Eric Gebhart

http://www2.sas.com/proceedings/sugi27/p003-27.pdf

http://www.sas.com/rnd/base/index-v9-resources.html

Tagsets

� Markup definition file� Defines how the markup should be generated

� Defines the tags and how they should be used

SAS-supplied Tagsets� A sampling of some of the available supplied tagsets:

� CSV

� Default (default XML)

� Docbook

� Event_map

� HTML4

� HTMLCSS (Cascading Style Sheets)

� LaTeX

� WML

� and many more!!!

Make your own destination

� Don’t like the supplied tagsets?

� Need a destination that SAS does not supply?� Create your own

� SYLK tagset created by Jack Hamilton

� DDE to Excel by Frank Poppe

� See http://www.sas.com/rnd/base/index-early-faq.html

Tagsets – SCSV ExampleProc Template;define tagset tagsets.SCSV;parent = tagsets.CSV;define event header; start: put ";" / if !cmp( COLSTART, "1"); put """"; put VALUE; finish: put """";end;define event data; start: put ";" / if !cmp( COLSTART, "1"); put """"; put VALUE; finish: put """";end;

define event colspanfill; put ";";end;

define event rowspanfill; put ";";end;

end; /* define tagset */

Semicolonsinstead ofcommas

Tagsets – SCSV Example

" 1";"Alfred";"M";"14";"69.0";"112.5"" 2";"Alice";"F";"13";"56.5";" 84.0"" 3";"Barbara";"F";"13";"65.3";" 98.0"

Semicolons instead ofcommas

ODS Tagsets.SCSV file = ’Ex.csv’;proc print data=sashelp.class; run;ODS Tagsets.SCSV close;

The Transition is Coming

� ODS HTML file = ’Version9.html’;

� will invoke MARKUP destination with HTML4tagset in Version 9.1 by default.

� Current 3.2 spec HTML will be accessible by setting anoption in the registry.

MARKUP & TAGSETS

� Provides ability to have Markup output YOURway

� Will be the default for HTML in Version 9.1

� Uses new TAGSET templates� otherwise referred to as Markup definitions

� Create your own destinations

ODS DOCUMENT

New ODS destination -- persists output objects inraw format

� Reorder

� Rearrange

� Replay

without rerunning your procedures

ODS DOCUMENT

RGV�GRFXPHQW�QDPH VDOHV�ZULWH��7LWOH�¶4XDUWHUO\�6DOHV�%\�3URGXFW·�SURF�WDEXODWH�GDWD VDVKHOS�SUGVDO��IRUPDW GROODU��FODVV�SURGXFW�TXDUWHU�YDU�DFWXDO�WDEOH�SURGXFW��TXDUWHU DFWXDO VXP ¶·�UXQ�RGV�GRFXPHQW�FORVH�

ODS DOCUMENT tools

Two new tools to manage ODS Documents

� Proc Document

� Graphical User Interface – ODS DocumentWindow� odsdocument

RTF: Page X of Y

No more having to insert raw RTF code

ods escapechar ’\’;title ’Hello ’ j=r ’Page \{pageof}’;

BEFORE:

title ’Hello ’ j=r ’Page {\field{\*\fldinst {\b\i PAGE}}}{\b\i of }{\field{\*\fldinst {\b\i NUMPAGES }}}’;

TEXT option

Some text BEFORE Proc Report

Name Sex Age Height Weight Alfred M 14 69 112.5

Alice F 13 56.5 84

Barbara F 13 65.3 98

Carol F 14 62.8 102.5

Henry M 14 63.5 102.5 Some text AFTER Proc Report

TEXT option

ODS RTF TEXT = ’Some text before PROC’;

ODS PDF TEXT = ’Some text before PROC’;

� Actually available in V8.2

� Improved to allow style option for formatting

TEXT option

� proc template;

� define style textstyle;

� parent = styles.printer;

� style usertext fromusertext /

� background = lightblue;

� end;

� run;

� ods rtf file = ’textopt.rtf’;

� ods rtf text = "Some text BEFOREProc Report";

� proc report data=sashelp.classnocenter nowd;run;

� ods rtf text = ’Some text AFTERProc Report’ style=textstyle;

� ods rtf close;

ODS PDF Enhancements

� Compressed

� MUCH faster

� Embedded fonts – definitely 9.1

Other SAS ® 9 FeaturesSoftware Installation

Q Customized software installations

Q Formal distribution of setinits via email

Q Setinit transparently applied by the installprogram

Q Improved “silent” install for Windows installations

Q New InstallCenter on www.sas.com

Other SAS ® 9 FeaturesShipping & Packaging

� New installation Kit

� CD packaging is 3-tiered

� All products shipped,making add-onseasy

Other SAS ® 9 Features

Section 508 Compliant

�SAS WindowingEnvironment

�Output Delivery System

National Language Support

�Japanese, Chinese, Korean

�French, German, Italian,Polish, Hungarian

SAS Display Manager in Kanji

� 9.0

� 9.1

� 9.1.2

� 9.1.3

� 9.2

��

��4�

��

��4�

��

Not carried forward from V8

� Windows 95/98

� CMS

� VAX/VMS

� 32-bit HP, Solaris, AIX

� Mac

� Intel ABI

� MIPS ABI

Summary

� Four Pillars (The Billy Ts)

� ANYDATE

� MP/Connect

� DATA step

� Threads and PROC SUMMARY

� ODS

� Release Schedule

� LOTS OF GOOD STUFF!!!

What’s New in SAS 9 Rick LangstonTitle Microsoft PowerPoint - wisug20042 Created Date...

Documents

What’s up?

Rick Schuler - Weebly

HGST Linecard 2013 Q4 s1 - Weikeng Q4.pdf · 450 GE 1200GB 750GB SATA SAS SAS SAS SATA SATA SATA SAS SAS 3Gb,'s SAS SAS 6Gb,'s SAS FCAL FcAL4GE's SAS SAS 66b,'s SAS 60b,'s SAS SAS

Performance Considerations in SAS Programming Rick Langston · PDF fileTitle: Microsoft PowerPoint - RickLangstonperformanceissues.ppt Created Date: 191041123095130

HP 3PAR StoreServ8000 Storage - what’s · PDF fileMax SSD raw capacity 921 TiB 1843 TiB 2x SAS Backend 6Gb SAS (copper only) 12Gb SAS (copper and optical) 2x

Predicas Rick Warren

Usability: What’s Hot, What’s Not

RICK NAAR 2016

Al cincilea val - Rick Yancey cand creioanele colorate s... · Title: Al cincilea val - Rick Yancey Author: Rick Yancey Keywords: Al cincilea val - Rick Yancey Created Date: 8/28/2018

Rick - Europa

What’s new?

Rick wakeman

What’s in the box - data.wikomobile.com · Wiko SAS 1, rue Capitaine Dessemond - 13007 Marseille - France μας ή επικοινωνήστε με το σημείο πώλησης

RICK - UNABCC

What’s hot

What’s This?

WHAT’S KNOWN WHAT’S NEW WHAT’S NEXT - DCRI · WHAT’S KNOWN WHAT’S NEW WHAT’S NEXT ANNUAL REPORT ... fewer adults would be taking the drug than if they ... pros and cons

Dr. Rick Kirschner

Rick owens

Presentatie Rick Griffin