White Papers

A Faster Index for Sorted SAS Datasets

Overview In a NESUG 2007 paper with Shuguang Zhang, The author demonstrated a compressed index (termed "Condensed index" in that paper) which provided significant performance gains (about 33% elapsed time and cpu time) in retrieving subsets from sorted datasets in which each level of the sort variables(s) has many observations, and the sort variable was used as the selection criterion. This paper extends the compressed index in two ways: replication of a SAS composite index, and further performance gains (up to 50%) by selectively replacing direct access (i.e. POINT=) techniques with sequential access (FIRSTOBS and LASTOBS). This paper demonstrates, with sample DATA steps, how to create and use a compressed index, and compares its performance to SAS indices, and to the previous results.

Download White Paper

By downloading you agree to our Terms and Conditions. These include information regarding use of your personal data.

Publisher
SAS Institute
File Format
PDF
Date Published
May 29, 2009
Format
White Papers
Topics
Application Development, Knowledge and Data Management

Similiar White Papers

Software Developer Creates an Affordable, Flexible Lab Information Management System

Software Developer Creates an Affordable, Flexible Lab Information Management System

Sciformatix wanted to make it easier and more cost-effective for scientists and other laboratory workers to manage infor

Publisher: Microsoft  |  Tags: information management, management

SAS for Real-Time Applications

SAS for Real-Time Applications

The SAS language is well suited for expressing program logic; people have been using it for over 30 years. There are man

Publisher: SAS Institute  |  Tags: applications, real-time

Best Practices for Gaining Visibility Into Application Performance

Best Practices for Gaining Visibility Into Application Performance

This white paper explains why having a "360-degree view," or comprehensive visibility, into all of your mission-critical

Publisher: SL Corporation  |  Tags: applications, business applications, management

Sterling Insurance: Cuts Quote Time by 90 Per Cent

Sterling Insurance: Cuts Quote Time by 90 Per Cent

Sterling Insurance Group needed to change its application deployment infrastructure. The company replaced the solution,

Publisher: Microsoft  |  Tags: infrastructure, sterling, time

IBM Case Study: GILFAM

IBM Case Study: GILFAM

GILFAM, the public organization whose mission is to automate the land registry in this area of France, engaged IBM to de

Publisher: IBM

SAS Institute White Papers

A Clever Demonstration of the SAS SUBSTR Function

A Clever Demonstration of the SAS SUBSTR Function

The SAS SUBSTR function differs from the substring function in other programming languages as it can be used on either s

Publisher: SAS Institute

Understanding Your Customer: Segmentation Techniques for Gaining Customer Insight and Predicting Risk in the Telecom Industry

Understanding Your Customer: Segmentation Techniques for Gaining Customer Insight and Predicting Risk in the Telecom Industry

The explosion of customer data in the last twenty years has increased the need for data mining aimed at Customer Relatio

Publisher: SAS Institute  |  Tags: crm, customer service, data, data mining

An Animated Guide: Proc Transpose

An Animated Guide: Proc Transpose

If one can think about a SAS data set as being made up of columns and rows, one can say Proc Transpose "Flips" the colum

Publisher: SAS Institute  |  Tags: data

Cool New Features in SAS Enterprise Miner 5.3

Cool New Features in SAS Enterprise Miner 5.3

SAS released Enterprise Miner 5.3 in late 2007 with a veritable plethora of cool new features for data miners everywhere

Publisher: SAS Institute  |  Tags: data, software

An Introduction to SAS Character Functions

An Introduction to SAS Character Functions

SAS software is especially rich in its assortment of functions that deal with character data. This class of functions is

Publisher: SAS Institute  |  Tags: data, software