Programming Languages White Papers
Using Formats, MP Connect, and Other SAS Efficiency Techniques to Save Time and Disk Space
Overview Working with historic household Census data can be quite challenging. Semi-annual data sets can exceed 50 gigabytes and when working with multi-year data it is often necessary to extract information from yearly clusters of data sets exceeding 300 gigabytes. These yearly clusters, until recently, have been processed sequencally, each independent process relying on the completion of the previous process before continuing. The sorting alone of some of these data sets can take over an hour of clock time. Processing six data set representing three years of data can take six hours. By using format tables and eliminating sorts and merges, reducing repeated passes through the data, and the use of MP connect for independent processes processing time and temporary storage can be reduced by over 50 percent.
| Publisher | SAS Institute | File Format | |
|---|---|---|---|
| Date Published | February 2009 | ||
| Format | White Papers | ||
| Topics | |||
-
Did you find this white paper useful? 2 out of 10 users found this white paper useful
White Paper RSSCitizants: Bringing IT In-House
DownloadCitizant enhances IT flexibility and scalability by creating a virtualized Dell infrastructure that will pay for itself in 18 months.
Designing High Availability for Internet Information Services
End downtime forever! - Organizations today are relying more and more on Web services for the implementation of mission-critical applications. With the advent of Service-Oriented Architectures (SOAs),which make extensive use...
Five JavaScript Frameworks: A Point-by-Point Comparison
There are a multitude of JavaScript frameworks available today for programming rich client-side interactions in web applications. With many such different options, it is important to choose a framework that...
Increase Reliability with IBM WebSphere File Transfer Edition (FTE)
"Does your organization still use FTP software? Did you know these links require 3 to 4 times more time and effort to build and maintain versus SOA-based Application Integration projects?...
Energy Monitoring Firm Saves Money, Scales Business With Hosted Computing Platform
Advanced Telemetry develops systems to help businesses monitor and control energy usage, onsite or via the Internet. The company employees 22 people. Advanced Telemetry needed a cost-effective way to scale...
