White Papers

Wake Up and Smell the Coffee: Evaluation Methodology for the 21st Century

Overview The paper explores the consequences of their collective inattention to methodology on innovation, makes recommendations for addressing this problem in one domain, and provides guidelines for other domains. The paper describes benchmark suite design, experimental design, and analysis for evaluating Java applications. For example, the paper introduces new criteria for measuring and selecting diverse applications for a benchmark suite. The paper shows that the complexity and nondeterminism of the Java runtime system make experimental design a first-order consideration, and they recommend mechanisms for addressing complexity and nondeterminism. Drawing on these results, the paper suggests how to adapt methodology more broadly. To continue to deliver innovations, their field needs to significantly increase participation in and funding for developing sound methodological foundations.

Download White Paper

By downloading you agree to our Terms and Conditions. These include information regarding use of your personal data.

Please disable any pop-up blocking software before downloading.

Publisher
Association for Computing Machinery
File Format
PDF
Date Published
Apr 23, 2008
Format
White Papers
Topics
Methodology, Programming Languages, Software Engineering

Similiar White Papers

Application Lifecycle Management as a Business Process

Application Lifecycle Management as a Business Process

As business processes become more dependent on software, getting that software right gets ever more important. And becau

Publisher: Microsoft  |  Tags: business process, management, software

Systems and Software Product Line Engineering with SysML, UML and the Rational Rhapsody/ Gears Bridge

Systems and Software Product Line Engineering with SysML, UML and the Rational Rhapsody/ Gears Bridge

One of the great challenges and opportunities in systems and software delivery today is Product Line Engineering - creat

Publisher: IBM  |  Tags: software

What is Application Lifecycle Management?

What is Application Lifecycle Management?

Defining application lifecycle management (ALM) isn't easy. Different people (and different vendors) take quite differen

Publisher: Microsoft  |  Tags: management, software, software development

Association for Computing Machinery White Papers

Managing ETL Processes

Managing ETL Processes

ETL tools allow the definition of sometimes complex processes to extract, transform, and load heterogeneous data into a

Publisher: Association for Computing Machinery  |  Tags: data, data integration, data warehouse, management

GPS-Free Node Localization in Mobile Wireless Sensor Networks

GPS-Free Node Localization in Mobile Wireless Sensor Networks

An important problem in mobile ad-hoc wireless sensor networks is the localization of individual nodes, i.e., each node'

Publisher: Association for Computing Machinery  |  Tags: gps, infrastructure, network

A Black-Box Approach for Web Application SLA

A Black-Box Approach for Web Application SLA

Web servers nowadays have to cope with unprecedented amounts of workload, due to increasing popularity and complexity; i

Publisher: Association for Computing Machinery  |  Tags: applications, server

Load Balancing for Multimedia Streaming in Heterogeneous Peer-to-Peer Systems

Load Balancing for Multimedia Streaming in Heterogeneous Peer-to-Peer Systems

Multimedia streaming of mostly user generated content is an ongoing trend, not only since the upcoming of Last.fm and Yo

Publisher: Association for Computing Machinery  |  Tags: user generated, user generated content, youtube

Multiobjective Network Design for Realistic Traffic Models

Multiobjective Network Design for Realistic Traffic Models

Network topology design problems find application in several real life scenarios. However, most designs in the past eith

Publisher: Association for Computing Machinery  |  Tags: network, realistic