The Art and Science of Analyzing Software Data

ISBN-13: 9780124115194 / Angielski / Miękka / 2015 / 672 str.

Bird, Christian Menzies, Tim Zimmermann, Thomas

Opis

The Art and Science of Analyzing Software Data provides valuable information on analysis techniques often used to derive insight from software data. This book shares best practices in the field generated by leading data scientists, collected from their experience training software engineering students and practitioners to master data science. The book covers topics such as the analysis of security data, code reviews, app stores, log files, and user telemetry, among others. It covers a wide variety of techniques such as co-change analysis, text analysis, topic analysis, and concept analysis, as well as advanced topics such as release planning and generation of source code comments. It includes stories from the trenches from expert data scientists illustrating how to apply data analysis in industry and open source, present results to stakeholders, and drive decisions.

• Presents best practices, hints, and tips to analyze data and apply tools in data science projects
• Presents research methods and case studies that have emerged over the past few years to further understanding of software data
• Shares stories from the trenches of successful data science initiatives in industry

Spis treści

1. Past, Present, and Future of Analyzing Software Data

Part 1 TUTORIAL-TECHNIQUES

2. Mining Patterns and Violations Using Concept Analysis
3. Analyzing Text in Software Projects
4. Synthesizing Knowledge from Software Development Artifacts
5. A Practical Guide to Analyzing IDE Usage Data
6. Latent Dirichlet Allocation: Extracting Topics from Software Engineering Data
7. Tools and Techniques for Analyzing Product and Process Data

PART 2 DATA/PROBLEM FOCUSSED

8. Analyzing Security Data
9. A Mixed Methods Approach to Mining Code Review Data: Examples and a Study of Multicommit Reviews and Pull Requests
10. Mining Android Apps for Anomalies
11. Change Coupling Between Software Artifacts: Learning from Past Changes

PART 3 STORIES FROM THE TRENCHES

12. Applying Software Data Analysis in Industry Contexts: When Research Meets Reality
13. Using Data to Make Decisions in Software Engineering:
14. Providing a Method to our Madness
15. Community Data for OSS Adoption Risk Management
16. Assessing the State of Software in a Large Enterprise: A 12-Year Retrospective
17. Lessons Learned from Software Analytics in Practice

PART 4 ADVANCED TOPICS

18. Code Comment Analysis for Improving Software Quality
19. Mining Software Logs for Goal-Driven Root Cause Analysis
20. Analytical Product Release Planning

PART 5 DATA ANALYSIS AT SCALE (BIG DATA)

21. Boa: An Enabling Language and Infrastructure for Ultra-Large-Scale MSR Studies
22. Scalable Parallelization of Specification Mining Using Distributed Computing

O autorze

is a researcher in the empirical software engineering group at Microsoft Research. He is primarily interested in the relationship between software design, social dynamics, and processes in large development projects. He has studied software development teams at Microsoft, IBM, and in the Open Source realm, examining the effects of distributed development, ownership policies, and the ways in which teams complete software tasks. He has published in the top Software Engineering venues and is the recipient of the ACM SIGSOFT distinguished paper award. Tim Menzies, Full Professor, CS, NC State and a former software research chair at NASA. He has published 200+ publications, many in the area of software analytics. He is an editorial board member (1) IEEE Trans on SE; (2) Automated Software Engineering journal; (3) Empirical Software Engineering Journal. His research includes artificial intelligence, data mining and search-based software engineering. He is best known for his work on the PROMISE open source repository of data for reusable software engineering experiments. is a researcher in the Research in Software Engineering (RiSE) group at Microsoft Research, adjunct assistant professor at the University of Calgary, and affiliate faculty at University of Washington. He is best known for his work on systematic mining of version archives and bug databases to conduct empirical studies and to build tools to support developers and managers. He received two ACM SIGSOFT Distinguished Paper Awards for his work published at the ICSE '07 and FSE '08 conferences.