Cor-Paul Bezemer

Cor-Paul Bezemer

I am an assistant professor in the Electrical and Computer Engineering department at the University of Alberta. I head the Analytics of Software, GAmes And Repository Data (ASGAARD) lab. Before that I was working as a postdoctoral research fellow in the Software Analysis and Intelligence Lab (SAIL) at Queen's University in Kingston, Canada under the supervision of prof. Ahmed E. Hassan. My research interests cover a wide variety of software engineering and performance engineering related topics, including repository mining, computer games, performance regression analysis and performance testing. I was born in The Hague (Den Haag) in the Netherlands, where I have lived for 30 years. I studied at Delft University of Technology, where I received my BSc (2007), MSc (2009) and PhD (2014) degree in Computer Science. The title of my PhD thesis was "Performance Optimization of Multi-Tenant Software Systems" (supervised by dr. Andy Zaidman and prof. dr. Arie van Deursen).

Prospective graduate students

Are you interested in working with me? And are you interested in studying and living in one of the coolest cities in the world? I am looking for self-motivated students (undergraduate RAs, MSc or PhD, funding available).

Please contact me with your CV, your unofficial transcripts, and a short explanation of why you would like to work with me. You will get bonus points for indicating on which research topic you would like to work. If you have a cool software engineering-related idea that does not directly fit into what I have worked on in the past, please do not hesitate to contact me. As you can probably tell from my papers, my research interests are quite broad. Please note:

April, 2019

- I will serve on the program committee of the artifact evaluation track of the ESEC-FSE 2019 conference.

- I was awarded a Best Reviewer award at ICPE'19.

March, 2019

- I was awarded a Distinguished Program Committee Member award at SANER'19.

- Our paper Improving the Testing Efficiency of Selenium-based Load Tests was accepted for publication in the International Workshop on Automation of Software Test (AST)!

December, 2018

- I will serve on the program committee of the ICPE 2020 conference.

- Our paper The Impact of Feature Reduction Techniques on Defect Prediction Models was accepted for publication in the Empirical Software Engineering (EMSE) journal!

November, 2018

- I will serve on the program committee of the VASPE 2019 workshop.

October, 2018

- I will serve on the program committee of the MSR 2019 conference.

September, 2018

- Our paper Studying Bad Updates of Top Free-to-Download Apps in the Google Play Store was accepted for publication in the Transactions on Software Engineering (TSE) journal!

- I will serve as the co-chair of the VISSOFT 2019 NIER and tool demo track.

August, 2018

- I will serve on the program committee of the SANER 2019 tool demo track.

June, 2018

- I will serve on the program committee of the SANER 2019 conference.

May, 2018

- I am very happy to announce that I will be joining the University of Alberta's Electrical and Computer Engineering department as an assistant professor in July!

- I will serve on the program committee of the ICPE 2019 conference.

- Our paper An Empirical Study of Game Reviews on the Steam Platform was accepted for publication in the Empirical Software Engineering (EMSE) journal!

- I was elected as the secretary of the SPEC Research Group.

April, 2018

- Our paper How Do Developers Utilize Source Code from Stack Overflow? was accepted for publication in the Empirical Software Engineering (EMSE) journal!

- I was elected as a member of the SPEC Research Group steering committee.

March, 2018

- Our paper Studying the Consistency of Star Ratings and Reviews of Popular Free Hybrid Android and iOS Apps was accepted for publication in the Empirical Software Engineering (EMSE) journal!

February, 2018

- I will serve on the program committee of the NIER/Tool demo track of the VISSOFT 2018 conference.

- Our paper Studying the consistency of star ratings and the complaints in 1 & 2-star user reviews for top free cross-platform Android and iOS apps was accepted for publication in the Empirical Software Engineering (EMSE) journal!


Publications

Journal Papers

  1. Masanari Kondo, Cor-Paul Bezemer, Yasutaka Kamei, Ahmed E. Hassan, Osamu Mizuno. The Impact of Feature Reduction Techniques on Defect Prediction Models. Empirical Software Engineering (EMSE), 2018
  2. Safwat Hassan, Cor-Paul Bezemer, Ahmed E. Hassan. Studying Bad Updates of Top Free-to-Download Apps in the Google Play Store. Transactions on Software Engineering (TSE), 2018
  3. Dayi Lin, Cor-Paul Bezemer, Ying Zou, Ahmed E. Hassan. An Empirical Study of Game Reviews on the Steam Platform. Empirical Software Engineering (EMSE), 2018
  4. Yuhao Wu, Shaowei Wang, Cor-Paul Bezemer, Katsuro Inoue. How Do Developers Utilize Source Code from Stack Overflow?. Empirical Software Engineering (EMSE), 2018
  5. Hanyang Hu, Shaowei Wang, Cor-Paul Bezemer, Ahmed E. Hassan. Studying the Consistency of Star Ratings and Reviews of Popular Free Hybrid Android and iOS Apps. Empirical Software Engineering (EMSE), 2018
  6. Hanyang Hu, Cor-Paul Bezemer, Ahmed E. Hassan. Studying the consistency of star ratings and the complaints in 1 & 2-star user reviews for top free cross-platform Android and iOS apps. Empirical Software Engineering (EMSE), 2018
  7. Mohamed Sami Rakha, Cor-Paul Bezemer, Ahmed E. Hassan. Revisiting the Performance of Automated Approaches for the Retrieval of Duplicate Reports in Issue Tracking Systems that Perform Just-in-Time Duplicate Retrieval. Empirical Software Engineering (EMSE), 2017
  8. Mohamed Sami Rakha, Cor-Paul Bezemer, Ahmed E. Hassan. Revisiting the Performance Evaluation of Automated Approaches for the Retrieval of Duplicate Issue Reports. Transactions on Software Engineering (TSE), 2017
  9. Mojtaba Bagherzadeh, Nafiseh Kahani, Cor-Paul Bezemer, Ahmed E. Hassan, Juergen Dingel, James R. Cordy. Analyzing a Decade of System Calls. Empirical Software Engineering (EMSE), 2017
  10. Safwat Hassan, Chakkrit Tantithamthavorn, Cor-Paul Bezemer, Ahmed E. Hassan. Studying the Dialogue Between Users and Developers of Free Apps in the Google Play Store. Empirical Software Engineering (EMSE), 2017
  11. Dayi Lin, Cor-Paul Bezemer, Ahmed E. Hassan. An Empirical Study of Early Access Games on the Steam Platform. Empirical Software Engineering (EMSE), 2017
  12. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, Mark D. Syer, Ahmed E. Hassan. Examining the Stability of Logging Statements. Empirical Software Engineering (EMSE), 2017
  13. Cor-Paul Bezemer, Shane McIntosh, Bram Adams, Daniel M. German, Ahmed E. Hassan. An Empirical Study of Unspecified Dependencies in Make-Based Build Systems. Empirical Software Engineering (EMSE), 2017
  14. Dayi Lin, Cor-Paul Bezemer, Ahmed E. Hassan. Studying the Urgent Updates of Popular Games on the Steam Platform. Empirical Software Engineering (EMSE), 2016
  15. Cor-Paul Bezemer, Elric Milon, Andy Zaidman, and Johan Pouwelse. Detecting and analyzing I/O performance regressions. Journal of Software: Evolution and Process (JSEP), 2014
  16. Jaap Kabbedijk, Cor-Paul Bezemer, Andy Zaidman, and Slinger Jansen. Defining multi-tenancy: A structured mapping study on the academic and industrial perspective. Journal of Systems and Software, 2014
  17. Cor-Paul Bezemer and Andy Zaidman. Performance optimization of deployed software-as-a-service applications. Journal of Systems and Software, 2014

Conference Papers

  1. Philipp Leitner, Cor-Paul Bezemer. An exploratory study of the state of practice of performance testing in Java-based open source projects. International Conference on Performance Engineering (ICPE), 2017
  2. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, and Ahmed E. Hassan. Logging Library Migrations: A Case Study for the Apache Software Foundation Projects. Mining Software Repositories (MSR), 2016
  3. Tarek M. Ahmed, Cor-Paul Bezemer, Tse-Hsun Chen, Ahmed E. Hassan and Weiyi Shang. Studying the Effectiveness of Application Performance Management (APM) Tools for Detecting Performance Regressions for Web Applications: An Experience Report. Mining Software Repositories (MSR), 2016
  4. Ravjot Singh, Cor-Paul Bezemer, Weiyi Shang, and Ahmed E. Hassan. Optimizing the performance configuration of object-relational mapping frameworks using a multi-objective genetic algorithm. ACM/SPEC International Conference on Performance Engineering (ICPE), 2016
  5. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, and Ahmed E. Hassan. Examining the stability of logging statements. IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER), 2016
  6. Cor-Paul Bezemer, Andy Zaidman, Ad van der Hoeven, Andre van de Graaf, Maarten Wiertz, and Remko Weijers. Locating performance improvement opportunities in an industrial software-as-a-service application. International Conference on Software Maintenance (ICSM), 2012
  7. Cor-Paul Bezemer, Andy Zaidman, Bart Platzbeecker, Toine Hurkmans, and Aad ’t Hart. Enabling multi-tenancy: An industrial experience report. International Conference on Software Maintenance (ICSM), 2010
  8. Cor-Paul Bezemer, Ali Mesbah, and Arie van Deursen. Automated security testing of web widget interactions. European Software Engineering Conference/ACM SIGSOFT International Symposium on the Foundations of Software Engineering (ESEC/FSE), 2009

Short Papers

  1. Cor-Paul Bezemer, Johan Pouwelse, and Brendan Gregg. Understanding software performance regressions using differential flame graphs. IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER), 2015
  2. Cor-Paul Bezemer and Andy Zaidman. Server overload detection and prediction using pattern classification. International Conference on Autonomous Computing (ICAC), 2011

Workshop Papers

  1. Shahnaz M. Shariff, Heng Li, Cor-Paul Bezemer, Ahmed E. Hassan, Thanh H. D. Nguyen, Parminder Flora. Improving the Testing Efficiency of Selenium-based Load Tests. 14th IEEE/ACM International Workshop on Automation of Software Test (AST), 2019
  2. Cor-Paul Bezemer and Andy Zaidman. Multi-tenant saas applications: maintenance dream or nightmare?. Joint ERCIM Workshop on Software Evolution (EVOL) and International Workshop on Principles of Software Evolution (IWPSE), 2010

Other Publications

  1. Cor-Paul Bezemer. Performance testing in Java-based open source projects. IEEE Software Blog, 2017

Theses

  1. Performance Optimization of Multi-Tenant Software Applications, PhD thesis 2014
  2. Automated security testing of AJAX web widgets, MSc thesis, 2009


Research

My research focuses on helping software developers understand the consequences of their code changes on the performance their application. In general, developers are not aware of these consequences. I am trying to bridge the gap between software and performance engineering to help them become aware.

In addition, I am interested in mining software repositories, log analysis, software bugs, mobile apps and software engineering in general.

Scientific Activities

Invited Talks

  1. Performance Regression Analysis, MSR Asia Summit, 2017
  2. Performance Regression Analysis: Challenges and Opportunities, International Workshop on Large-Scale Testing (LT) (co-located with ICPE), 2016

Organization

  1. Workshop chair, Financial chair ICPE 2020
  2. NIER & tool demo chair VISSOFT 2019
  3. Social media chair MSR, 2018
  4. International Workshop on Large-Scale Testing & Benchmarking (LTB), 2017, 2018
  5. Software Industry Conference (Academic track), 2015, 2016

Program committee

  1. ESEC-FSE (artifact evaluation track), 2019
  2. VASPE, 2019
  3. SANER (main track & tool demo track), 2019
  4. SATToSE, 2018
  5. VISSOFT (NIER/Tool demo track), 2018
  6. International Conference on Mining Software Repositories (MSR), 2018, 2019
  7. International Conference on Performance Engineering (ICPE), 2018, 2019, 2020
  8. International Workshop on Quality-aware DevOps (QUDOS), 2017, 2018
  9. International Conference on Performance Engineering (ICPE) poster/demo track, 2017
  10. International Workshop on Large-Scale Testing & Benchmarking (LTB, formerly LT), 2015, 2016, 2017
  11. International Workshop on Empirical Software Engineering in Practice (IWESEP), 2016, 2017

Reviewer for (also see my Publons profile):

  1. IEEE Transactions on Software Engineering (TSE)
  2. Springer Empirical Software Engineering (EMSE)
  3. IEEE Transactions on Services Computing (TSCSI)
  4. ACM Transactions on Software Engineering and Methodology (TOSEM)
  5. ACM Transactions on Modeling and Performance Evaluation of Computing Systems (ToMPECS)
  6. IEEE Software
  7. Elsevier Information and Software Technology
  8. SPEC RG Tool repository
  9. PeerJ Computer Science

Other activities:

  1. Member of the SPEC Research Group steering committee, 2018
  2. Vice chair SPEC RG DevOps Performance, 2018
  3. Secretary of the SPEC Research Group, 2018
  4. Attended the GI-Dagstuhl seminar on Performance engineering in the DevOps world, 2016

Awards

  1. ICPE Best Reviewer Award, 2019
  2. SANER Distinguished Program Committee Member Award, 2019
  3. CSER Fall Meeting Best Presentation Award, 2017
  4. Queen's School of Computing Research Award, 2017
  5. Microsoft Azure Sponsorship, 2016, 2017
  6. Queen's University Postdoc travel grant, 2016
  7. PoLyMORSE Open Workshop (PLOW) - Most elegant solution, 2015


Teaching

  1. ECE 321: Software Requirements Engineering, 2018 (Fall term)
  2. CISC 883: Introduction to Ultra-Large-Scale Systems, 2016
  3. CISC 882: Engineering of Ultra-Large-Scale Systems, 2016
  4. TI1310: Data structures and algorithms (seminar), 2012

Mentoring

I have (had) the pleasure of co-supervising the following students:

PhD Students

  1. 2019-.., Markos Viggiato de Almeida. Thesis topic: TBA.
  2. 2017-2019, Filipe Roseiro Cogo. Thesis topic: Software ecosystems.
  3. 2015-2016, Tarek Mamdouh. Thesis topic: Application Performance Management (APM).

Graduated:

  1. 2015-2018, Dayi Lin. Thesis topic: How can game developers leverage data from online distribution platforms? A case study of the Steam platform.
  2. 2015-2017, Mohamed Sami Rakha. Thesis title: Revisiting the Experimental Design Choices for Approaches for the Automated Retrieval of Duplicate Issue Reports.
  3. 2015-2018, Safwat Mohamed Ibrahim Hassan. Thesis: Studying User-Developer Interactions Through the Updating and Reviewing Mechanisms of the Google Play Store.

MSc Students

  1. 2018-.., Daniel Lee. Thesis topic: Computer games.
  2. 2017-.., Yiajuan Zhou. Thesis topic: Stack Overflow.
  3. 2017-.., Muhammad Ahasanuzzaman. Thesis topic: Mobile apps.
  4. 2016, Thanh Tat Quang. Thesis topic: Software ecosystems.

Graduated:

  1. 2017-2019, Shahnaz Shariff. Thesis topic: Web application performance testing.
  2. 2015-2017, Hanyang (Phenom) Hu. Thesis title: Studying the Consistency in the Perceived Quality of Cross-Platform Mobile Apps by Analyzing User Feedback. First job after graduating: open source analyst @ QNX Software Systems
  3. 2015-2017, Hammam AlGhamdi. Thesis title: Automated Approaches for Reducing the Execution Time of Performance Tests. First job after graduating: lecturer @ University of Jeddah
  4. 2015-2016, Suhas Kabinna. Thesis title: An Exploration of Challenges Associated with Software Logging in Large Systems. First job after graduating: data systems analyst @ Energy Profiles Limited
  5. 2015-2016, Ravjot Singh. Project title: Performance-related Configuration of Object-Relation Mapping Frameworks. First job after graduating: software engineer @ Nomis Solutions

BSc Students

  1. 2016, Liki Lew. Amazon reviews (MITACS summer internship).
  2. 2014, Herman Banken, Hylke Visser and Patrick van Hesteren. Vantage Practice (in collaboration with Emando).
  3. 2014, Tim Rensen and Dennis Eikelenboom. Exact Online Plugins for the Salesforce Platform (in collaboration with Exact).
  4. 2013, Jaap van Touw. A non-centralized approach to Video on Demand on mobile devices (in collaboration with Tribler).
  5. 2013, Edwin van den Houdt and Man Wai Shing. Mobile notification system (in collaboration with Exact).
  6. 2012, Bastiaan van Graafeiland, Wing Ngai and Arvind Jagesser. Tam Tam in je broekzak (in collaboration with Tam Tam).

Personal

I was born in 1984 in The Hague, in the Netherlands. I am married since April 2018 to Nadia. In my free time, I enjoy woodworking and going to the gym. I am passionate about everything strength sports-related. Over the past years I was a competitor in Strongman and Highland games.


Contact

Prospective students: please read the note above. You can find me in the Donadeo ICE building or reach me via bezemer [at] ualberta.ca.

11-368 Donadeo ICE Building
9211-116 St
Edmonton, Alberta, Canada T6G 1H9
Tel: 780.492.8355