Computer Science Stack Exchange
Computer Science Stack Exchange

Questions tagged [experimental-analysis]

18 questions
11
votes
2 answers

Is there any standard for comparing runtimes experimentally?

My situation I am writing a paper presenting a software module I developed and I want to compare its runtime to other modules for the same task. I am aware of the drawbacks of runtime experiments, but please assume as given that there is no way…
Wrzlprmft
  • 245
  • 1
  • 9
4
votes
1 answer

how to understand time complexity from a plot?

This is my first question here. I'm not a CS at all, so it might be quite trivial. I have written a program in C where I allocate memory to store a matrix of dimensions n-by-n and then feed a linear algebra subroutine with. I'm having big troubles…
Mattia Paterna
  • 155
  • 1
  • 8
2
votes
0 answers

Are there many empirical results about which metaheuristics are well-suited for which problem domains?

One of the nice things about genetic algorithms is that they can easily be used for a diverse array of problem domains, whereas PSO for example seems best-suited for candidates of real-valued vectors (although I am aware of the use of the latter in…
readyready15728
  • 121
  • 1
2
votes
1 answer

Getting O-bounds by applying regression methods to execution time measurements

Does anyone of you know how to associate an algorithm execution time (of experimental execution) to a well known complexity time? For example, say a divide and conquer algorithm lasts theoretically O(n·logn·n^2) or Ω(n·logn), in a theoretical way,…
dunnomuch
  • 23
  • 3
2
votes
0 answers

Transductive Learning vs Inductive Learning in Machine Learning

Several recent research work has shown that transductive learning/inference outperforms inductive learning/inference during classification problems. This has been found in few-shot learning, other metric learning works, etc. But all of these results…
Sandra
  • 73
  • 1
  • 8
2
votes
0 answers

What would you do if the author of a published CS article does not respond to code requests?

Since reproducibility is a major principle or basic norm of scientific experiments, simulations, and computations, what would you do or what to do if the author of a published CS article does not respond to code requests? Thanks a lot!
cser
  • 21
  • 1
1
vote
0 answers

Unsupervised learning: necessity of labels and dependency between features and labels?

I have logs of activities without labels, which describe whether an activity is normal or not. Assuming that normal behaviors will follow a Gaussian distribution, I fit Gaussian distributions on dataset. I utilized this to generate a synthetic…
pippp
  • 111
  • 2
1
vote
1 answer

Which one should I report as total network I/O bytes among Sum(InBound) or Sum(InBound + OutBound)?

I have a set of experiments with distributed environments. I am planning to present a total network I/O bytes usage of the system for each run. Which one should I report as total network I/O bytes among Sum(InBound Traffic) or Sum(InBound Traffic +…
syko
  • 275
  • 3
  • 11
1
vote
1 answer

does cpu time reflect BigO time complexity

QUESTION does CPU time reflect Big O time complexity? WHAT I MADE I implemented two Fibonacci functions in C programming language. The former has recursive behaviour while the latter has iterative behaviour. I found out that the worst case scenario…
Mattia Paterna
  • 155
  • 1
  • 8
1
vote
0 answers

Finding the total work of an array list expansion effort

Suppose we are given an array-based list data structure. Suppose that its initial capacity is $m > 0.$ When appending an element to the end of the list, if the list is full, we extend its capacity by $d > 0$ array components, copy the old content,…
coderodde
  • 60
  • 1
  • 13
1
vote
1 answer

Why does $O(n \log n)$ seem so linear?

I've implemented an algorithm, that when analyzed should be running with the time complexity of $O(n \log n)$. However when plotting the computational time against the cardinality of the input set, it seems somewhat linear and computing $R^2$…
Andreas V.
  • 11
  • 2
0
votes
1 answer

Efficient traffic allocation

Users can be assigned to one experiment on my site. I have an API that developers use to trigger logic for each experiment. They call ExperimentEngine.run() to trigger the code logic for the experiment. I would like to allocate users to each…
Chris Hansen
  • 103
  • 3
0
votes
1 answer

Avarage height of Red-Black tree

I wrote a program to discover how height of the tree is relative to the number of elements in the tree (nodes). On first test I filled array with 10-50-100-200...-1000 elements of random numbers from 0 to 32k~~ and checked their height and then…
user84267
  • 1
0
votes
0 answers

What kind of runtime behavior should we expect of Finite Element Methods?

For a typical finite element algorithms, what kind of order of growth in solution time (i.e solve stiffness matrix & post-processing) are we expected to see with an increase in number of elements? Literature I have seen show exponential and…
craxsh
  • 1
0
votes
1 answer

Difference in scale between mean page loading times and exponentially distributed page loading times?

Apologies if this is the wrong place to ask. For my experiment, I have a single-page application and a multi-page application. I am testing them with an exponential distributed delay throttling. The idea is that individual chunks are delayed by a…
user153882
  • 101
  • 2
1
2