Questions tagged [partial-derivative]

For questions regarding partial derivatives. The partial derivative of a function of several variables is the derivative of the function with respect to one of those variables, with all others held constant.

The partial derivative of a function of several variables is the derivative of the function with respect to one of the variables, with the others held constant. The partial derivative, like the ordinary derivative, describes the rate of change of a function in a particular direction.

If $f = f(a_1, a_2, \dots, a_n)$ is a function of $n$ variables, then the partial derivative of $f$ with respect to the variable $a_i$ can be written as a limit:

$$\frac{\partial f}{\partial a_i} = \lim_{h \to 0} \frac{f(a_1, \dots, a_i + h, \dots, a_n) - f(a_1, \dots, a_i, \dots, a_n)}{h}.$$

Alternatively, this quantity can be denoted as $f_{a_i}$.

If the function has continuous partial second derivatives, then:

$$\frac{\partial}{\partial x_i}\left(\frac{\partial}{\partial x_j}\right)=\frac{\partial}{\partial x_j}\left(\frac{\partial}{\partial x_i}\right)$$

a result known as Schwarz's Theorem.

7088 questions
151
votes
4 answers

Partial derivative in gradient descent for two variables

I've started taking an online machine learning class, and the first learning algorithm that we are going to be using is a form of linear regression using gradient descent. I don't have much of a background in high level math, but here is what I…
127
votes
8 answers

derivative of cost function for Logistic Regression

I am going over the lectures on Machine Learning at Coursera. I am struggling with the following. How can the partial derivative of $$J(\theta)=-\frac{1}{m}\sum_{i=1}^{m}y^{i}\log(h_\theta(x^{i}))+(1-y^{i})\log(1-h_\theta(x^{i}))$$ where…
66
votes
1 answer

when can we interchange integration and differentiation

Let $f$ be a Riemann Integrable function over $\mathbb{R}^2$. When can we do this? $$\frac{\partial}{\partial\theta}\int_{a}^{b}f(x,\theta)dx=\int_{a}^{b}\frac{\partial}{\partial\theta}f(x,\theta)dx$$ (Here, $a$ and $b$ are not a function of…
user467365
  • 1,223
  • 1
  • 11
  • 16
59
votes
4 answers

Is there such a thing as partial integration?

Recently in my mathematics courses I was taught partial derivatives, and I wondered if the reverse exists for integrals. This may sound like a stupid question, and it probably is, but let me explain: By the fundamental theorem of calculus: $$ \int…
42
votes
3 answers

Derivative of a function with respect to another function.

I want to calculate the derivative of a function with respect to, not a variable, but respect to another function. For example: $$g(x)=2f(x)+x+\log[f(x)]$$ I want to compute $$\frac{\mathrm dg(x)}{\mathrm df(x)}$$ Can I treat $f(x)$ as a variable…
Marco
  • 821
  • 1
  • 7
  • 12
42
votes
2 answers

Notation for partial derivative of functions of functions

Say we have a function $f(x(t),t)$ and we take the partial derivative of $f(x(t),t)$ with respect to $t$ $$\frac{\partial f(x(t),t)}{\partial t}$$ Do we hold $x(t)$ constant? For example, if I had $f(x(t),t) = x(t)^2 + t$ where $x(t)=t^2$, I…
40
votes
8 answers

What is the difference between partial and normal derivatives?

I have a clarifying question about this question: What is the difference between $d$ and $\partial$? I understand the idea that $\frac{d}{dx}$ is the derivative where all variables are assumed to be functions of other variables, while with…
John Doe
  • 3,529
  • 5
  • 50
  • 89
39
votes
6 answers

Notation for partial derivatives

I thought that the meaning of $$ \frac{\partial f(x, y, z)}{\partial x} $$ is differentiation on $x$ with fixed $y$ and $z$. So $(x, y, z)$ in the numerator is just saying which variables are fixed. If I need to indicate where the derivative is…
LuianChu
  • 403
37
votes
7 answers

Why do complex functions have derivatives?

I'm sorry if I sound too ignorant, I don't have a high level of knowledge in math. The function $f(z)=z^2$ (where $z$ is a complex number) has a derivative equal to $2z$. I'm really confused about this. If we define the derivative of $f(z)$ as the…
35
votes
2 answers

Derivative of the $2$-norm of a multivariate function

I've got a function $$g(x,y) = \| f(x,y) \|_2$$ and I want to calculate its derivatives with respect to $x$ and $y$. Using Mathematica, differentiating w.r.t. $x$ gives me $ f'_x(x,y) \text{Norm}'( f(x,y))$, where Norm is $\| \cdot \|$. I read here…
Babis
  • 517
  • 1
  • 4
  • 10
32
votes
4 answers

Geometric interpretation of $\frac {\partial^2} {\partial x \partial y} f(x,y)$

Is there any geometric interpretation for the following second partial derivative? $$f_{xy} = \frac {\partial^2 f} {\partial x \partial y}$$ In particular, I'm trying to understand the determinant from second partial derivative test for determining…
29
votes
1 answer

Exponential of powers of the derivative operator

A translation operator The Taylor series of a function $f$ is $$f(x)=\sum_{n=0}^\infty\frac{(\partial_x^nf)(a)}{n!}(x-a)^n$$ where $\partial_x$ is the derivative operator. Expanding about…
19
votes
4 answers

The "second derivative test" for $f(x,y)$

I'm currently taking multivariable calculus, and I'm familiar with the second partial derivative test. That is, the formula $D(a, b) = f_{xx}(a,b)f_{yy}(a, b) - (f_{xy}(a, b))^2$ to determine the behavior of $f(x,y)$ at the point $(a, b,…
19
votes
5 answers

What is the best way to think about partial derivatives?

I'm looking for a good visual way to think about partial derivatives (and slopes and tangent lines of partial derivatives) since this concept is very new for me and a little counter intuitive. SO what is a good visual way to think about partial…
18
votes
2 answers

The notation for partial derivatives

Today, in my lesson, I was introduced to partial derivatives. One of the things that confuses me is the notation. I hope that I am wrong and hope the community can contribute to my learning. In single-variable calculus, we know that, given a…
bryan.blackbee
  • 4,199
  • 2
  • 31
  • 50
1
2 3
99 100