Ok. So I figured it out. But I think my argument is really convoluted. I would appreciate if someone could come up with a simpler argument.
Without loss of generality, we can assume that the matrix $C$ is of full-rank $p$.
First let $B = \begin{bmatrix} A & C \\ C^T & 0 \end{bmatrix}$, where $A \in \mathbb{R}^{m \times m}$ and $C \in \mathbb{R}^{m \times p}$.
The first observation is that all the eigenvalues of this matrix have to be real. This is so since the matrix $B$ is symmetric. Also, the matrix $B$ has an eigenvalue decomposition.
Clearly, $\exists x$ such that $x^TBx > 0$. For instance, $x = [x_1 , 0]^T$ where $x_1 \in \mathbb{R}^{1 \times m}$ and $x_1 \neq 0$ and $0 \in \mathbb{R}^{1 \times p}$. Then $x^TBx =x_1^TAx_1 > 0$ since $A$ is positive definite.
Now, if we consider $x=[0,x_2]^T$ where $x_2 \in \mathbb{R}^{1 \times p}$ and $x_2 \neq 0$ and $0 \in \mathbb{R}^{1 \times m}$, then $x^TBx = 0$.
So $B$ is not positive definite. And since $B$ is symmetric, there is an eigenvalue decomposition for $B$. And hence $\exists \lambda$ such that $\lambda \leq 0$.
Now, we need to prove that $\exists \lambda$ such that $\lambda < 0$.
Now, we recognize that the matrix $B$ is full-rank.
This can be seen from the fact that the null space of the matrix $B$ is trivial.
Let $ z = \begin{bmatrix} x \\ y \end{bmatrix}$ such that $Bz = 0$.
Then we have $Ax + Cy = 0$ and $C^Tx = 0$. So we have $x = -A^{-1}Cy$ and hence we get $C^TA^{-1}Cy = 0$.
The matrix $C^TA^{-1}C$ is positive definite. This is because $C$ is full rank and is a skinny matrix. So whenever $x \neq 0$, $x^* = Cx \neq 0$ and hence $x^TC^TA^{-1}Cx = {x^*}^TA^{-1}x^* > 0$ (Since $A^{-1}$ is also positive definite).
Hence, $y=0$ is the only possible solution which implies $x=0$ and hence $z=0$ is the only vector in the null space.
So the matrix $B$ is of full-rank.
Hence, none of the eigenvalues are zero i.e. $\forall \lambda$, $\lambda \neq 0$.
Also, from previous argument, we have that $\exists \lambda$ such that $\lambda \leq 0$.
Hence, we can conclude that $\exists \lambda$ such that $\lambda < 0$. So if I choose the (or) a eigenvector $v$ corresponding to this $\lambda$, then I have $v^TBv = - \lambda ||v||_2^2 < 0$.
Hence, the matrix $B$ is Indefinite.