LaTeX table in pandoc markdown, can't reference \label{tbl:mylabel} using @tbl:mylabel

[LunkRat]

Because I want table formatting that isn't possible with Markdown, I am pasting LaTeX tables into my pandoc Markdown. Works great. However, xnos doesn't pick up my in-text table reference when I try to reference \label{tbl:mylabel} using @tbl:mylabel

Here's my table right in the markdown:

\begin{table}
\caption[My short caption]{My Longer caption.}
\label{tbl:mylabel}
\begin{tabular}
[...]

And then when I try to reference the table with "See Table @tbl:mylabel for results", pandoc returns an error:

pandoc-tablenos: Bad reference: @tbl:mylabel.

Is it supported to reference a raw latex table from pandoc markdown with tablenos using the \label{tbl:mylabel} in the LaTex table? If yes, What am I doing wrong?

PS: The table is numbered correctly regardless of if I have a label in it.