Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GPU] Implement bias on internal FC op #23317

Merged
merged 3 commits into from
Mar 12, 2024

Conversation

dnkurek
Copy link
Contributor

@dnkurek dnkurek commented Mar 7, 2024

Added bias semantics support for internal FC op

Details:

  • Added bias semantics support for internal FC op

@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Mar 7, 2024
@dnkurek dnkurek marked this pull request as ready for review March 7, 2024 07:59
@dnkurek dnkurek requested review from a team as code owners March 7, 2024 08:00
@sshlyapn
Copy link
Contributor

sshlyapn commented Mar 7, 2024

build_jenkins

@praasz praasz added this to the 2024.1 milestone Mar 7, 2024
@dnkurek dnkurek added WIP work in progress and removed WIP work in progress labels Mar 7, 2024
Copy link
Contributor

@vladimir-paramuzov vladimir-paramuzov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

overall, LGTM

@@ -40,6 +40,7 @@ ConvertFullyConnectedToFullyConnectedCompressed::ConvertFullyConnectedToFullyCon
return in_ps.rank().is_static() && out_ps.rank().is_static() && in_ps.size() == 3 && out_ps.size() == 2;
};


Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

del

const ov::Output<Node> &decompression_scale,
const ov::Output<Node> &decompression_zero_point,
const ov::element::Type output_type = ov::element::undefined);

FullyConnectedCompressed(const ov::Output<Node> &A,
const ov::Output<Node> &B,
const ov::Output<Node> &bias,
const ov::Output<Node> &decompression_scale,
const ov::element::Type output_type = ov::element::undefined);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since Placeholder op was added recently, we may now have single c-tor for this op with all arguments. Could you modify that too? Can be done in a separate PR if you want

@@ -44,7 +44,8 @@ MoveFCReshapeToWeights::MoveFCReshapeToWeights() {
auto weights_input_m = std::make_shared<ov::pass::pattern::op::Or>(ov::OutputVector{reshape_m, transpose_m});

auto data_m = any_input();
auto fully_connected_m = wrap_type<op::FullyConnected>({data_m, weights_input_m});
auto bias_m = any_input();
auto fully_connected_m = wrap_type<op::FullyConnected>({data_m, weights_input_m, bias_m});
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: I think there's no big sense to have named variable for bias in such cases. Something like this should be shorter and won't lose any meaningful info

auto fully_connected_m = wrap_type<op::FullyConnected>({data_m, weights_input_m, any_input()});

Added bias semantics support for internal FC op
@p-durandin p-durandin enabled auto-merge March 12, 2024 05:30
@p-durandin p-durandin added this pull request to the merge queue Mar 12, 2024
Merged via the queue into openvinotoolkit:master with commit ebde6c8 Mar 12, 2024
91 of 92 checks passed
praasz pushed a commit to praasz/openvino that referenced this pull request Mar 13, 2024
Added bias semantics support for internal FC op

### Details:
 - Added bias semantics support for internal FC op
vishniakov-nikolai pushed a commit to vishniakov-nikolai/openvino that referenced this pull request Mar 13, 2024
Added bias semantics support for internal FC op

### Details:
 - Added bias semantics support for internal FC op
alvoron pushed a commit to alvoron/openvino that referenced this pull request Apr 29, 2024
Added bias semantics support for internal FC op

### Details:
 - Added bias semantics support for internal FC op
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: GPU OpenVINO GPU plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants