New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement Global attention mechanism #237

Open

akhilpandey95 opened this issue Apr 9, 2024 · 1 comment

Assignees

Labels

Collaborator

akhilpandey95 commented Apr 9, 2024

resources to consider

https://pytorch-geometric.readthedocs.io/en/1.3.1/_modules/torch_geometric/nn/glob/attention.html

allaffa assigned akhilpandey95

allaffa added the enhancement label

Collaborator

allaffa commented Apr 12, 2024 •

edited

Global attention can mean many things. A few examples are:

concatenate global input features to the graph embedding layer created by the message passing layers.
a "slight" generalization of the above consists in passing the global input features into an MLP, and then concatenate the output to the graph embedding generated by the MPNN layers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment