Skip to content

Datasets block refactor #95

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
LukyanovKirillML merged 24 commits into from
Nov 10, 2025
Merged

Datasets block refactor #95

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
15ad985
+
mishadr Feb 27, 2025
3d8d509
+
mishadr Feb 28, 2025
48c7b6a
Merge branch 'develop' into heterographs
mishadr Mar 25, 2025
a26d5e7
can draw heterograph, no dataset var data
mishadr Mar 28, 2025
ffa9d74
+
mishadr May 8, 2025
e51c208
Merge branch 'develop' into datasets_block_refactor
mishadr Jun 25, 2025
0b5fd5c
+
mishadr Jun 28, 2025
f711e41
+
mishadr Jul 4, 2025
3839048
commit with powergraph to use for experiments
mishadr Jul 14, 2025
b5a3793
add download to powergraph
mishadr Jul 15, 2025
4d86898
Small fix for PowerGraph + launch experiment
Jeratt Jul 17, 2025
0000f26
+
mishadr Jul 23, 2025
c167273
+
mishadr Jul 23, 2025
d3d0c88
+
mishadr Jul 24, 2025
16fdc36
Merge branch 'PowerGraphFix' into datasets_block_refactor
mishadr Aug 1, 2025
6fd9c0a
+
mishadr Aug 5, 2025
fda58d7
+
mishadr Aug 13, 2025
fe029e7
add datasets with constructor parameters
mishadr Oct 16, 2025
2372719
now support almost all ptg graphs
mishadr Nov 1, 2025
6846c56
Merge branch 'develop' into datasets_block_refactor
mishadr Nov 1, 2025
4585100
rename datasets_block
mishadr Nov 5, 2025
db19f84
fix docs yaml and pyproject toml
mishadr Nov 5, 2025
6f98a48
importall -> imports in init files
mishadr Nov 7, 2025
eaeb680
fix gen_dataset.dataset.data -> gen_dataset.data
mishadr Nov 9, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 2 additions & 3 deletions .github/workflows/docs.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,13 +21,12 @@ jobs:
run: |
sudo apt update
python -m pip install --upgrade --no-cache-dir pip setuptools
python -m pip install --exists-action=w --no-cache-dir -r requirements1.txt
python -m pip install --exists-action=w --no-cache-dir -r requirements2.txt
pip install -r requirements1.txt -r requirements2.txt
python -m pip install --exists-action=w --no-cache-dir -r docs/requirements.txt
python -m pip install --upgrade --upgrade-strategy eager --no-cache-dir .

- name: Build documentation
# Build the documentation, you can use this command locally
run: |
cd docs/source
python -m sphinx -T -W --keep-going -b html -d _build/doctrees -D language=en . docs/html
python -m sphinx -T --keep-going -b html -d _build/doctrees -D language=en . docs/html
20 changes: 20 additions & 0 deletions data/example/custom/karate/metainfo
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
{
"class_name": "KnownFormatDataset",
"import_from": "datasets.known_format_datasets",
"count": 1,
"name": "Zachary karate club",
"nodes": [34],
"remap": false,
"directed": false,
"node_attributes": {
"names": [],
"types": [],
"values": []
},
"labelings": {
"0 and 33 nodes": 2,
"2comms": 2,
"3comms": 3,
"4comms": 4
}
}
78 changes: 78 additions & 0 deletions data/example/custom/karate/raw/edges.ij
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,78 @@
0 1
0 2
1 2
0 3
1 3
2 3
0 4
0 5
0 6
4 6
5 6
0 7
1 7
2 7
3 7
0 8
2 8
2 9
0 10
4 10
5 10
0 11
0 12
3 12
0 13
1 13
2 13
3 13
5 16
6 16
0 17
1 17
0 19
1 19
0 21
1 21
23 25
24 25
2 27
23 27
24 27
2 28
23 29
26 29
1 30
8 30
0 31
24 31
25 31
28 31
2 32
8 32
14 32
15 32
18 32
20 32
22 32
23 32
29 32
30 32
31 32
8 33
9 33
13 33
14 33
15 33
18 33
19 33
20 33
22 33
23 33
26 33
27 33
28 33
29 33
30 33
31 33
32 33
2 changes: 2 additions & 0 deletions data/example/custom/karate/raw/labels/0 and 33 nodes
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
{"0": 0, "1": null, "2": null, "3": null, "4": null, "5": null, "6": null, "7": null, "8": null, "9": null, "10": null, "11": null, "12": null, "13": null, "14": null, "15": null, "16": null, "17": null, "18": null, "19": null, "20": null, "21": null, "22": null, "23": null, "24": null, "25": null, "26": null, "27": null, "28": null, "29": null, "30": null, "31": null, "32": null, "33": 1}

2 changes: 2 additions & 0 deletions data/example/custom/karate/raw/labels/2comms
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
{"0": 0, "1": 0, "2": 0, "3": 0, "4": 0, "5": 0, "6": 0, "7": 0, "8": 1, "9": 1, "10": 0, "11": 0, "12": 0, "13": 0, "14": 1, "15": 1, "16": 0, "17": 0, "18": 1, "19": 0, "20": 1, "21": 0, "22": 1, "23": 1, "24": 1, "25": 1, "26": 1, "27": 1, "28": 1, "29": 1, "30": 1, "31": 1, "32": 1, "33": 1}

2 changes: 2 additions & 0 deletions data/example/custom/karate/raw/labels/3comms
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
{"0": 0, "1": 0, "2": 0, "3": 0, "4": 2, "5": 2, "6": 2, "7": 0, "8": 1, "9": 0, "10": 2, "11": 0, "12": 0, "13": 0, "14": 1, "15": 1, "16": 2, "17": 0, "18": 1, "19": 0, "20": 1, "21": 0, "22": 1, "23": 1, "24": 1, "25": 1, "26": 1, "27": 1, "28": 1, "29": 1, "30": 1, "31": 1, "32": 1, "33": 1}

2 changes: 2 additions & 0 deletions data/example/custom/karate/raw/labels/4comms
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
{"0": 1, "1": 1, "2": 1, "3": 1, "4": 0, "5": 0, "6": 0, "7": 1, "8": 3, "9": 3, "10": 0, "11": 1, "12": 1, "13": 1, "14": 3, "15": 3, "16": 0, "17": 1, "18": 3, "19": 1, "20": 3, "21": 1, "22": 3, "23": 2, "24": 2, "25": 2, "26": 3, "27": 2, "28": 2, "29": 3, "30": 3, "31": 2, "32": 3, "33": 3}

2 changes: 2 additions & 0 deletions data/single-graph/custom/example/raw/.info → data/example/example/metainfo
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
{
"class_name": "KnownFormatDataset",
"import_from": "datasets.known_format_datasets",
"name": "example",
"count": 1,
"directed": false,
Expand Down
0 ...xample/raw/example.edge_attributes/weight → ...xample/example/raw/edge_attributes/weight
View file
Open in desktop
File renamed without changes.
0 ...ingle-graph/custom/example/raw/example.ij → data/example/example/raw/edges.ij
View file
Open in desktop
File renamed without changes.
0 .../custom/example/raw/example.labels/binary → data/example/example/raw/labels/binary
View file
Open in desktop
File renamed without changes.
0 ...m/example/raw/example.labels/threeClasses → data/example/example/raw/labels/threeClasses
View file
Open in desktop
File renamed without changes.
0 ...tom/example/raw/example.node_attributes/a → data/example/example/raw/node_attributes/a
View file
Open in desktop
File renamed without changes.
0 ...tom/example/raw/example.node_attributes/b → data/example/example/raw/node_attributes/b
View file
Open in desktop
File renamed without changes.
2 changes: 2 additions & 0 deletions .../multiple-graphs/custom/example/raw/.info → data/example/example3/metainfo
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
{
"class_name": "KnownFormatDataset",
"import_from": "datasets.known_format_datasets",
"name": "example",
"count": 3,
"nodes": [3, 4, 5],
Expand Down
0 ...xample/raw/example.edge_attributes/weight → ...ample/example3/raw/edge_attributes/weight
View file
Open in desktop
File renamed without changes.
0 ...phs/custom/example/raw/example.edge_index → data/example/example3/raw/edge_index
View file
Open in desktop
File renamed without changes.
0 ...iple-graphs/custom/example/raw/example.ij → data/example/example3/raw/edges.ij
View file
Open in desktop
File renamed without changes.
0 .../custom/example/raw/example.labels/binary → data/example/example3/raw/labels/binary
View file
Open in desktop
File renamed without changes.
0 ...m/example/raw/example.labels/threeClasses → .../example/example3/raw/labels/threeClasses
View file
Open in desktop
File renamed without changes.
0 .../example/raw/example.node_attributes/type → ...example/example3/raw/node_attributes/type
View file
Open in desktop
File renamed without changes.
81 changes: 81 additions & 0 deletions data/example/example3_gml/metainfo
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@
{
"class_name": "KnownFormatDataset",
"import_from": "datasets.known_format_datasets",
"format": "gml",
"name": "example of multiple graphs in gml format",
"count": 3,
"directed": false,
"hetero": false,
"nodes": [
4,
4,
5
],
"remap": true,
"node_attributes": {
"names": [
"a",
"b"
],
"types": [
"continuous",
"categorical"
],
"values": [
[
0,
100
],
[
"alpha",
"beta",
"gamma",
"delta"
]
]
},
"edge_attributes": {
"names": [
"weight",
"type"
],
"types": [
"continuous",
"categorical"
],
"values": [
[
0,
5
],
[
"mixed",
"complex",
"hybrid"
]
]
},
"labelings": {
"binary": 2
},
"node_attr_slices": {
"a": [
0,
1
],
"b": [
1,
5
]
},
"edge_attr_slices": {
"weight": [
0,
1
],
"type": [
1,
4
]
}
}
48 changes: 48 additions & 0 deletions data/example/example3_gml/raw/graph1.gml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
graph [
node [
id 0
label "1"
a 10
b "alpha"
]
node [
id 1
label "2"
a 20
b "beta"
]
node [
id 2
label "3"
a 30
b "gamma"
]
node [
id 3
label "4"
a 40
b "delta"
]
edge [
source 0
target 1
weight 1.5
type "mixed"
]
edge [
source 0
target 3
weight 0.9
type "hybrid"
]
edge [
source 1
target 2
weight 2.7
]
edge [
source 2
target 3
type "complex"
]
]
49 changes: 49 additions & 0 deletions data/example/example3_gml/raw/graph2.gml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
graph [
node [
id 0
label "1"
a 15
b "alpha"
]
node [
id 1
label "2"
a 25
b "beta"
]
node [
id 2
label "3"
a 35
b "gamma"
]
node [
id 3
label "4"
a 45
b "delta"
]
edge [
source 0
target 1
weight 1.2
type "mixed"
]
edge [
source 0
target 3
weight 4.5
type "hybrid"
]
edge [
source 1
target 2
weight 2.3
type "complex"
]
edge [
source 2
target 3
weight 3.4
]
]
57 changes: 57 additions & 0 deletions data/example/example3_gml/raw/graph3.gml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
graph [
node [
id 0
label "1"
a 20
b "alpha"
]
node [
id 1
label "2"
a 30
b "beta"
]
node [
id 2
label "3"
a 40
b "gamma"
]
node [
id 3
label "4"
a 50
b "delta"
]
node [
id 4
label "5"
a 60
]
edge [
source 0
target 1
weight 1.8
type "mixed"
]
edge [
source 0
target 4
weight 3.2
]
edge [
source 1
target 2
]
edge [
source 2
target 3
weight 2.5
type "complex"
]
edge [
source 3
target 4
type "hybrid"
]
]
1 change: 1 addition & 0 deletions data/example/example3_gml/raw/labels/binary
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"0": 0, "1": 1, "2": 0}
2 changes: 2 additions & 0 deletions data/multiple-graphs/custom/small/raw/.info → data/example/example8/metainfo
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
{
"class_name": "KnownFormatDataset",
"import_from": "datasets.known_format_datasets",
"count": 8,
"nodes": [5, 4, 4, 8, 6, 7, 7, 9],
"directed": true,
Expand Down
0 ...-graphs/custom/small/raw/small.edge_index → data/example/example8/raw/edge_index
View file
Open in desktop
File renamed without changes.
0 ...multiple-graphs/custom/small/raw/small.ij → data/example/example8/raw/edges.ij
View file
Open in desktop
File renamed without changes.
0 ...aphs/custom/small/raw/small.labels/binary → data/example/example8/raw/labels/binary
View file
Open in desktop
File renamed without changes.
0 .../custom/small/raw/small.node_attributes/a → data/example/example8/raw/node_attributes/a
View file
Open in desktop
File renamed without changes.
0 .../custom/small/raw/small.node_attributes/b → data/example/example8/raw/node_attributes/b
View file
Open in desktop
File renamed without changes.
Loading