Skip to content

[WIP] Graph improvements#348

Draft
raver119 wants to merge 261 commits intomasterfrom
r119_abstractions
Draft

[WIP] Graph improvements#348
raver119 wants to merge 261 commits intomasterfrom
r119_abstractions

Conversation

@raver119
Copy link
Copy Markdown

@raver119 raver119 commented Mar 26, 2020 •
edited
Loading

WIP - DO NOT MERGE!

This PR adds bunch of improvements for Graph execution and memory management, including:

  • mmap support for Graph deserialization
  • Better topological sort
  • Better dependency analysis for smaller memory footprint & inplace execution
  • Model parallelism support

raver119 added 30 commits March 26, 2020 18:54
@raver119
ManagedDataBuffer
667559c 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
ManagedDataBuffer
d2d603e 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
one more planned Graph method
a52e862 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
virtual DataBuffer methods
0e09e35 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
few build fixes
b2c2fa5 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
few other abstractions
9334cbb 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
first basic test
540bbaf 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
two more abstractions
2a9b3c7 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
few missing methods
8131f18 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
meh
9d52e98 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
meh
d6f4c9b 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
ManagedDataBuffer stuff
5c8c1ae 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
additional assert
b84a51f 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
.gitignore
6312a91 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
meh
a28154c 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
virtual destructor
7fe07d1 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
first analyzer test
b0ad718 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
second analyzer test
16e544e 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
minor fix
eade08e 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
additional convenience operator for OpSequence
c743a35 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
ExecutionLayer abstraction instead of std::vector for OptimizedGraph
d920ca9 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
NodeOptimizer abstraction
0d42c67 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
GraphOptimizer abstraction
34deb66 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
few files moved around
e7ed426 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
few more files moved around
49469d5 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
one more method
c4f0387 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
GraphExecutor
8d7e470 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
one include fixed
d3a46e7 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
few minor api changes
9939fa9 
Signed-off-by: raver119 <raver119@gmail.com>
@raver119
placeholder test
e7c22f6 
Signed-off-by: raver119 <raver119@gmail.com>
raver119 and others added 30 commits June 19, 2020 12:37
@raver119
Numeric Node frameId
b13edae 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@shyrma
- determine correspondence between enter and exit nodes
d45132d 
Signed-off-by: Yurii <iuriish@yahoo.com>
@shyrma
- correct procedure of opSeq creation for ops within given loop
7a8b379 
Signed-off-by: Yurii <iuriish@yahoo.com>
@raver119
next step
5bfed37 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
Merge remote-tracking branch 'origin/r119_abstractions' into r119_abs…
5883c08 
…tractions
@raver119
next step
d8892cd 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
next step
8be942c 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
Exit draft
3e00fe0 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
first test passed
e706c9e 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
Merge branch 'master' into r119_abstractions
02f1537
@raver119
assertions for a new test
4f8fde2 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
full stack cleanup
0b00097 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
next step
b5b9319 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
bunch of small tweaks
5d74719 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@shyrma
- apply another toposort for switch node
ba73c10 
Signed-off-by: Yurii <iuriish@yahoo.com>
@raver119
- purge methods for ExecutionLayer and OptimizedGraph
e27d87d 
- remove legacy Logic ops

Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
OpSequence::append test
e71e9d1 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
few tweaks to make CLang happy
44d1efa 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@shyrma
- provide different sorting algorithm for graph with loops
c555c44 
Signed-off-by: Yurii <iuriish@yahoo.com>
@raver119
disable disabled Merge
035416c 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@shyrma
- split graph sorting into two separate algorithms: first one for usu…
39963b3 
…al graphs without enter nodes, second for graphs containing enter nodes

Signed-off-by: Yurii <iuriish@yahoo.com>
@raver119
Merge branch 'master' into r119_abstractions
cc5ef9a
@raver119
2 more tests for Switch and While
8b6aa54 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@shyrma
- provide connections between Exit and NextIeration nodes within same…
0ff755f 
… frame in order to make toposort alg work correctly

Signed-off-by: Yurii <iuriish@yahoo.com>
@raver119
stubs for cuda
f9ce92c 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
BERT test updates
50aa79f 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
mmap for CUDA
fc3220d 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
non_max_suppression_overlaps CUDA fix
d4c0abd 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
sqrtm :/
bd9f9c2 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
@raver119
few updates for Java side
b4fa5bf 
Signed-off-by: raver119@gmail.com <raver119@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@raver119 @olegsemeniv @shyrma @shugeo