Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SmartSim Experiment docs #422

Merged
merged 44 commits into from
Jan 5, 2024

Conversation

amandarichardsonn
Copy link
Contributor

@amandarichardsonn amandarichardsonn commented Nov 15, 2023

This PR merges the Experiment.rst file into a branch that will encapsulate the entirety of the SmartSim documentation refactor. The Experiment.rst file offers documentation for an Experiment, a Launcher, the Experiment entities and an example demonstrating initializing, starting and stopping from within an experiment. The documentation is aimed to be accessible.

Copy link

codecov bot commented Nov 15, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (142ddc1) 90.34% compared to head (3d6aeb2) 90.47%.

Additional details and impacted files

Impacted file tree graph

@@                    Coverage Diff                    @@
##           smartsim-docs-refresh     #422      +/-   ##
=========================================================
+ Coverage                  90.34%   90.47%   +0.13%     
=========================================================
  Files                         60       60              
  Lines                       3748     3738      -10     
=========================================================
- Hits                        3386     3382       -4     
+ Misses                       362      356       -6     

see 2 files with indirect coverage changes

Copy link
Contributor

@billschereriii billschereriii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is looking really good. A few places that need changes and a big TBD that has to be addressed before merging

Copy link
Member

@ashao ashao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great start to the documentation and an impressive amount of work. Most of my suggestions are fixing some inaccuracies of the descriptions which should hopefully be easy to fix. LEt me know if there's anything you want to clarify.

steering, and more. The ``Orchestrator`` can be thought of as a general
feature store capable of storing numerical data, ML models, and scripts.
The orchestrator is capable of performing inference and script evaluation on feature
store data. Any SmartSim ``Model`` or ``Ensemble`` model can connect to the
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

'Any SmarSim model or Ensemble of models' ? Technically an ensemble is a group of models.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I refer to a single ensemble model here since we can instruct a single ensemble model to connect to an orch, and then another does not need to!

Copy link
Contributor

@mellis13 mellis13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for doing this refactor to the docs! Just some comments to hopefully make things clearer.

Copy link
Contributor

@mellis13 mellis13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I really like this refactor. Thanks for the hard work. Just a couple of small comments and rework before merging.


.. code-block:: bash
If the systems launcher cannot be found or no `launcher` argument is provided, the default value of
`launcher="local"` will be used.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@al-rigazzi Do we have.a method for viewing the launcher that is chosen by the auto feature? I only see the private member attribute Experiment._launcher.

Copy link
Contributor

@mellis13 mellis13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very small comments and changes -- otherwise looks really good!

Copy link
Contributor

@mellis13 mellis13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very tiny changes but then LGTM!

Copy link
Contributor

@mellis13 mellis13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@amandarichardsonn amandarichardsonn merged commit bc0e667 into smartsim-docs-refresh Jan 5, 2024
@amandarichardsonn amandarichardsonn deleted the smartsim-api-craylabs branch January 5, 2024 23:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants