Various improvements for TextAnalyze #2
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…crosoft#1239) Co-authored-by: Mark Hamilton <mhamilton723@gmail.com>
…ft#1226) * [DataBalanceAnalysis] Add doc and sample notebook * Clear outputs in sample notebook * Address jasowang PR comments * [DataBalanceAnalysis] Update notebook and doc * [Databricks E2E Tests] Upgrade DBR from 8.3 to 9.1 LTS * [Databricks E2E Tests] Revert DBR from 9.1 LTS to 8.3 Co-authored-by: Patel, Kashyap M <kpatel370@gatech.edu>
…1240) * [DataBalanceAnalysis] Add doc and sample notebook * Clear outputs in sample notebook * Address jasowang PR comments * [DataBalanceAnalysis] Update notebook and doc * [Databricks E2E Tests] Upgrade DBR from 8.3 to 9.1 LTS * [Databricks E2E Tests] Revert DBR from 9.1 LTS to 8.3 * Fix broken link Co-authored-by: Patel, Kashyap M <kpatel370@gatech.edu>
* fix: fix publish Pypi & build publish path errors * fix inconsistency in variable name of secrets * fix synapseml blob maven path * fix var name * fix testR install spark path
… DataBalanceAnalysis) (microsoft#1241) * [DataBalanceAnalysis] Add doc and sample notebook * Clear outputs in sample notebook * Address jasowang PR comments * [DataBalanceAnalysis] Update notebook and doc * [Databricks E2E Tests] Upgrade DBR from 8.3 to 9.1 LTS * [Databricks E2E Tests] Revert DBR from 9.1 LTS to 8.3 * Fix broken link * [website] Model Interpretability -> Responsible AI * Get latest from upstream/master * Host DataBalanceAnalysis-AdultCensusIncome cell outputs in blob instead of inline, use Interpretability-Image Explainers as outstanding notebook in features/responsible_ai/ * Replace ModelInterpretability-SnowLeopardDetection with Interpretability-Image Explainers as outstanding Responsible AI notebook Co-authored-by: Patel, Kashyap M <kpatel370@gatech.edu>
* test: add config to specify Text Api location * Combine TextKey and TextApiLocation into TextEndpoint
* refactor: refactor notebooks folder structure and modify notebookcovert to auto-detect file paths * rename MMLSpark to SynapseML in some contents & update website main page to include announcement and installation in Synapse * move notebooks to correct path * merge master * fix broken links and update to version-0.9.1 because the changes have nothing to do with library updates and only add new markdowns * remove " from announcement * update pipeline * fix string format in notebookconvert * fix missing argument of encoding in pipeline"s version of python * fix pipeline -- create conda environment * fix nbtest.DatabricksTests & add jupyter into environment.yaml * add source activate synapseml * remove generated markdowns * add markdowns into .gitignore * simplify fetching notebooks * remove condition for now to test if auto deployment works * test passed then add back condition & fix sidebar order Co-authored-by: Mark Hamilton <mhamilton723@gmail.com>
microsoft#1253) * delete python imports and helpers in markdowns & modify doctest to auto add those * fix ) in markdown & format * fix mergePyCodeDir error * fix announcement color * test letting job fail on errors * fix pipeline * fix pipeline * fix SynapseE2e job * fixing pipeline * fix python version * fix sphinx version caused bug in publish artifacts
* fix: fix installation instruction * fix translator test
* feat: add predict_disable_shape_check in LightGBM * test: predict_disable_shape_check * fix: change to BooleanParam
…s, set useSingleDatasetMode=True by default (microsoft#1222)
…rosoft#1270) Bumps [algoliasearch-helper](https://github.com/algolia/algoliasearch-helper-js) from 3.6.1 to 3.6.2. - [Release notes](https://github.com/algolia/algoliasearch-helper-js/releases) - [Changelog](https://github.com/algolia/algoliasearch-helper-js/blob/develop/CHANGELOG) - [Commits](algolia/algoliasearch-helper-js@3.6.1...3.6.2) --- updated-dependencies: - dependency-name: algoliasearch-helper dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Mark Hamilton <mhamilton723@gmail.com>
…/analyze` endpoint (microsoft#1267) * Initial implementation work * Avoid using fixed task result to determine document count * Add options for TextAnalyze tasks to run * Add example notebook for TextAnalyze * fix style * Fix typo in build helpers * chore: some TA spring cleaning * minor rename of notebook
…eads to be cores-1 (microsoft#1282)
* feat: add multivariate anomaly detection * update correct format of classes * update diagnosticsInfo as ServiceParam * fix modelReader * fix fuzzingtest * update retry time * move MAD test to a separate folder since the training process takes a long time * ignore serialization fuzzing test for MAD since it takes too long; fix deleting modelId error * move MAD suite back to split1 * update waiting time * ignore experiment fuzzing test as well * address comments * test sparklyr version Co-authored-by: Mark Hamilton <mhamilton723@gmail.com>
* feat: Add non-array value propagation to FlattenBatch * Avoid relying on schema for array test
* feat) Add support for Azure Maps Geocode and Batch Geocode - Created a geospatial package to support all geospatial functions - Added support for GetSearchAddress - TODO: Fix the flattening of batch results * fix) fixup the basic use testcase for batch geocoding - fixed how the columns are fetched and flattened - added asserts to ensure the results `df` contains all rows * fix) fix style errors reported in pipeline * fix) fix pending style errors * chore: Implement Review Comments - [Review Comment] Removed `AzureMapsBase` class to simplify dependency - [Review Comment] Renamed `BatchAsyncReply` to `MapsAsyncReply` - [Review Comment] Removed `=None` assignments in schema classes - [Enhancements] Update Output Column to only return batch results making is easier to flatten responses. * chore: cleanup - Updated test case to include realistic address data - fixed a potential issue with `MapAsyncReply` appending subscription key twice * chore) Explicitly Set `User-Agent` header to `synapseml ...` - Explicitly set the user agent header to track SynapseML usage * chore: cleanup unused code - cleaned up `HasAddressInput` Co-authored-by: Mark Hamilton <mhamilton723@gmail.com>
Co-authored-by: Hanlin Tang <hanlin.tang@akunacapital.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
/analyzeendpoint (feat: Add TextAnalyze transformer to add support for Text Analytics/analyzeendpoint microsoft/SynapseML#1267)