Feature/support cosmos#145

Draft

hmoazam wants to merge 59 commits intomainfrom

feature/supportCosmos

Commits on Dec 12, 2022

Commits on Dec 18, 2022

Commits on Jan 6, 2023

Resolving race condition based on app settings being deployed while ms deploy is going

wjohnson
and
hmoazam
committed

Commits on Feb 12, 2023

Bump cryptography from 38.0.4 to 39.0.1 in /tests/environment

dependabot[bot]
authored and
wjohnson
committed

Commits on Apr 28, 2023

Added unit test and integration test for Azure MySQL, and updated LIMITATIONS.md to indicate MySQL support (#149)
hmoazam
committed
Documentation references OL 0.18 and DBR 11.3

wjohnson
authored and
hmoazam
committed
No longer supporting Spark 2

wjohnson
authored and
hmoazam
committed
Updates - Postgres (#148)
hmoazam
committed
Feature/support kusto (#147)
hmoazam
committed
Refactoring SelectReturnEntity to be more clear

wjohnson
authored and
hmoazam
committed
Refactoring SelectReturnEntity to reflect we only accept entities with matching fully qualified names

wjohnson
authored and
hmoazam
committed
Fix spark3-test-def merge conflict

wjohnson
authored and
hmoazam
committed
Prioritize blob paths over placeholder entity

wjohnson
authored and
hmoazam
committed
Refactoring validentity to validEntitiesAfterFiltering to make it more clear that filtering has occured

wjohnson
authored and
hmoazam
committed
Removing unncessary column mapping comments and Validate_Resource_Set method which is never referenced

wjohnson
authored and
hmoazam
committed
Refactoring PurviewIngestion to remove unused methods and refactor our the Log method in favor of using the ILogger directly

wjohnson
authored and
hmoazam
committed
Refactor Validate_X_Json method names to reflect what it is testing or verifying

wjohnson
authored and
hmoazam
committed
Refactoring SendToPurview in PurviewIngestion for each loop's variable from a simple entity to purviewEntityToBeUpdated to make it more clear what's going to happen to this entity and not confuse i…

wjohnson
authored and
hmoazam
committed
Refactoring PurviewIngestion naming conventions to clarify entities that may be deleted and adding comments to walk through relationship attribute extraction and replacement

wjohnson
authored and
hmoazam
committed
Adding a field for originalQualifiedName and removing unused methods simpleEntity, AddToTable, FindQualifiedNameInPurview, CleanUnusedCustomEntities, and Name_To_Search

wjohnson
authored and
hmoazam
committed
Refactoring the cache naming conventions inside of PurviewIngestion

wjohnson
authored and
hmoazam
committed
ColParser should optionally take in a mapping of original dataset names to fully qualified names discovered during search and PurviewIngestion needs to keep track of these mappings

wjohnson
authored and
hmoazam
committed
Refactoring to support extracting the ColumnParser to be passed around in PurviewOut

wjohnson
authored and
hmoazam
committed
Implement ColumnParser injection and update column mappings of process entities

wjohnson
authored and
hmoazam
committed
Updating Limitations and Readme to better reflect current state and support of column lineage

wjohnson
authored and
hmoazam
committed
Handle Azure Data Factory Job Names (#137)

wjohnson
authored and
hmoazam
committed
Reflect support for Azure Data Factory (#170)

wjohnson
authored and
hmoazam
committed
Update ADF and Kusto limitations (#169)

wjohnson
authored and
hmoazam
committed
Update Delta Merge support (#167)

wjohnson
authored and
hmoazam
committed
Adding Hive Table as part of supported features (#171)

wjohnson
authored and
hmoazam
committed
OL 13 -> 18 (#173)
hmoazam
committed
Added snowflake mapping to gallery (#172)
hmoazam
committed
Updated with new aka.ms url ready for release (#168)
hmoazam
committed
fixed MySQL and Postgres test expectations (#174)
hmoazam
committed
Fix Library Definitions in Job Tasks to prevent deserialization error from JSON to class models

wjohnson
authored and
hmoazam
committed
OlToPurviewMapping Quality of Dev Improvements

wjohnson
authored and
hmoazam
committed
Enabling Workflow Dispatch to run the build

wjohnson
authored and
hmoazam
committed
Correct one line mappings as artifact

wjohnson
authored and
hmoazam
committed
Fix Mappings for Mount Points with Subdirectories

wjohnson
authored and
hmoazam
committed
Adding unit tests to confirm mount behavior

wjohnson
authored and
hmoazam
committed
Testin

wjohnson
authored and
hmoazam
committed
Rollback Delta Merge statements due to false positive in test suite

wjohnson
authored and
hmoazam
committed
Remove unncessary comment

wjohnson
authored and
hmoazam
committed
Update readme to rollback delta merge support

wjohnson
authored and
hmoazam
committed
Mappings must be a separate artifact

wjohnson
authored and
hmoazam
committed
Implementing Cosmos support
hmoazam
committed
Cosmos integration test added, and test-env README updated. TODO: Update LIMITATIONS, add integration test notebooks, and add integration test for additional inputs + cosmos
hmoazam
committed
WIP - found flaws in DataSourceV2 events logic
hmoazam
committed
Cosmos support WIP
hmoazam
committed
Cosmos WIP
hmoazam
committed
Cosmos WIP
hmoazam
committed
Update LIMITATIONS
hmoazam
committed
Updated UnitTestData, test CompleteNoOutputsInputsFullMessage expected result to True, as now considering COMPLETE events with only outputs
hmoazam
committed
save progress - VS code broken
hmoazam
committed
Cosmos WIP
hmoazam
committed
Unsuccessful debugging
hmoazam
committed
Fix null error when accessing inputs from table storage, and clean up code
hmoazam
committed