Tags: Nike-Inc/spark-expectations
Tags
Updating the flow diagram and enabling summarized row dq to capture a… …ll results (fail/pass) as part of PR - 80 (#90) * Addign changes to the flow diagram * enabling the summarized row dq to fetch all the results --------- Co-authored-by: Vigneshwarr Venkatesan <[email protected]>
update row dq summary (#73) * Update writer.py * Update CONTRIBUTORS.md * Update context.py * Update expectations.py * spelling corrections, writing more unit tests, removing rdd's * reformatting * fixing tests * Update test_writer.py * Update test_regulate_flow.py * Update test_context.py * Update test_regulate_flow.py --------- Co-authored-by: Ashok Singamaneni <[email protected]>
Feature remove mandatory args (#40) * making changes and refactoring the code. * Adding Wrapped DataFrameWriter and unitests for the same * ignoring agg_dq and query_dq * Rearranging lot of code, removed delta. Enabled custom writers in different formats * fixing tests for the sinks and updating README * fixing kafka configurations * Feature add reader * changing rules table along with few other changes * reader and writer modifications --------- Co-authored-by: phanikumarvemuri <[email protected]> * Updating formatting, removing delta as dependency * Adding examples for expectations * adding documentation Co-authored-by: phanikumarvemuri <[email protected]> * Updating tests * Updating documentation * Updating WrappedDataframeWriter --------- Co-authored-by: phanikumarvemuri <[email protected]>
PreviousNext