[Epic] Auto-Detect Schema Changes

[alovew]

• PRD
• Figma Prototype

Tasks

Preview Give feedback

1. Add new columns to connection table #17521
   team/platform-move +1
   
2. Update FieldTransform object and populate breakingChange when calculating a catalogDiff #17522
   team/platform-move +1
   
3. Connection Get Endpoint: add and populate schemaChange in response #17525
   team/platform-move +1
   
4. Connection List Endpoint: add and populate schemaChange in response #17526
   team/platform-move +1
   
5. Implement shouldRefreshSchema method #17632
   team/platform-move +1
   
6. Implement refreshSourceSchema method #17527
   team/platform-move +1
   
7. Connection Update endpoint: populate notification & non-breaking schema change options #17528
   team/platform-move +1
   
8. Update DiscoverSchema endpoint: determine breaking change #17523
   team/platform-move +1
   
9. Auto detect schema changes env variable #19242
   team/platform-move +1
   
10. New Notifications Temporal Workflow #17529
    team/platform-move +1
    
11. New WorkspaceAPI endpoint to fetch a workspace given a connectionId #18979
    team/platform-move +1
    
12. Show auto-detect schema changes status in connection list view #17829
    area/frontend team/platform-move ui/connection +3
    
13. Add auto-detect schema changes flow to connection replication settings page #17828
    area/frontend team/platform-move ui/connection +3
    
14. Add auto-detect schema changes option to create connection and replication settings pages #17826
    area/frontend team/platform-move ui/connection +3
    
15. Prevent the user from editing stream if there is a breaking schema change #20201
    area/frontend platform-move/requires-grooming team/platform-move ui/connection +4
    
16. Add metrics around schema changes #17619
    team/platform-move +1
    
17. Trigger notifications within the DiscoverSchema endpoint #17530
    team/platform-move +1
    
18. Discover schema endpoint: disable connections as needed after refreshing schema #17633
    team/platform-move +1
19. Add E2E tests for auto-detect schema changes frontend #17936
    area/frontend team/platform-move ui/connection +3
    
20. Update settings to toggle auto-detect schema changes notifications #17830
    area/frontend team/platform-move ui/connection +3
    
21. Add feature flag for auto-detect schema changes #19920
    area/frontend team/platform-move +2
    
22. Re-enable auto-detect schema notification setting in webapp #22562
    area/frontend team/platform-move ui/connection +3
    
23. Add email notification toggle for auto-detect schema changes #24462
    area/frontend platform-move/requires-grooming team/platform-move ui/connection +4
    

[octavia-squidington-iv]

cc @airbytehq/frontend

[davinchia]

@benmoriceau what is the status of this?

[cgardens]

closes #1037

[davinchia]

@benmoriceau what is the status of this? Can we close this epic?

[benmoriceau]

@davinchia I think so, the 3 open tickets are actually done. We may still need to build a board with the metrics that have been added.

[davinchia]

Great! Can we close those issues then and close this Epic? Is building the board Compose or Move?

[benmoriceau]

I think that it might go to compose because they are the ones responsible for the auto propagation which is related to the auto detection.