Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix revoke Dag stale permission on airflow < 2.10 #42844

Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
354 commits
Select commit Hold shift + click to select a range
83d96df
Refactor system test for Campaign Manager 360 (#42346)
moiseenkov Sep 19, 2024
5e31c38
Add better typing in the db clean utils (#42341)
jedcunningham Sep 19, 2024
8495082
Fix cloud_build system tests (#42306)
VladaZakharova Sep 19, 2024
9fbc603
Mark VertexAI AutoMLText deprecation (#42251)
olegkachur-e Sep 19, 2024
d3ad8d6
Minor fixes to ensure successful Vertex AI LLMops pipeline (#41997)
CYarros10 Sep 19, 2024
ef9740c
Adjust typing in Mongo hook to prevent mypy errors (#42354)
jscheffl Sep 19, 2024
430bc4b
AWS System Test: EMR Container (#42353)
o-nikolas Sep 19, 2024
8edbf5c
Refactor bulk_save_to_db (#42245)
uranusjr Sep 20, 2024
cfd89f9
fix(dag): avoid getting dataset next run info for unresolved dataset …
Lee-W Sep 20, 2024
75213aa
Switch UI codegen to fastAPI spec (#42222)
bbovenzi Sep 20, 2024
92a31f2
Add ability to create Flink Jobs in dataproc cluster (#42342)
VladaZakharova Sep 20, 2024
78b45ef
Add documentation for FAB DB commands (#42352)
ephraimbuddy Sep 20, 2024
ec6cdcf
Remove empty dirs (#42375)
vincbeck Sep 20, 2024
2223fe5
Minor fixups to FAB DB command docs (#42377)
jedcunningham Sep 20, 2024
557a549
Make migrations path relative to ini (#42381)
dstandish Sep 20, 2024
89a96e9
Fix pre-commit inserting airflow_version var (#42378)
dstandish Sep 20, 2024
d6425d1
Remove redundant dag_id index on log table (#42376)
dstandish Sep 20, 2024
8b7a32f
Reduce max length of pre-commit hooks (#42384)
dstandish Sep 20, 2024
dd8258f
Handle `AUTH_ROLE_PUBLIC` in FAB auth manager (#42280)
vincbeck Sep 20, 2024
c507c7a
Fix pre-commit for auto update of fab migration versions (#42382)
ephraimbuddy Sep 20, 2024
1df2566
Prepare docs for Sep 1st wave of providers (#42387)
eladkal Sep 21, 2024
ad2f2d9
(feat): Add opensearch logging integration (#41799)
Owen-CH-Leung Sep 21, 2024
74cae3f
Use set instead of list for dags' tags (#41695)
Avihais12344 Sep 21, 2024
240749a
Improve CI workflows docs (#42389)
shahar1 Sep 21, 2024
d768610
remove time folder from standard provider (#42392)
gopidesupavan Sep 21, 2024
42fc1ff
Enabling TLS arguments for FastAPI (#42395)
JoshuaXOng Sep 22, 2024
fface72
Changed type hinting for handler function (#42275)
Ariel2400 Sep 22, 2024
07918db
Add git clone instruction to the begining of breeze setup (#42403)
SamLiaoP Sep 23, 2024
5dfd9b7
Refactor ORM DAG insertion logic (#42358)
uranusjr Sep 23, 2024
037675a
FastAPI API Add test query params standardization an reusability (#42…
pierrejeambrun Sep 23, 2024
4557392
Chart: Default airflow version to 2.10.2 (#42406)
ephraimbuddy Sep 23, 2024
0f0114b
Add and improve coverage for new UI (#42397)
DjVinnii Sep 23, 2024
bd201f3
Fix typo in error stack trace formatting for clearer output (#42017)
aboitreaud Sep 23, 2024
097f3b0
Add option in simple auth manager to disable authentication and allow…
vincbeck Sep 23, 2024
9b44687
Resolve failing test when request and ddb table schema mismatch (#42419)
ellisms Sep 23, 2024
54f98b3
Simple auth manager documentation - Airflow only (#42418)
vincbeck Sep 23, 2024
191894d
Make AlreadyExists a subclass of more general Conflict exception (#42…
dstandish Sep 23, 2024
8d37163
Fix broken main: generated JS types (#42422)
jscheffl Sep 23, 2024
493be8e
Deprecate DAG.run method (#42417)
dstandish Sep 24, 2024
9eef820
Fix failing canary build (#42431)
Owen-CH-Leung Sep 24, 2024
ef81463
Add more filters and search to get_dags endpoint (#42321)
pierrejeambrun Sep 24, 2024
bd3f81e
Bugfix/dataflow job location passing (#41887)
lukas-mi Sep 24, 2024
132ebdc
add "enable_tracemalloc" to log memory usage in scheduler (#42304)
Lee-W Sep 24, 2024
5bad199
apply otel_service on metrics (#42242)
romsharon98 Sep 24, 2024
a045756
Update providers metadata 2024-09-24 (#42445)
eladkal Sep 24, 2024
85155d2
fix(providers/amazon): handle ClientError raised after key is missing…
Lee-W Sep 24, 2024
e0b71df
Simple auth manager documentation (#42390)
vincbeck Sep 24, 2024
fd39d31
Fix UI pre commit hook (#42435)
pierrejeambrun Sep 24, 2024
5252bfb
Fix logout in AWS auth manager (#42447)
vincbeck Sep 24, 2024
bff3b78
Split next_dagruns_to_examine function into two (#42386)
dstandish Sep 24, 2024
9206b03
Support session reuse in `RedshiftDataOperator` (#42218)
borismo Sep 24, 2024
e287b62
Fix broken main: generated JS types (#42451)
jscheffl Sep 24, 2024
ddda5f6
AIP-69: Add CLI to Edge Provider (#42050)
jscheffl Sep 24, 2024
e9d5ede
Add STOPPED to the failure cases for Sagemaker Training Jobs (#42423)
ferruzzi Sep 24, 2024
c72b57a
Refactor _register_dataset_changes (#42343)
uranusjr Sep 25, 2024
8cb6b4d
add env support for migratedatabase job (#42345)
pgvishnuram Sep 25, 2024
b42d7e6
fix: Fixing Helm chart flower ingress service reference (#41179)
andormarkus Sep 25, 2024
875898b
Flush less in dataset manager (#42458)
uranusjr Sep 25, 2024
ab7f2d1
Refactor AWS Auth manager user output (#42454)
o-nikolas Sep 25, 2024
d45affe
(bugfix): Paginated results in MSGraphAsyncOperator (#42414)
dabla Sep 25, 2024
12b4af1
uv version bump to 0.4.7 (#42274)
dirrao Sep 25, 2024
a4bb0d3
Purge existing SLA implementation (#42285)
ferruzzi Sep 25, 2024
fca3d2c
#42442 Make the AWS logging faster by reducing the amount of sleep (#…
smsm1-ito Sep 25, 2024
883d984
bugfix: create_vector_index task gets marked successful even when it …
ferruzzi Sep 25, 2024
570480c
docs: fix Executor alias syntax (#42471)
pustoshilov-d Sep 25, 2024
546505c
Bugfix task execution from runner in Windows (#42426)
jscheffl Sep 25, 2024
cdb7a71
Fix the span link of task instance to point to the correct span in th…
howardyoo Sep 25, 2024
38e1643
Remove deprecated CloudSQL HA functionality from the system test (#42…
moiseenkov Sep 25, 2024
9df76d6
Small fix to AWS AVP cli init script (#42479)
o-nikolas Sep 25, 2024
64e7d28
Do not attempt to provide not stringified objects to UI via xcom if p…
jscheffl Sep 25, 2024
b2677ee
Remove identity center auth manager cli (#42481)
o-nikolas Sep 25, 2024
8566823
Remove jhtimmins as code owner for security (#42477)
dstandish Sep 26, 2024
0c2601f
Simplify expression for get_permitted_dag_ids query (#42484)
dstandish Sep 26, 2024
8719d50
Split up the return statement in _is_authorized_callback for clarity …
dstandish Sep 26, 2024
0b81423
Fix typo in fixture set_auth_role_public (#42488)
dstandish Sep 26, 2024
82ff46e
Migrate patch dag to FastAPI API (#42469)
pierrejeambrun Sep 26, 2024
4627d2e
fix: ensure DAG trigger form submits with updated parameters upon key…
dannyl1u Sep 26, 2024
639c26b
fix(providers/common/sql): add dummy connection setter for backward c…
Lee-W Sep 26, 2024
a6668e5
Fix broken main re generated api typescript comment (#42500)
dstandish Sep 26, 2024
4cc91c6
`S3DeleteObjects` Operator: Handle dates passed as strings (#42464)
ellisms Sep 26, 2024
c2b68b9
Move ECS executor to stable (#42483)
o-nikolas Sep 26, 2024
c14f8db
Add in backport of astunparse where needed in static checks (#42503)
ashb Sep 26, 2024
6570a1e
Remove deprecated stuff from Amazon provider package (#42450)
vincbeck Sep 26, 2024
c7709f9
Clarify logic in callback func in is authorized callback (#42475)
dstandish Sep 26, 2024
2354075
Add basic endpoints for managing backfill entities (#42455)
dstandish Sep 26, 2024
abd6168
fix: OL dag start event not being emitted (#42448)
kacpermuda Sep 26, 2024
dd95db6
Fix DB utils for Airflow Backwards compatability tests - import not e…
jscheffl Sep 26, 2024
758b91c
Prepare docs for Sep 2nd adhoc wave of providers (#42519)
eladkal Sep 27, 2024
c497a5a
Add more sort and filters to get dags endpoint (#42462)
pierrejeambrun Sep 27, 2024
156a3ba
Refactor ``bucket.get_blob`` calls in ``GCSHook`` to handle validatio…
jsjasonseba Sep 27, 2024
0a8417c
Update docs regarding the AutoMLText deprecation (#42415)
olegkachur-e Sep 27, 2024
189a960
KubernetesPodOperator never stops if credentials are refreshed (#42361)
paolo-moriello Sep 27, 2024
0920da0
Handle ENTER key correctly in trigger form and allow manual JSON (#42…
jscheffl Sep 27, 2024
273ab43
Deprecate AutoMLBatchPredictOperator and refactor AutoMl system tests…
olegkachur-e Sep 27, 2024
4851331
Fix gcp text to speech uri fetch (#42309)
olegkachur-e Sep 27, 2024
c153e99
Update code owners (#42536)
pierrejeambrun Sep 27, 2024
d303e69
Fix AWS system test `example_batch` (#42518)
vincbeck Sep 27, 2024
9a9a0f2
Undo partition exclusion from the table name when splitting a full Bi…
moiseenkov Sep 27, 2024
2b8833d
Add slack notification for canary build failures (#42394)
romsharon98 Sep 27, 2024
b2f64e7
AIP-84 Add HTTPException openapi documentation (#42508)
pierrejeambrun Sep 27, 2024
1a6a462
Fix SparkKubernetesOperator spark name. (#42427)
gopidesupavan Sep 27, 2024
46ba84f
Fix incorrect operator name in FileTransferOperator example (#42543)
dan-js Sep 27, 2024
1f8b99b
Pre commit script to validate template fields (#42284)
gopidesupavan Sep 27, 2024
63dcb24
Remove DagRun.is_backfill attribute (#42548)
dstandish Sep 27, 2024
cfc374b
Attempt to correct dependency for Slack notification for canary build…
jscheffl Sep 28, 2024
d12b835
Airflow 2.10.2 has been released (#42405)
ephraimbuddy Sep 28, 2024
a4f8faa
remove callable functions parameter from kafka operator template_fiel…
gopidesupavan Sep 29, 2024
18bc08f
fix PyDocStyle checks (#42557)
dannyl1u Sep 29, 2024
47e0417
Documentation change to highlight difference in usage between params …
kunaljubce Sep 29, 2024
4f177f3
Bugfix/42575 workaround pin azure kusto data (#42576)
jscheffl Sep 29, 2024
f05c842
Bump uv to 0.4.17 (#42574)
topherinternational Sep 30, 2024
ea99f74
Change default .airflowignore syntax to glob (#42436)
uranusjr Sep 30, 2024
673da92
Rename dataset related python variable names to asset (#41348)
Lee-W Sep 30, 2024
8350351
Add 'name' and 'group' to DatasetModel (#42407)
uranusjr Sep 30, 2024
32b37c9
Ensure consistent Seriailized DAG hashing (#42517)
ephraimbuddy Sep 30, 2024
018478c
reduce eyestrain in dark mode with reduced contrast and saturation (#…
codecae Sep 30, 2024
7662959
AIP-84 Migrate patch dags to FastAPI API (#42545)
pierrejeambrun Sep 30, 2024
d2b116c
KubernetesHook kube_config extra can take dict (#41413)
dstandish Sep 30, 2024
779a227
Speed up boring cyborg consistency pre-commit check (#42589)
dstandish Sep 30, 2024
7ead4e8
Doc update - Airflow local settings no longer importable from dags fo…
jishangarg Oct 1, 2024
329cbf8
add flexibility for redis service (#41811)
kongdewen Oct 1, 2024
ea1432f
Support of host.name in OTEL metrics and usage of OTEL_RESOURCE_ATTRI…
howardyoo Oct 1, 2024
c83d509
Update fastapi operation ids (#42588)
pierrejeambrun Oct 1, 2024
1045c80
Limit build-images workflow to main and v2-10 branches (#42601)
potiuk Oct 1, 2024
807f267
openlineage: add unit test for listener hooks on dag run state change…
JDarDagran Oct 1, 2024
0c49fbe
Update Rest API tests to no longer rely on FAB auth manager. Move tes…
vincbeck Oct 1, 2024
f3e1b32
Add Docs button to Nav (#42586)
bbovenzi Oct 1, 2024
09c2d4a
Update providers metadata 2024-10-01 (#42611)
eladkal Oct 1, 2024
d413f0b
Prevent redirect loop on /home with tags/lastrun filters (#42607) (#4…
jmaicher Oct 1, 2024
13f1158
Remove `AIRFLOW_V_2_7_PLUS` constant (#42627)
vincbeck Oct 1, 2024
4380bff
Move FSHook/PackageIndexHook/SubprocessHook to standard provider (#42…
gopidesupavan Oct 1, 2024
828a6d8
send notification to internal-ci-cd channel (#42630)
romsharon98 Oct 1, 2024
730347b
Add heartbeat metric for DAG processor (#42398)
rawwar Oct 1, 2024
e8fbe03
Fix the order of tasks during serialization (#42219)
millin Oct 2, 2024
375ea2d
Remove state sync during celery task processing (#41870)
Kytha Oct 2, 2024
71112f0
fix: rm `skip_if` and `run_if` in python source (#41832)
phi-friday Oct 2, 2024
bdee2d3
fix: task flow dynamic mapping with default_args (#41592)
phi-friday Oct 2, 2024
4fea1bc
Adds new `triggerer.capacity_left[.<hostname>]` metric (#41323)
Usiel Oct 2, 2024
296f84c
[HELM] - Add guide how to PgBouncer with Kubernetes Secret (#42460)
andormarkus Oct 2, 2024
830f35b
Add dag run creation logic for backfill (#42529)
dstandish Oct 2, 2024
5600388
All executors should inherit from BaseExecutor (#41904)
dstandish Oct 2, 2024
a7ff6a5
Revert "Fix the order of tasks during serialization (#42219)" (#42646)
dstandish Oct 2, 2024
f5e3711
Check pool_slots on partial task import instead of execution (#39724)
karenbraganz Oct 2, 2024
7ea01a3
Add retry logic in the scheduler for updating trigger timeouts in cas…
TakawaAkirayo Oct 2, 2024
4ee2b0b
Fix consistent return response from PubSubPullSensor (#42080)
gopidesupavan Oct 2, 2024
51cb1ff
Fix type-ignore comment for typing changes (#42656)
uranusjr Oct 2, 2024
e0cf55e
AIP-84 Migrate delete a connection to FastAPI API (#42571)
bugraoz93 Oct 2, 2024
908b8e7
Add is_paused toggle (#42621)
bbovenzi Oct 2, 2024
a12d78c
Correctly select task in DAG Graph View when clicking on its name (#3…
jonhspyro Oct 2, 2024
78a84fd
Revert "Move FSHook/PackageIndexHook/SubprocessHook to standard provi…
gopidesupavan Oct 2, 2024
6c00b89
Add backfill cancellation logic (#42530)
dstandish Oct 2, 2024
dc6597b
Use FAB auth manager in `test_google_openid` (#42622)
vincbeck Oct 2, 2024
c3879aa
Remove "project" from log path in callback docs (#42666)
jedcunningham Oct 2, 2024
879537e
Fix invalid path in lineage.rst (#42655)
shahar1 Oct 2, 2024
300f260
Add support for PostgreSQL 17 in Breeze (#42644)
jedcunningham Oct 2, 2024
bd7c86e
Update AWS system test `example_emr_serverless` (#42669)
vincbeck Oct 2, 2024
035d137
Rename wrongly named test (#42667)
vincbeck Oct 2, 2024
9b32cb9
Upgrade build dependencies to latest (tomli) (#42672)
potiuk Oct 2, 2024
a11df4d
Make `private_key_content` a sensitive field in Snowflake connection…
rawwar Oct 2, 2024
5db66b1
Ignore peformance directory in mypy-airflow pre-commit (#42657)
shahar1 Oct 2, 2024
96367cc
add gopidesupavan to triage team (#42602)
romsharon98 Oct 2, 2024
b2b0677
Temporarily disable branch protection for older v2-* branches (#42680)
potiuk Oct 2, 2024
d1705c7
Revert "Temporarily disable branch protection for older v2-* branches…
potiuk Oct 2, 2024
77bb928
Add debug logs to print Request/Response data in Databricks provider…
rawwar Oct 2, 2024
f529e16
Point users at `db migrate` if there are outstanding migrations (#42670)
jedcunningham Oct 2, 2024
40f8c56
Removed deprecated concurrency field from dag details schema (#42660)
dirrao Oct 3, 2024
741f087
Add Snowpark operator and decorator (#42457)
sfc-gh-jdu Oct 3, 2024
a32ba9d
Remove special handling of backfills in scheduler (#42678)
dstandish Oct 3, 2024
0970d64
Remove DagRunNotBackfillDep (#42552)
dstandish Oct 3, 2024
f882c98
Add standard provider to preinstalled providers. (#42676)
potiuk Oct 3, 2024
4eb2353
AIP-84 Migrate the public endpoint DAG Details to FastAPI (#42631)
omkar-foss Oct 3, 2024
79f3cb3
small fixes for system tests (#42614)
VladaZakharova Oct 3, 2024
ae5d319
AIP-69: Add API and Plugin to Edge Provider (#42049)
jscheffl Oct 3, 2024
446ac40
Update min version of Pydantic to 2.6.4 (#42694)
potiuk Oct 3, 2024
b5bafdf
Add `on_kill` to Databricks Workflow Operator (#42115)
R7L208 Oct 3, 2024
0a9fb4e
AIP-84 Serve new UI from FastAPI API (#42663)
pierrejeambrun Oct 3, 2024
7f1588e
fix(shell_params): prevent generating `,celery` in extra when there i…
josix Oct 3, 2024
0ab281d
Mention in simple auth manager doc how to read/update passwords direc…
vincbeck Oct 3, 2024
a912fef
Update tensorflow image uris for VertexAI system tests (#42707)
MaksYermak Oct 3, 2024
9f4cf3b
fix PubSubAsyncHook in PubsubPullTrigger to use gcp_conn_id (#42671)
gopidesupavan Oct 3, 2024
38941c5
Rename dataset endpoints as asset endpoints (#42579)
Lee-W Oct 3, 2024
ded7a12
Improve startup of K8S tests (#42721)
gopidesupavan Oct 4, 2024
914dd23
- Snowflake does not currently support variable binding in multi-stat…
harjeevanmaan Oct 4, 2024
7f740ac
option to enable ipv6 ipaddress resolve support for statsd host (#42625)
kongdewen Oct 4, 2024
49e2fc4
Add an ability to use scan queries via new YDB operator (#42311)
vgvoleg Oct 4, 2024
2e6cefc
Changing dag_id to a positional argument in the 'dags list-runs' CLI …
dirrao Oct 4, 2024
d167458
Added unit tests and restructred `await_xcom_sidecar_container_start`…
harjeevanmaan Oct 4, 2024
68a3fb2
AIP-84 Migrate GET connection to FastAPI API (#42674)
rawwar Oct 4, 2024
5f2130f
Removed unused and deprecated custom dag dependancy detector from ser…
dirrao Oct 4, 2024
4b314d7
Typo correction in 07_local_virtualenv.rst (#42727)
nitesh-dubey-samsung Oct 4, 2024
80c54b4
Handle empty login and password with opensearch client (#39982)
pdebelak Oct 4, 2024
4916f03
Fix main failures and adjust test names and file names according to c…
bugraoz93 Oct 4, 2024
dbb6c00
Add fastapi subapps to plugin system (#42740)
pierrejeambrun Oct 4, 2024
d0799e9
Publish Dataproc Serverless Batch link after it starts if batch_id wa…
rafalh Oct 4, 2024
9c6764e
updated INTHEWILD.md with SailPoint (#42746)
andrew-stein-sp Oct 4, 2024
869797e
Fix broken compat test after PR 42740 (#42750)
jscheffl Oct 4, 2024
745d851
Fix broken compat test after PR 42740 attempt 2 (#42755)
jscheffl Oct 4, 2024
f431ab5
feat(providers/common/sql): add warning to connection setter (#42736)
Lee-W Oct 4, 2024
5c41a51
Remove airflow_version from k8s executor pod selector (#42751)
dstandish Oct 5, 2024
f49b61f
Add 'retry_if_resource_not_ready' logic for DataprocCreateClusterOper…
MaksYermak Oct 5, 2024
9e7a349
Include Selective Check to Ping Maintainer about Legacy WWW and API C…
bugraoz93 Oct 5, 2024
02c5a87
Minor changes in the SparkKubernetesOperator documentaiont. (#42613)
damjad Oct 5, 2024
51fe875
Add "tests/test_utils" folder to the list of files triggering full te…
potiuk Oct 5, 2024
177d4ac
Update celery_executor.rst (#42741)
tampal Oct 5, 2024
724ff32
Schedule backfills in the scheduler (#42686)
dstandish Oct 5, 2024
cf5e6ef
Fix failing tests for test log handler attempt 3 (#42772)
gopidesupavan Oct 5, 2024
4ea77a4
Removed deprectaed extras dict from hatch build (#42647)
dirrao Oct 6, 2024
dc1cb6a
Removed conditional check for task context logging in airflow version…
dirrao Oct 6, 2024
6ceace6
fix test_cli_internal_api_background process termination (#42773)
gopidesupavan Oct 6, 2024
c806b7d
fix fast api background process test (#42781)
gopidesupavan Oct 6, 2024
fcbcde8
Fix import sequencing in skip-db-tests (#42787)
dstandish Oct 6, 2024
6af0dfc
fix fastapi port (#42791)
rawwar Oct 7, 2024
f4b65bb
Removed unicodecsv dependency for providers with Airflow version 2.8.…
dirrao Oct 7, 2024
d8d2959
Removed deprecated k8s rendering methods from task instance module (#…
dirrao Oct 7, 2024
9093357
Add standard provider to chicken-egg-providers (#42760)
potiuk Oct 7, 2024
349c475
Remove burdensome eslint rules (#42795)
bbovenzi Oct 7, 2024
f614aec
kubernetes executor cleanup_stuck_queued_tasks optimization (#41220)
dirrao Oct 7, 2024
e5976f3
FIX: Only pass connection to sqlalchemy engine in JdbcHook (#42705)
dabla Oct 7, 2024
78e0dcf
The function resolve_kerberos_principal updated when airflow version …
dirrao Oct 7, 2024
75bf237
remove docstring D214 and D215 from ignore list (#42802)
dannyl1u Oct 7, 2024
4d49b20
AIP-84 Simplify route definition (#42799)
pierrejeambrun Oct 7, 2024
c0c3ab4
Bump micromatch from 4.0.7 to 4.0.8 in /airflow/ui (#42805)
dependabot[bot] Oct 7, 2024
6a5fa33
Bump rollup from 4.21.0 to 4.24.0 in /airflow/ui (#42804)
dependabot[bot] Oct 7, 2024
dceeb72
Bump vite from 5.4.4 to 5.4.6 in /airflow/ui (#42803)
dependabot[bot] Oct 7, 2024
1b808c2
fix(assets/managers): fix error handling file loc when asset alias re…
Lee-W Oct 8, 2024
7f65001
AIP-84 Delete Variable (#42798)
pierrejeambrun Oct 8, 2024
e9d3e3f
Drop python3.8 support core and providers (#42766)
jscheffl Oct 8, 2024
3092ea5
Add ability to switch between table and card views for listing items …
bbovenzi Oct 8, 2024
466b7ee
Remove more burdensome eslint rules (#42819)
pierrejeambrun Oct 8, 2024
0329980
Updating prometheus statsd exporter version from v0.27.2-pr579 to v0.…
gopidesupavan Oct 8, 2024
83cfe89
Specify asyncio_default_fixture_loop_scope in pytest.ini (#42827)
dstandish Oct 8, 2024
720bba1
feat: allow customizing podManagementPolicy (#42673)
EvertonSA Oct 8, 2024
70c9a05
Fix import sequencing of backfill and dagrun models (#42828)
dstandish Oct 8, 2024
aa473ed
add warning log when task_key>100 (#42813)
rawwar Oct 8, 2024
b183df6
Switch `kuberenetes_tests` to run with `uv run` (#42836)
ashb Oct 8, 2024
749ffa3
CI providers discovery update when airflow min 2.7.0 (#42767)
dirrao Oct 8, 2024
337449b
Make Scarf details more prominent in 2.10 release notes (#42838)
kaxil Oct 8, 2024
2c320ba
Add ability to provide proxy for dbt Cloud connection (#42737)
b-per Oct 8, 2024
b6ff864
Update CODEOWNERS to update Kaxil's entry (#42839)
kaxil Oct 8, 2024
2da6848
Remove unused ldap3 dependency (#42829)
glostis Oct 8, 2024
a4b998e
Improve docs on adding Google secrets in AWS Secrets Manager (#42832)
zachliu Oct 8, 2024
6d7d2c7
Remove `sqlalchemy-redshift` dependency from Amazon provider (#42830)
vincbeck Oct 8, 2024
3341931
Simplify code for recent dbt provider change (#42840)
kaxil Oct 8, 2024
add13ba
Merge remote-tracking branch 'origin/fix/fab-access-control-revoke-st…
joaopamaral Oct 21, 2024
4662541
fix typing check
joaopamaral Oct 21, 2024
7521ee4
add unit test
joaopamaral Oct 21, 2024
08faa8e
Merge branch 'main' into fix/fab-access-control-revoke-stale-permissi…
joaopamaral Oct 21, 2024
d954df4
reformat files
joaopamaral Oct 22, 2024
8daa2a7
fix typing
joaopamaral Oct 22, 2024
83348b6
Merge branch 'main' into fix/fab-access-control-revoke-stale-permissi…
joaopamaral Oct 25, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -1107,7 +1107,7 @@ def is_dag_resource(self, resource_name: str) -> bool:
def sync_perm_for_dag(
self,
dag_id: str,
access_control: dict[str, dict[str, Collection[str]]] | None = None,
access_control: dict[str, dict[str, Collection[str]] | Collection[str]] | None = None,
) -> None:
"""
Sync permissions for given dag id.
Expand Down Expand Up @@ -1149,7 +1149,7 @@ def _resource_name(self, dag_id: str, resource_name: str) -> str:
def _sync_dag_view_permissions(
self,
dag_id: str,
access_control: dict[str, dict[str, Collection[str]]],
access_control: dict[str, dict[str, Collection[str]] | Collection[str]],
) -> None:
"""
Set the access policy on the given DAG's ViewModel.
Expand All @@ -1175,7 +1175,13 @@ def _get_or_create_dag_permission(action_name: str, dag_resource_name: str) -> P
for perm in existing_dag_perms:
non_admin_roles = [role for role in perm.role if role.name != "Admin"]
for role in non_admin_roles:
target_perms_for_role = access_control.get(role.name, {}).get(resource_name, set())
access_control_role = access_control.get(role.name)
target_perms_for_role = set()
if access_control_role:
if isinstance(access_control_role, set):
target_perms_for_role = access_control_role
elif isinstance(access_control_role, dict):
target_perms_for_role = access_control_role.get(resource_name, set())
if perm.action.name not in target_perms_for_role:
self.log.info(
"Revoking '%s' on DAG '%s' for role '%s'",
Expand All @@ -1194,7 +1200,7 @@ def _get_or_create_dag_permission(action_name: str, dag_resource_name: str) -> P
f"'{rolename}', but that role does not exist"
)

if isinstance(resource_actions, (set, list)):
if not isinstance(resource_actions, dict):
# Support for old-style access_control where only the actions are specified
resource_actions = {permissions.RESOURCE_DAG: set(resource_actions)}

Expand Down
15 changes: 13 additions & 2 deletions providers/tests/fab/auth_manager/test_security.py
Original file line number Diff line number Diff line change
Expand Up @@ -865,11 +865,22 @@ def test_access_control_is_set_on_init(
)


@pytest.mark.parametrize(
"access_control_before, access_control_after",
[
(READ_WRITE, READ_ONLY),
# old access control format
({permissions.ACTION_CAN_READ, permissions.ACTION_CAN_EDIT}, {permissions.ACTION_CAN_READ}),
],
ids=["new_access_control_format", "old_access_control_format"],
)
def test_access_control_stale_perms_are_revoked(
app,
security_manager,
assert_user_has_dag_perms,
assert_user_does_not_have_dag_perms,
access_control_before,
access_control_after,
):
username = "access_control_stale_perms_are_revoked"
role_name = "team-a"
Expand All @@ -882,12 +893,12 @@ def test_access_control_stale_perms_are_revoked(
) as user:
set_user_single_role(app, user, role_name="team-a")
security_manager._sync_dag_view_permissions(
"access_control_test", access_control={"team-a": READ_WRITE}
"access_control_test", access_control={"team-a": access_control_before}
)
assert_user_has_dag_perms(perms=["GET", "PUT"], dag_id="access_control_test", user=user)

security_manager._sync_dag_view_permissions(
"access_control_test", access_control={"team-a": READ_ONLY}
"access_control_test", access_control={"team-a": access_control_after}
)
# Clear the cache, to make it pick up new rol perms
user._perms = None
Expand Down