Closed
Description
Body
I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?
The guidelines on how to test providers can be found in
Verify providers by contributors
Let us know in the comments, whether the issue is addressed.
These are providers that require testing as there were some substantial changes introduced:
Provider amazon: 9.8.0rc1
- Add in-memory buffer and gzip support in SqlToS3Operator (#50287): @james5418
Linked issues: - Add Key to default meta keys in S3KeySensor (#50122): @Dukastlik
Linked issues: - Update Sagemaker Operators and Sensors to inherit Base AWS classes (#50321): @ellisms
Provider apache.beam: 6.1.0rc1
Provider apache.druid: 4.2.0rc1
- Migrate
Hive
provider to useget_df
(#50070): @guan404ming
Linked issues:
Provider apache.hive: 9.1.0rc1
- Refine type overload for
HiveServer2Hook
(#50211): @guan404ming - Migrate
Hive
provider to useget_df
(#50070): @guan404ming
Linked issues:
Provider apache.kafka: 1.9.0rc1
- AIP-82: Add KafkaMessageQueueProvider (#49938): @jason810496
- fix: correct invalid arg timeout (#49426): @simonprydden
Linked issues: - Fix max_messages warning of Kafka ConsumeFromTopicOperator (#48646): @nguymin4
Provider apache.livy: 4.4.0rc1
Provider apache.spark: 5.3.0rc1
- add root parent information to OpenLineage events (#49237): @mobuchowski
- Bump Pyspark to even higher version (#50308): @potiuk
Provider celery: 3.11.0rc1
- Fix execution API server URL handling for relative paths (#49782): @kaxil
- Make default execution server URL be relative to API Base URL (#49747): @kaxil
Provider cncf.kubernetes: 10.5.0rc1
- [KubernetesPodOperator] Add fail fast detection during pod startup (#49867): @AutomationDev85
- [KubernetesPodOperator] Dectection of different timeouts for schedule and startup state (#49784): @AutomationDev85
- Add configurable automountServiceAccountToken for the KubernetesPodOperator (#50223): @DjVinnii
- Add
test_connection
method toKubernetesHook
(#47881): @fritz-astronomer - Add
@task.kuberenetes_cmd
(#46913): @insomnes
Linked issues: - Move SQS message queue to Amazon provider (#50057): @potiuk
Provider cohere: 1.5.0rc1
- Change CohereHook.get_conn type from property to method in the next major apache-airflow-providers-cohere (#50470): @sjyangkevin
Provider common.messaging: 1.0.2rc1
Provider common.sql: 1.27.1rc1
- Update deprecated functions to use stable functions (#50275): @guan404ming
- Update type to follow newest typing spec (#50229): @guan404ming
Provider databricks: 7.4.0rc1
- Upgrade
DatabricksSqlHook
to supportpolars
(#50523): @guan404ming
Linked issues: - feat: Add OpenLineage support for DatabricksSqlHook (#50392): @kacpermuda
- Add logs SQL before execution in
snowflake
anddatabricks_sql
(#48942): @guan404ming
Linked issues: - Update deprecated functions to use the stable functions (#49460): @guan404ming
Linked issues:
Provider dbt.cloud: 4.4.0rc1
- add root parent information to OpenLineage events (#49237): @mobuchowski
- nit: Switch to emitting OL events with adapter and not client directly (#50398): @kacpermuda
- fix: adjust dag_run extraction for Airflow 3 in OL utils (#50346): @kacpermuda
Linked issues: - Use Label class from task sdk in providers (#49398): @amoghrajesh
Provider edge3: 1.1.0rc1
- Support For Edge Worker in Daemon Mode (#50425): @dheerajturaga
- Ability to request shutdown of a remote edge worker (#50278): @dheerajturaga
- Extend Edge Worker CLI commands operate on remote edge workers (#49915): @dheerajturaga
- Edge worker maintenance state is remembered if worker crashes (#50338): @majorosdonat
- Fix execution API server URL handling for relative paths (#49782): @kaxil
- Make default execution server URL be relative to API Base URL (#49747): @kaxil
- Ensure fab provider is installed when running EdgeExecutor (#49473): @jscheffl
Provider elasticsearch: 6.3.0rc1
- Migrate
ElasticsearchSQLHook
to useget_df
(#50454): @guan404ming
Linked issues:
Provider exasol: 4.8.0rc1
- Migrate
Exasol
provider to useget_df
(#50017): @guan404ming
Linked issues: - Update deprecated functions to use the stable functions (#49460): @guan404ming
Linked issues:
Provider fab: 2.1.0rc1
- Add back ProxyFix Middleware for flask app builder (#49942): @gschuurman
Linked issues: - Move access_denied_message webserver config to fab (#50208): @pierrejeambrun
- Move webserver expose_hostname config to fab (#50269): @pierrejeambrun
- Upgrade
flask-appbuilder
to 4.6.3 in FAB provider (#50513): @vincbeck
Linked issues: - docs: conditionally render section‐move links in sections‐and‐options include (#50582): @sunank200
Provider facebook: 3.8.0rc1
Provider git: 0.0.2rc1
- Don't log repo_url in git dag bundle (#48909): @dstandish
- Make git connection optional for git dag bundle (#49270): @dstandish
- Use 'git_default' if the user defines nothing (#49359): @uranusjr
- Include subdir in Gitbundle view url (#49239): @ephraimbuddy
Provider microsoft.azure: 12.4.0rc1
- feat(provider/azure): Add Power BI triggers, operators and tests for dataset and workspace operations (#50001): @mvfc
- bugfix: Add handling for unhealthy state in
AzureContainerInstancesOperator
(#49688): @eladkal - Suppress deprecation warning when unpacking context in default_event_handler of MSGraphAsyncOperator (#47069): @dabla
- Limit portalocker in an attempt to avoid resolution too deep in Py3.12 (#49936): @potiuk
- Use Label class from task sdk in providers (#49398): @amoghrajesh
Provider openlineage: 2.3.0rc1
- add root parent information to OpenLineage events (#49237): @mobuchowski
- feat: Add DAG versioning information to OpenLineage events (#48741): @kacpermuda
- Improve execution time messages for DAG or Task not found (#49352): @ashb
- nit: Remove duplicate warning when no OL metadata returned (#50350): @kacpermuda
Provider oracle: 4.1.0rc1
- feat: add expire_time configuration to OracleHook connection (#49521): @simonprydden
Linked issues: - Fix
get_uri
for oracle (#49533): @guan404ming
Provider pagerduty: 5.0.0rc1
- Replace pdpyras with pagerduty library in PagerDuty integration (#48919): @simonprydden
- Update description of provider.yaml dependencies (#50231): @potiuk
Provider presto: 5.9.0rc1
- Migrate
PrestoHook
andTrinoHook
to useget_df
(#50123): @guan404ming
Linked issues:
Provider qdrant: 1.4.0rc1
Provider redis: 4.1.0rc1
- Fix: SQLExecuteQueryOperator does not pass extra_dejson values to hook_params (#49282): @kandharvishnu
Provider sendgrid: 4.1.0rc1
Provider slack: 9.1.0rc1
- Migrate
BaseSqlToSlackOperator
to useget_df
(#50143): @guan404ming
Linked issues:
Provider snowflake: 6.3.1rc1
- fix: Adjust OpenLineage task state check for Airflow 3 (#50380): @kacpermuda
- nit: Switch to emitting OL events with adapter and not client directly (#50398): @kacpermuda
- docs: remove stale warning about SnowflakeOperator (#50450): @eladkal
Provider standard: 1.2.0rc1
- Flattening the
requirements
input for python venv operators (#50521): @amoghrajesh - Preserve all context keys during serialization (#50446): @yannlambret
- Use latest bundle version when clearing / re-running dag (#50040): @dstandish
- Update
WorkflowTrigger
to forward failed_stat (#50487): @guan404ming
Linked issues: - Adding deprecation notice for get_current_context in std provider (#50301): @amoghrajesh
- Refactor Branch Operators to use
BaseBranchOperator
(#48979): @kaxil - Removed duplicate test_generic_transfer from standard provider (#49786): @dabla
- Add back missing
[sources]
link in generated documentation's includes (#49978): @potiuk
Linked issues:
Provider trino: 6.2.0rc1
- Migrate
PrestoHook
andTrinoHook
to useget_df
(#50123): @guan404ming
Linked issues: - Fix Trino provider doc (#50018): @pierrejeambrun
All users involved in the PRs:
@ellisms @jscheffl @ashb @Dukastlik @gschuurman @dstandish @olegkachur-e @kacpermuda @dabla @pierrejeambrun @kandharvishnu @AutomationDev85 @majorosdonat @eladkal @potiuk @mobuchowski @sunank200 @YannLa
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.