-
Notifications
You must be signed in to change notification settings - Fork 690
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Prepare pre-release 3.0.0rc2 (#1746)
- Loading branch information
1 parent
b14c199
commit 78a3734
Showing
24 changed files
with
112 additions
and
114 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -11,7 +11,7 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q | |
|
||
> An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | [email protected] | ||
[![Release](https://img.shields.io/badge/release-3.0.0rc1-brightgreen.svg)](https://pypi.org/project/awswrangler/) | ||
[![Release](https://img.shields.io/badge/release-3.0.0rc2-brightgreen.svg)](https://pypi.org/project/awswrangler/) | ||
[![Python Version](https://img.shields.io/badge/python-3.7%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler) | ||
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black) | ||
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0) | ||
|
@@ -26,7 +26,7 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q | |
| **[PyPi](https://pypi.org/project/awswrangler/)** | [![PyPI Downloads](https://pepy.tech/badge/awswrangler)](https://pypi.org/project/awswrangler/) | `pip install awswrangler` | | ||
| **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [![Conda Downloads](https://img.shields.io/conda/dn/conda-forge/awswrangler.svg)](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` | | ||
|
||
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> | ||
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#aws-glue-pyspark-jobs), MWAA):**<br> | ||
➡️ `pip install pyarrow==2 awswrangler` | ||
|
||
Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/) | ||
|
@@ -45,7 +45,7 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http | |
|
||
Installation command: `pip install awswrangler` | ||
|
||
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> | ||
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#aws-glue-pyspark-jobs), MWAA):**<br> | ||
➡️`pip install pyarrow==2 awswrangler` | ||
|
||
```py3 | ||
|
@@ -102,7 +102,7 @@ AWS SDK for pandas can also run your workflows at scale by leveraging [modin](ht | |
|
||
### Installation | ||
``` | ||
pip install "awswrangler[modin,ray]==3.0.0rc1" | ||
pip install "awswrangler[modin,ray]==3.0.0rc2" | ||
``` | ||
|
||
As a result existing scripts can run on significantly larger datasets with no code rewrite. Supported APIs are parallelized across cores on a single machine or across multiple nodes on a cluster in the cloud. | ||
|
@@ -133,17 +133,17 @@ As a result existing scripts can run on significantly larger datasets with no co | |
|
||
## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/) | ||
|
||
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/what.html) | ||
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html) | ||
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#pypi-pip) | ||
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#conda) | ||
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-lambda-layer) | ||
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-python-shell-jobs) | ||
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-pyspark-jobs) | ||
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#amazon-sagemaker-notebook) | ||
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#amazon-sagemaker-notebook-lifecycle) | ||
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#emr) | ||
- [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#from-source) | ||
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/what.html) | ||
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html) | ||
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#pypi-pip) | ||
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#conda) | ||
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#aws-lambda-layer) | ||
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#aws-glue-python-shell-jobs) | ||
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#aws-glue-pyspark-jobs) | ||
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#amazon-sagemaker-notebook) | ||
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#amazon-sagemaker-notebook-lifecycle) | ||
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#emr) | ||
- [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/install.html#from-source) | ||
- [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) | ||
- [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb) | ||
- [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb) | ||
|
@@ -178,31 +178,31 @@ As a result existing scripts can run on significantly larger datasets with no co | |
- [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb) | ||
- [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb) | ||
- [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb) | ||
- [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/release-3.0.0/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb) | ||
- [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/release-3.0.0/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb) | ||
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html) | ||
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-s3) | ||
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-glue-catalog) | ||
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-athena) | ||
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-lake-formation) | ||
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-redshift) | ||
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#postgresql) | ||
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#mysql) | ||
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#sqlserver) | ||
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#oracle) | ||
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#data-api-redshift) | ||
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#data-api-rds) | ||
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#opensearch) | ||
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-neptune) | ||
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#dynamodb) | ||
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-timestream) | ||
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-emr) | ||
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-cloudwatch-logs) | ||
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-chime) | ||
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-quicksight) | ||
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-sts) | ||
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-secrets-manager) | ||
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#global-configurations) | ||
- [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/release-3.0.0rc2/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb) | ||
- [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/release-3.0.0rc2/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb) | ||
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html) | ||
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-s3) | ||
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#aws-glue-catalog) | ||
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-athena) | ||
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#aws-lake-formation) | ||
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-redshift) | ||
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#postgresql) | ||
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#mysql) | ||
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#sqlserver) | ||
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#oracle) | ||
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#data-api-redshift) | ||
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#data-api-rds) | ||
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#opensearch) | ||
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-neptune) | ||
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#dynamodb) | ||
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-timestream) | ||
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-emr) | ||
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-cloudwatch-logs) | ||
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-chime) | ||
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#amazon-quicksight) | ||
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#aws-sts) | ||
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#aws-secrets-manager) | ||
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc2/api.html#global-configurations) | ||
- [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt) | ||
- [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md) | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1 @@ | ||
3.0.0rc1 | ||
3.0.0rc2 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.