A RetroSearch Logo

Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Search Query:

Showing content from https://github.com/ml-tooling/best-of-python below:

lukasmasuch/best-of-python: πŸ† A ranked list of awesome Python open-source libraries and tools. Updated weekly.

πŸ†  A ranked list of awesome Python open-source libraries & tools. Updated weekly.

This curated list contains 390 awesome open-source projects with a total of 2M stars grouped into 28 categories. All projects are ranked by a project-quality score, which is calculated based on various metrics automatically collected from GitHub and different package managers. If you like to add or update projects, feel free to open an issue, submit a pull request, or directly edit the projects.yaml. Contributions are very welcome!

πŸ§™β€β™‚οΈ  Discover other best-of lists or create your own.
πŸ“«  Subscribe to our newsletter for updates and trending projects.

protobuf (πŸ₯‡51 Β· ⭐ 69K) - Protocol Buffers - Googles data interchange format. BSD-3 flatbuffers (πŸ₯‡42 Β· ⭐ 25K) - FlatBuffers: Memory Efficient Serialization Library. Apache-2 marshmallow (πŸ₯ˆ36 Β· ⭐ 7.2K) - A lightweight library for converting complex objects to and from.. MIT orjson (πŸ₯ˆ34 Β· ⭐ 7.3K) - Fast, correct Python JSON library supporting dataclasses, datetimes,.. Apache-2 dill (πŸ₯ˆ34 Β· ⭐ 2.4K) - serialize all of Python. BSD-3 jsonpickle (πŸ₯ˆ34 Β· ⭐ 1.3K) - Python library for serializing any arbitrary object graph into.. BSD-3 simplejson (πŸ₯ˆ32 Β· ⭐ 1.7K) - simplejson is a simple, fast, extensible JSON encoder/decoder for.. MIT ultrajson (πŸ₯‰31 Β· ⭐ 4.4K) - Ultra fast JSON decoder and encoder written in C with Python bindings. BSD-3 msgpack (πŸ₯‰31 Β· ⭐ 2K) - MessagePack serializer implementation for Python msgpack.org[Python]. Apache-2 cloudpickle (πŸ₯‰29 Β· ⭐ 1.8K) - Extended pickling support for Python objects. BSD-3 python-rapidjson (πŸ₯‰28 Β· ⭐ 520) - Python wrapper around rapidjson. MIT srsly (πŸ₯‰25 Β· ⭐ 470 Β· πŸ’€) - Modern high-performance serialization utilities for Python (JSON,.. MIT rtoml (πŸ₯‰17 Β· ⭐ 370 Β· πŸ’€) - A fast TOML library for python implemented in rust. MIT Show 3 hidden projects...
Data Containers & Dataframes

General-purpose data containers as well as utilities & extensions for pandas.

pandas (πŸ₯‡51 Β· ⭐ 46K) - Flexible and powerful data analysis / manipulation library for.. BSD-3 polars (πŸ₯‡40 Β· ⭐ 35K) - Dataframes powered by a multithreaded, vectorized query engine, written in.. MIT h5py (πŸ₯‡40 Β· ⭐ 2.2K) - HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5.. BSD-3 xarray (πŸ₯ˆ39 Β· ⭐ 3.9K) - N-D labeled arrays and datasets in Python. Apache-2 numexpr (πŸ₯ˆ35 Β· ⭐ 2.3K) - Fast numerical array expression evaluator for Python, NumPy, Pandas,.. MIT zarr (πŸ₯ˆ35 Β· ⭐ 1.8K) - An implementation of chunked, compressed, N-dimensional arrays for Python. MIT Modin (πŸ₯ˆ34 Β· ⭐ 10K) - Modin: Scale your Pandas workflows by changing a single line of.. Apache-2 PyTables (πŸ₯ˆ32 Β· ⭐ 1.3K) - A Python package to manage extremely large amounts of data. BSD-3 Bottleneck (πŸ₯ˆ32 Β· ⭐ 1.1K) - Fast NumPy array functions written in C. BSD-2 pandera (πŸ₯ˆ31 Β· ⭐ 4K) - A light-weight, flexible, and expressive statistical data testing.. MIT docarray (πŸ₯ˆ31 Β· ⭐ 3.1K) - Represent, send, store and search multimodal data. Apache-2 Vaex (πŸ₯‰29 Β· ⭐ 8.4K Β· πŸ’€) - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML,.. MIT TinyDB (πŸ₯‰29 Β· ⭐ 7.2K Β· πŸ’€) - TinyDB is a lightweight document oriented database optimized for your.. MIT StaticFrame (πŸ₯‰27 Β· ⭐ 470) - Immutable and statically-typeable DataFrames with runtime type and.. MIT datatable (πŸ₯‰26 Β· ⭐ 1.9K) - A Python package for manipulating 2-dimensional tabular data.. MPL-2.0 pickleDB (πŸ₯‰19 Β· ⭐ 1K) - pickleDB is an in memory key-value store using Pythons orjson module for.. BSD-3 Pandas Summary (πŸ₯‰19 Β· ⭐ 520) - Engine for ML/Data tracking, visualization,.. Apache-2 Show 13 hidden projects...

pyrsistent (πŸ₯‡32 Β· ⭐ 2.1K) - Persistent/Immutable/Functional data structures for Python. MIT bidict (πŸ₯‡29 Β· ⭐ 1.5K) - The bidirectional mapping library for Python. MPL-2.0 anytree (πŸ₯ˆ28 Β· ⭐ 1K) - Python tree data library. Apache-2 ordered-set (πŸ₯ˆ27 Β· ⭐ 220 Β· πŸ’€) - A mutable set that remembers the order of its entries. One of.. MIT glom (πŸ₯‰24 Β· ⭐ 2.1K Β· πŸ’€) - Pythons nested data operator (and CLI), for all your declarative.. BSD-3 python-benedict (πŸ₯‰24 Β· ⭐ 1.6K) - dict subclass with keylist/keypath support, built-in I/O.. MIT multidict (πŸ₯‰24 Β· ⭐ 470) - The multidict implementation. Apache-2 immutables (πŸ₯‰23 Β· ⭐ 1.2K Β· πŸ’€) - A high-performance immutable mapping type for Python. Apache-2 python-box (πŸ₯‰22 Β· ⭐ 2.8K Β· πŸ’€) - Python dictionaries with advanced dot notation access. MIT janus (πŸ₯‰22 Β· ⭐ 900) - Thread-safe asyncio-aware queue for Python. Apache-2 Show 5 hidden projects...

pydantic (πŸ₯‡42 Β· ⭐ 25K) - Data validation using Python type hints. MIT jsonschema (πŸ₯‡39 Β· ⭐ 4.8K) - An implementation of the JSON Schema specification for Python. MIT cerberus (πŸ₯ˆ32 Β· ⭐ 3.2K) - Lightweight, extensible data validation library for Python. ISC voluptuous (πŸ₯ˆ30 Β· ⭐ 1.8K) - CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data.. BSD-3 validators (πŸ₯ˆ30 Β· ⭐ 1.1K) - Python Data Validation for Humans. MIT param (πŸ₯ˆ29 Β· ⭐ 490) - Param: Make your Python code clearer and more reliable by declaring.. BSD-3 schema (πŸ₯‰27 Β· ⭐ 2.9K) - Schema validation just got Pythonic. MIT python-email-validator (πŸ₯‰25 Β· ⭐ 1.3K) - A robust email syntax and deliverability validation.. Unlicense dirty-equals (πŸ₯‰20 Β· ⭐ 900) - Doing dirty (but extremely useful) things with equals. MIT typical (πŸ₯‰17 Β· ⭐ 180 Β· πŸ’€) - Typical: Fast, simple, & correct data-validation using Python 3 typing. MIT Show 5 hidden projects...
Algorithms & Design Patterns

πŸ”— python-patterns ( ⭐ 42K) - Collection of design patterns/idioms in Python.

transitions (πŸ₯‡33 Β· ⭐ 6.2K) - A lightweight, object-oriented finite state machine implementation.. MIT algorithms (πŸ₯‰27 Β· ⭐ 25K) - Minimal examples of data structures and algorithms in Python. MIT Show 1 hidden projects...

arrow (πŸ₯‡36 Β· ⭐ 8.9K) - Better dates & times for Python. Apache-2 holidays (πŸ₯‡36 Β· ⭐ 1.7K) - Open World Holidays Framework. MIT pendulum (πŸ₯ˆ33 Β· ⭐ 6.5K) - Python datetimes made easy. MIT dateparser (πŸ₯ˆ32 Β· ⭐ 2.7K) - python parser for human readable dates. BSD-3 python-dateutil (πŸ₯ˆ32 Β· ⭐ 2.5K) - Useful extensions to the standard Python datetime features. Apache-2 pytz (πŸ₯‰31 Β· ⭐ 370) - pytz Python historical timezone library and database. MIT tzlocal (πŸ₯‰29 Β· ⭐ 210) - A Python module that tries to figure out what your local timezone is. MIT isodate (πŸ₯‰28 Β· ⭐ 170 Β· πŸ’€) - ISO 8601 date/time parser. BSD-3 parsedatetime (πŸ₯‰24 Β· ⭐ 700 Β· πŸ’€) - Parse human-readable date/time strings. Apache-2

filesystem_spec (πŸ₯‡36 Β· ⭐ 1.2K) - A specification that python filesystems should adhere to. BSD-3 watchdog (πŸ₯ˆ35 Β· ⭐ 7K) - Python library and shell utilities to monitor filesystem events. Apache-2 filelock (πŸ₯ˆ33 Β· ⭐ 880) - A platform-independent file lock for Python. Unlicense aiofiles (πŸ₯ˆ32 Β· ⭐ 3.1K) - File support for asyncio. Apache-2 pyfilesystem2 (πŸ₯‰26 Β· ⭐ 2.1K) - Pythons Filesystem abstraction layer. MIT scandir (πŸ₯‰23 Β· ⭐ 540) - Better directory iterator and faster os.walk(). Archived, as this has.. BSD-3 Show 4 hidden projects...

six (πŸ₯‡35 Β· ⭐ 1K Β· πŸ’€) - Python 2 and 3 compatibility library. MIT typing (πŸ₯ˆ30 Β· ⭐ 1.7K) - Python static typing home. Hosts the documentation and a user help.. Python-2.0 Show 5 hidden projects...

cryptography (πŸ₯‡44 Β· ⭐ 7.2K) - cryptography is a package designed to expose cryptographic.. Apache-2 pycryptodomex (πŸ₯ˆ34 Β· ⭐ 3.1K) - A self-contained cryptographic library for Python. BSD-3 bcrypt (πŸ₯ˆ33 Β· ⭐ 1.4K) - Modern(-ish) password hashing for your software and your servers. Apache-2 keyring (πŸ₯ˆ33 Β· ⭐ 1.4K) - Store and access your passwords safely. MIT rsa (πŸ₯‰26 Β· ⭐ 490) - Python-RSA is a pure-Python RSA implementation. Apache-2 Show 2 hidden projects...

ansible (πŸ₯‡45 Β· ⭐ 66K) - Ansible is a radically simple IT automation platform that makes your.. ❗️GPL-3.0 pulumi (πŸ₯‡44 Β· ⭐ 24K) - Pulumi - Infrastructure as Code in any programming language. Apache-2 botocore (πŸ₯ˆ43 Β· ⭐ 1.6K) - The low-level, core functionality of boto3 and the AWS CLI. Apache-2 awscli (πŸ₯ˆ41 Β· ⭐ 16K) - Universal Command Line Interface for Amazon Web Services. Apache-2 paramiko (πŸ₯ˆ39 Β· ⭐ 9.5K) - The leading native Python SSHv2 protocol library. ❗️LGPL-2.1 docker (πŸ₯ˆ38 Β· ⭐ 7.1K) - A Python library for the Docker Engine API. Apache-2 kubernetes (πŸ₯ˆ35 Β· ⭐ 7.3K) - Official Python client library for kubernetes. Apache-2 netmiko (πŸ₯ˆ34 Β· ⭐ 3.9K) - Multi-vendor library to simplify Paramiko SSH connections to network.. MIT fabric (πŸ₯‰31 Β· ⭐ 15K) - Simple, Pythonic remote execution and deployment. BSD-2 plumbum (πŸ₯‰30 Β· ⭐ 2.9K) - Plumbum: Shell Combinators. MIT pyinfra (πŸ₯‰29 Β· ⭐ 4.4K) - pyinfra turns Python code into shell commands and runs them on your.. MIT docker-compose (πŸ₯‰26 Β· ⭐ 36K Β· πŸ“‰) - Define and run multi-container applications with Docker. Apache-2 Show 8 hidden projects...

pexpect (πŸ₯‡35 Β· ⭐ 2.7K) - A Python module for controlling interactive programs in a pseudo-terminal. ISC supervisor (πŸ₯ˆ33 Β· ⭐ 8.8K) - Supervisor process control system for Unix.. ❗️Repoze Public License sh (πŸ₯‰30 Β· ⭐ 7.1K) - Python process launching. MIT ptyprocess (πŸ₯‰24 Β· ⭐ 230) - Run a subprocess in a pseudo terminal. ISC

anyio (πŸ₯‡37 Β· ⭐ 2.2K) - High level asynchronous concurrency and networking framework that works on.. MIT greenlet (πŸ₯‡37 Β· ⭐ 1.7K) - Lightweight in-process concurrent programming. MIT uvloop (πŸ₯ˆ33 Β· ⭐ 11K) - Ultra fast asyncio event loop. Apache-2 asyncer (πŸ₯‰24 Β· ⭐ 2K) - Asyncer, async and await, focused on developer experience. MIT aiomisc (πŸ₯‰20 Β· ⭐ 400) - aiomisc - miscellaneous utils for asyncio. MIT Show 2 hidden projects...

python-dotenv (πŸ₯‡37 Β· ⭐ 8.3K) - Reads key-value pairs from a .env file and can set them as.. BSD-3 hydra (πŸ₯ˆ34 Β· ⭐ 9.6K) - Hydra is a framework for elegantly configuring complex applications. MIT traitlets (πŸ₯ˆ34 Β· ⭐ 650) - A lightweight Traits like module. BSD-3 omegaconf (πŸ₯ˆ28 Β· ⭐ 2.2K Β· πŸ’€) - Flexible Python configuration system. The last one you will ever.. BSD-3 configobj (πŸ₯‰26 Β· ⭐ 330) - Python 3+ compatible port of the configobj library. BSD-3 Dynaconf (πŸ₯‰24 Β· ⭐ 4K) - dynaconf mirror (mainly for stats)- ORIGINAL REPO ON -.. MIT gin-config (πŸ₯‰24 Β· ⭐ 2.1K) - Gin provides a lightweight configuration framework for Python. Apache-2 everett (πŸ₯‰20 Β· ⭐ 150) - configuration library for python projects. MPL-2.0 Show 1 hidden projects...

click (πŸ₯‡45 Β· ⭐ 17K) - Python composable command line interface toolkit. BSD-3 rich (πŸ₯‡43 Β· ⭐ 53K) - Rich is a Python library for rich text and beautiful formatting in the terminal. MIT Typer (πŸ₯ˆ36 Β· ⭐ 18K) - Typer, build great CLIs. Easy to code. Based on Python type hints. MIT python-prompt-toolkit (πŸ₯ˆ36 Β· ⭐ 9.9K) - Library for building powerful interactive command.. BSD-3 python-fire (πŸ₯ˆ35 Β· ⭐ 28K) - Python Fire is a library for automatically generating command.. Apache-2 colorama (πŸ₯ˆ35 Β· ⭐ 3.7K) - Simple cross-platform colored terminal text in Python. BSD-3 docopt (πŸ₯ˆ33 Β· ⭐ 8K) - Create *beautiful* command-line interfaces with Python. MIT wcwidth (πŸ₯ˆ32 Β· ⭐ 420) - Python library that measures the width of unicode strings rendered to a.. MIT asciimatics (πŸ₯‰29 Β· ⭐ 4.1K) - A cross platform package to do curses-like operations, plus.. Apache-2 argcomplete (πŸ₯‰29 Β· ⭐ 1.5K) - Python and tab completion, better together. Apache-2 ConfigArgParse (πŸ₯‰29 Β· ⭐ 750) - Drop-in replacement for argparse with added support for config.. MIT cleo (πŸ₯‰28 Β· ⭐ 1.3K) - Cleo allows you to create beautiful and testable command-line interfaces. MIT questionary (πŸ₯‰27 Β· ⭐ 1.8K) - Python library to build pretty command line user prompts Easy to use.. MIT colout (πŸ₯‰16 Β· ⭐ 1.1K Β· πŸ’€) - Color text streams with a polished command line interface. ❗️GPL-3.0 Show 5 hidden projects...

πŸ”— best-of-python-dev ( ⭐ 1.2K) - A ranked list of awesome python developer tools and libraries. Updated..

cachetools (πŸ₯‡30 Β· ⭐ 2.6K) - Extensible memoizing collections and decorators. MIT cached-property (πŸ₯ˆ27 Β· ⭐ 710 Β· πŸ’€) - A decorator for caching properties in classes. BSD-3 aiocache (πŸ₯ˆ25 Β· ⭐ 1.3K) - Asyncio cache manager for redis, memcached and memory. BSD-3 beaker (πŸ₯ˆ25 Β· ⭐ 540) - WSGI middleware for sessions and caching. BSD-3 pylibmc (πŸ₯ˆ25 Β· ⭐ 480) - A Python wrapper around the libmemcached interface from TangentOrg. BSD-3 cachier (πŸ₯‰21 Β· ⭐ 610) - Persistent, stale-free, local and cross-machine caching for Python.. MIT

πŸ”— best-of-web-python - Web UI ( ⭐ 2.6K) - Collection of libraries to implement web-based UIs.

kivy (πŸ₯‡39 Β· ⭐ 19K) - Open source UI framework written in Python, running on Windows, Linux, macOS,.. MIT DearPyGui (πŸ₯ˆ31 Β· ⭐ 15K) - Dear PyGui: A fast and powerful Graphical User Interface Toolkit for.. MIT toga (πŸ₯ˆ31 Β· ⭐ 5.1K) - A Python native, OS native GUI toolkit. BSD-3 Eel (πŸ₯‰25 Β· ⭐ 6.7K) - A little Python library for making simple Electron-like HTML/JS GUI apps. MIT Show 5 hidden projects...
Computer & Machine Vision

πŸ”— best-of-ml-python - Computer Vision ( ⭐ 22K) - Collection of computer vision and image processing..

Show 1 hidden projects...
Machine Learning & Data Engineering

πŸ”— best-of-ml-python ( ⭐ 22K) - A ranked list of awesome machine learning Python libraries. Updated..

πŸ”— best-of-ml-python - NLP ( ⭐ 22K) - Collection of text processing and NLP libraries.

chardet (πŸ₯‡32 Β· ⭐ 2.3K Β· πŸ’€) - Python character encoding detector. ❗️LGPL-2.1 phonenumbers (πŸ₯‡31 Β· ⭐ 3.6K) - Python port of Googles libphonenumber. Apache-2 emoji (πŸ₯ˆ30 Β· ⭐ 2K) - emoji terminal output for Python. BSD-3 inflect (πŸ₯ˆ28 Β· ⭐ 1K) - Correctly generate plurals, ordinals, indefinite articles; convert numbers.. MIT pyahocorasick (πŸ₯‰27 Β· ⭐ 1K) - Python module (C extension and plain python) implementing Aho-.. BSD-3 coolname (πŸ₯‰21 Β· ⭐ 160 Β· πŸ’€) - Random Name and Slug Generator. BSD-2 price-parser (πŸ₯‰16 Β· ⭐ 340) - Extract price amount and currency symbol from a raw text string. BSD-3 Show 4 hidden projects...

πŸ”— best-of-web-python ( ⭐ 2.6K) - A ranked list of awesome python libraries for web development. Updated..

Libraries for connecting to, operating, and querying databases.

boto3 (πŸ₯‡43 Β· ⭐ 9.5K) - Boto3, an AWS SDK for Python. Apache-2 azure-storage-blob (πŸ₯‡40 Β· ⭐ 5K) - This repository is for active development of the Azure SDK.. MIT redis (πŸ₯‡39 Β· ⭐ 13K) - Redis Python client. MIT google-cloud-storage (πŸ₯‡39 Β· ⭐ 5.1K) - Google Cloud Client Library for Python. Apache-2 peewee (πŸ₯‡38 Β· ⭐ 12K Β· πŸ“‰) - a small, expressive orm -- supports postgresql, mysql, sqlite and.. MIT Ibis (πŸ₯‡38 Β· ⭐ 6K) - the portable Python dataframe library. Apache-2 kafka-python (πŸ₯‡37 Β· ⭐ 5.8K Β· πŸ“‰) - Python client for Apache Kafka. Apache-2 elasticsearch (πŸ₯‡37 Β· ⭐ 4.3K) - Official Python client for Elasticsearch. Apache-2 alembic (πŸ₯‡37 Β· ⭐ 3.5K) - A database migrations tool for SQLAlchemy. MIT pymongo (πŸ₯ˆ36 Β· ⭐ 4.3K) - PyMongo - the Official MongoDB Python driver. Apache-2 python-bigquery (πŸ₯ˆ35 Β· ⭐ 780) - Google BigQuery API client library. Apache-2 sqlmodel (πŸ₯ˆ34 Β· ⭐ 17K) - SQL databases in Python, designed for simplicity, compatibility, and.. MIT pydantic MongoEngine (πŸ₯ˆ34 Β· ⭐ 4.3K) - A Python Object-Document-Mapper for working with MongoDB. MIT AWS Data Wrangler (πŸ₯ˆ34 Β· ⭐ 4K) - pandas on AWS - Easy integration with Athena, Glue,.. Apache-2 PyMySQL (πŸ₯ˆ33 Β· ⭐ 7.8K) - MySQL client library for Python. MIT Prometheus Client (πŸ₯ˆ33 Β· ⭐ 4.2K) - Prometheus instrumentation library for Python.. Apache-2 SQLAlchemy-Utils (πŸ₯ˆ33 Β· ⭐ 1.3K) - Various utility functions and datatypes for SQLAlchemy. BSD-3 tortoise-orm (πŸ₯ˆ32 Β· ⭐ 5.2K) - Familiar asyncio ORM for python, built with relations in mind. Apache-2 s3fs (πŸ₯ˆ32 Β· ⭐ 960) - S3 Filesystem. BSD-3 confluent-kafka-python (πŸ₯ˆ32 Β· ⭐ 320) - Confluents Kafka Python Client. Apache-2 s3transfer (πŸ₯ˆ32 Β· ⭐ 230) - Amazon S3 Transfer Manager for Python. Apache-2 mysqlclient (πŸ₯ˆ31 Β· ⭐ 2.5K) - MySQL/MariaDB connector for Python. ❗️GPL-2.0 Motor (πŸ₯ˆ31 Β· ⭐ 2.5K Β· πŸ“‰) - Motor - the async Python driver for MongoDB and Tornado or asyncio. Apache-2 SQLAlchemy (πŸ₯ˆ30 Β· ⭐ 11K) - The Database Toolkit for Python. MIT Elasticsearch DSL (πŸ₯ˆ30 Β· ⭐ 3.9K) - High level Python client for Elasticsearch. Apache-2 PynamoDB (πŸ₯ˆ30 Β· ⭐ 2.5K) - A pythonic interface to Amazons DynamoDB. MIT Cassandra Driver (πŸ₯ˆ30 Β· ⭐ 1.4K) - DataStax Python Driver for Apache Cassandra. Apache-2 minio (πŸ₯ˆ30 Β· ⭐ 960) - MinIO Client SDK for Python. Apache-2 Pony (πŸ₯‰29 Β· ⭐ 3.8K) - Pony Object Relational Mapper. Apache-2 PyPika (πŸ₯‰29 Β· ⭐ 2.7K Β· πŸ’€) - PyPika is a python SQL query builder that exposes the full.. Apache-2 neo4j-driver (πŸ₯‰29 Β· ⭐ 980) - Neo4j Bolt driver for Python. Apache-2 dataset (πŸ₯‰27 Β· ⭐ 4.8K) - Easy-to-use data handling for SQL data stores with support for implicit.. MIT cx-Oracle (πŸ₯‰27 Β· ⭐ 900) - Obsolete Python interface to Oracle Database, now superseded by.. BSD-3 pysolr (πŸ₯‰27 Β· ⭐ 680) - Pysolr Python Solr client. BSD-3 pandas-gbq (πŸ₯‰27 Β· ⭐ 480) - Google BigQuery connector for pandas. BSD-3 influxdb (πŸ₯‰26 Β· ⭐ 1.7K Β· πŸ’€) - Python client for InfluxDB. MIT pygsheets (πŸ₯‰26 Β· ⭐ 1.5K) - Google Sheets Python API v4. MIT piccolos (πŸ₯‰25 Β· ⭐ 1.7K) - A fast, user friendly ORM and query builder which supports asyncio. MIT libcloud (πŸ₯‰24 Β· ⭐ 2.1K) - Apache Libcloud is a Python library which hides differences between.. Apache-2 cloudant (πŸ₯‰22 Β· ⭐ 160 Β· πŸ’€) - A Python library for Cloudant and CouchDB. Apache-2 ODMantic (πŸ₯‰20 Β· ⭐ 1.1K Β· πŸ’€) - Sync and Async ODM (Object Document Mapper) for MongoDB based on.. ISC psycopg3 (πŸ₯‰19 Β· ⭐ 2K) - New generation PostgreSQL database adapter for the Python.. ❗️LGPL-3.0 prisma (πŸ₯‰19 Β· ⭐ 2K) - Prisma Client Python is an auto-generated and fully type-safe database.. Apache-2 PugSQL (πŸ₯‰18 Β· ⭐ 740) - A HugSQL-inspired database library for Python. Apache-2 Show 20 hidden projects...
Data Loading & Extraction

Libraries for loading, collecting, and extracting data from a variety of data sources and formats.

Datasets (πŸ₯‡41 Β· ⭐ 21K) - The largest hub of ready-to-use datasets for AI models with fast,.. Apache-2 Faker (πŸ₯‡39 Β· ⭐ 19K Β· πŸ“‰) - Faker is a Python package that generates fake data for you. MIT xlwings (πŸ₯‡34 Β· ⭐ 3.2K) - xlwings is a Python library that makes it easy to call Python from.. BSD-3 xmltodict (πŸ₯ˆ32 Β· ⭐ 5.7K Β· πŸ’€) - Python module that makes working with XML feel like you are.. MIT Tablib (πŸ₯ˆ32 Β· ⭐ 4.7K) - Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c. MIT python-magic (πŸ₯ˆ31 Β· ⭐ 2.8K) - A python wrapper for libmagic. MIT xlrd (πŸ₯ˆ31 Β· ⭐ 2.2K) - Please use openpyxl where you can... BSD-3 smart-open (πŸ₯ˆ30 Β· ⭐ 3.3K) - Utils for streaming large files (S3, HDFS, gzip, bz2...). MIT pandas-datareader (πŸ₯ˆ30 Β· ⭐ 3.1K) - Extract data from a wide range of Internet sources into a.. BSD-3 csvkit (πŸ₯ˆ29 Β· ⭐ 6.2K) - A suite of utilities for converting to and working with CSV, the king of.. MIT gdown (πŸ₯ˆ29 Β· ⭐ 4.8K) - Google Drive Public File Downloader when Curl/Wget Fails. MIT camelot (πŸ₯‰28 Β· ⭐ 3.4K Β· πŸ“ˆ) - A Python library to extract tabular data from PDFs. MIT img2dataset (πŸ₯‰27 Β· ⭐ 4.1K Β· πŸ“ˆ) - Easily turn large sets of image urls to an image dataset. Can.. MIT Intake (πŸ₯‰27 Β· ⭐ 1K) - Intake is a lightweight package for finding, investigating, loading and.. BSD-2 excalibur (πŸ₯‰22 Β· ⭐ 1.7K Β· πŸ’€) - A web interface to extract tabular data from PDFs. MIT pyexcel-xlsx (πŸ₯‰21 Β· ⭐ 120) - A wrapper library to read, manipulate and write data in xlsx and.. BSD-3 Singer (πŸ₯‰20 Β· ⭐ 1.3K) - Standard for moving data between databases, web APIs, files,.. ❗️AGPL-3.0 rows (πŸ₯‰19 Β· ⭐ 880) - A common, beautiful interface to tabular data, no matter the format. ❗️LGPL-3.0 Upgini (πŸ₯‰17 Β· ⭐ 340) - Data search & enrichment library for Machine Learning Easily find and add.. BSD-3 csvs-to-sqlite (πŸ₯‰14 Β· ⭐ 910) - Convert CSV files into a SQLite database. Apache-2 Squirrel (πŸ₯‰10 Β· ⭐ 280 Β· πŸ’€) - A Python library that enables ML teams to share, load, and.. Apache-2 Show 9 hidden projects...
Data Pipelines & Streaming

Libraries for data batch- and stream-processing, workflow automation, job scheduling, and other data pipeline tasks.

Airflow (πŸ₯‡49 Β· ⭐ 42K) - Platform to programmatically author, schedule, and monitor workflows. Apache-2 Celery (πŸ₯‡43 Β· ⭐ 27K Β· πŸ“ˆ) - Asynchronous task queue/job queue based on distributed message passing. BSD-3 Prefect (πŸ₯‡41 Β· ⭐ 20K) - Prefect is a workflow orchestration framework for building resilient.. Apache-2 Dagster (πŸ₯‡41 Β· ⭐ 14K) - An orchestration platform for the development, production, and.. Apache-2 Beam (πŸ₯‡41 Β· ⭐ 8.2K) - Unified programming model to define and execute data processing.. Apache-2 dbt (πŸ₯ˆ37 Β· ⭐ 11K) - dbt enables data analysts and engineers to transform their data using the.. Apache-2 rq (πŸ₯ˆ37 Β· ⭐ 10K) - Simple job queues for Python. BSD-3 joblib (πŸ₯ˆ37 Β· ⭐ 4.1K) - Computing with Python functions. BSD-3 Great Expectations (πŸ₯ˆ36 Β· ⭐ 11K) - Always know what to expect from your data. Apache-2 Kedro (πŸ₯ˆ33 Β· ⭐ 10K) - Kedro is a toolbox for production-ready data science. It uses software.. Apache-2 petl (πŸ₯ˆ32 Β· ⭐ 1.3K) - Python Extract Transform and Load Tables of Data. MIT luigi (πŸ₯ˆ31 Β· ⭐ 18K) - Luigi is a Python module that helps you build complex pipelines of batch.. Apache-2 zenml (πŸ₯ˆ30 Β· ⭐ 4.8K) - ZenML : MLOps for Reliable AI: from Classical AI to Agents... Apache-2 Activeloop (πŸ₯ˆ29 Β· ⭐ 8.8K) - Database for AI. Store Vectors, Images, Texts, Videos, etc. Use.. Apache-2 huey (πŸ₯ˆ29 Β· ⭐ 5.6K) - a little task queue for python. MIT arq (πŸ₯ˆ26 Β· ⭐ 2.6K Β· πŸ’€) - Fast job queuing and RPC in python with asyncio and redis. MIT mleap (πŸ₯ˆ26 Β· ⭐ 1.5K Β· πŸ’€) - MLeap: Deploy ML Pipelines to Production. Apache-2 ploomber (πŸ₯‰24 Β· ⭐ 3.6K) - The fastest way to build data pipelines. Develop iteratively,.. Apache-2 streamparse (πŸ₯‰23 Β· ⭐ 1.5K Β· πŸ’€) - Run Python in Apache Storm topologies. Pythonic API, CLI.. Apache-2 whylogs (πŸ₯‰22 Β· ⭐ 2.7K Β· πŸ’€) - Open standard for end-to-end data and ML monitoring for any.. Apache-2 PyFunctional (πŸ₯‰22 Β· ⭐ 2.5K) - Python library for creating data pipelines with chain functional.. MIT pdpipe (πŸ₯‰22 Β· ⭐ 720) - Easy pipelines for pandas DataFrames. MIT CocoIndex (πŸ₯‰21 Β· ⭐ 2.6K Β· 🐣) - Data transformation framework for AI. Ultra performant, with.. Apache-2 BatchFlow (πŸ₯‰21 Β· ⭐ 200) - BatchFlow helps you conveniently work with random or sequential.. Apache-2 TaskTiger (πŸ₯‰19 Β· ⭐ 1.4K Β· πŸ’€) - Python task queue using Redis. MIT flupy (πŸ₯‰19 Β· ⭐ 200) - Fluent data pipelines for python and your shell. MIT dbnd (πŸ₯‰18 Β· ⭐ 270) - DBND is an agile pipeline framework that helps data engineering teams.. Apache-2 Show 17 hidden projects...

XlsxWriter (πŸ₯‡36 Β· ⭐ 3.8K) - A Python module for creating Excel XLSX files. BSD-2 PyYAML (πŸ₯‰35 Β· ⭐ 2.7K Β· πŸ’€) - Canonical source repository for PyYAML. MIT Show 1 hidden projects...

deepdiff (πŸ₯‡35 Β· ⭐ 2.3K Β· πŸ“ˆ) - DeepDiff: Deep Difference and search of any Python object/data... MIT typing_inspect (πŸ₯‰21 Β· ⭐ 370) - Runtime inspection utilities for Python typing module. MIT Show 2 hidden projects...

attrs (πŸ₯‡39 Β· ⭐ 5.6K) - Python Classes Without Boilerplate. MIT more-itertools (πŸ₯‡37 Β· ⭐ 4K) - More routines for operating on iterables, beyond itertools. MIT toolz (πŸ₯ˆ34 Β· ⭐ 5K) - A functional standard library for Python. BSD-3 python-dependency-injector (πŸ₯ˆ33 Β· ⭐ 4.5K) - Dependency injection framework for Python. BSD-3 boltons (πŸ₯ˆ31 Β· ⭐ 6.7K) - Like builtins, but boltons. 250+ constructs, recipes, and snippets.. BSD-3 tenacity (πŸ₯ˆ30 Β· ⭐ 7.8K) - Retrying library for Python. Apache-2 returns (πŸ₯ˆ30 Β· ⭐ 4K) - Make your functions return something meaningful, typed, and safe!. BSD-2 natsort (πŸ₯‰27 Β· ⭐ 980) - Simple yet flexible natural sorting in Python. MIT ubelt (πŸ₯‰23 Β· ⭐ 730) - A Python utility library with a stdlib like feel and extra batteries... Apache-2 ratelimit (πŸ₯‰20 Β· ⭐ 800) - API Rate Limit Decorator. MIT pampy (πŸ₯‰18 Β· ⭐ 3.5K Β· πŸ’€) - Pampy: The Pattern Matching for Python you always dreamed of. MIT Show 4 hidden projects...

cpython (πŸ₯‡51 Β· ⭐ 68K) - The Python programming language. MIT micropython (πŸ₯ˆ36 Β· ⭐ 21K) - MicroPython - a lean and efficient Python implementation for.. Python-2.0 pyston (πŸ₯ˆ22 Β· ⭐ 2.5K Β· πŸ’€) - (No longer maintained) A faster and highly-compatible.. Apache-2 Show 3 hidden projects...

Pygments (πŸ₯‡41 Β· ⭐ 2K) - Pygments is a generic syntax highlighter written in Python. BSD-2 pyparsing (πŸ₯‡38 Β· ⭐ 2.4K) - Python library for creating PEG parsers. MIT wrapt (πŸ₯‡38 Β· ⭐ 2.2K Β· πŸ“ˆ) - A Python module for decorators, wrappers and monkey patching. BSD-2 pluggy (πŸ₯ˆ35 Β· ⭐ 1.5K) - A minimalist production ready plugin system. MIT diagrams (πŸ₯ˆ33 Β· ⭐ 41K) - Diagram as Code for prototyping cloud system architectures. MIT pycparser (πŸ₯ˆ33 Β· ⭐ 3.4K) - Complete C99 parser in pure Python. BSD-3 decorator (πŸ₯ˆ32 Β· ⭐ 890) - Decorators for Humans. BSD-2 py4j (πŸ₯ˆ31 Β· ⭐ 1.2K) - Py4J enables Python programs to dynamically access arbitrary Java objects. BSD-3 fastcore (πŸ₯ˆ31 Β· ⭐ 1K) - Python supercharged for the fastai library. Apache-2 Copier (πŸ₯‰28 Β· ⭐ 2.7K) - Library and command-line utility for rendering projects templates. MIT pyscaffold (πŸ₯‰26 Β· ⭐ 2.2K Β· πŸ’€) - Python project template generator with batteries included. MIT python-mss (πŸ₯‰24 Β· ⭐ 1.1K) - An ultra fast cross-platform multiple screenshots module in pure.. MIT Send2Trash (πŸ₯‰23 Β· ⭐ 290) - Python library to natively send files to Trash (or Recycle bin) on.. BSD-3 Show 8 hidden projects...

Contributions are encouraged and always welcome! If you like to add or update projects, choose one of the following ways:

If you like to contribute to or share suggestions regarding the project metadata collection or markdown generation, please refer to the best-of-generator repository. If you like to create your own best-of list, we recommend to follow this guide.

For more information on how to add or update projects, please read the contribution guidelines. By participating in this project, you agree to abide by its Code of Conduct.


RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4