Awesome Open Source

Programming Languages

Search results for information theory

information-theory x

113 search results found

Interviews.ai ⭐ 3,146

It is my belief that you, the postgraduate students and job-seekers for whom the book is primarily meant will benefit from reading it; however, it is my hope that even the most experienced researchers will find it fascinating as well.

Math Php ⭐ 2,280

Powerful modern math library for PHP: Features descriptive statistics and regressions; Continuous and discrete probability distributions; Linear algebra with matrices and vectors, Numerical analysis; special mathematical functions; Algebra

Python package for information theory.

Collection of papers

Corex_topic ⭐ 441

Hierarchical unsupervised and semi-supervised topic models for sparse count data with CorEx

Infomap ⭐ 401

Multi-level network clustering based on the Map Equation

A toolbox for integrated information theory.

Awesome Maths Learning ⭐ 269

😎 📜 Collection of the most awesome Maths learning resources in the form of notes, videos and cheatsheets.

Non-parametric Entropy Estimation Toolbox

Shifterator ⭐ 247

Interpretable data visualizations for understanding how texts differ at the word level

CorEx or "Correlation Explanation" discovers a hierarchy of informative latent factors. This reference implementation has been superseded by other versions below.

Flutter_info ⭐ 234

📚Сборник русскоязычной информации по Flutter

JIDT: Java Information Dynamics Toolkit for studying information-theoretic measures of computation in complex systems

The Information Dynamics Toolkit xl (IDTxl) is a comprehensive software package for efficient inference of networks and their node dynamics from multivariate time series data using information theory.

Philentropy ⭐ 119

Information Theory and Distance Quantification with R

Bio_corex ⭐ 116

A flexible version of CorEx developed for bio-data challenges that handles missing data, continuous/discrete variables, multi-CPU, overlapping structure, and includes visualizations

Pycopent ⭐ 101

Estimating Copula Entropy (Mutual Information), Transfer Entropy (Conditional Independence), and the statistics for multivariate normality test and two-sample test in Python

Quantuminformation.jl ⭐ 84

A Julia package for numerical computation in quantum information theory

Infobert ⭐ 81

[ICLR 2021] "InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective" by Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, Jingjing Liu

Node Google Search Scraper ⭐ 76

Google search scraper with captcha solving support

An open-source library for Python 3 providing tools for analysis and simulation of analog and digital communication systems.

Framework for Information Theoretical analysis of Electrophysiological data and Statistics

Agtboost ⭐ 62

Adaptive and automatic gradient boosting computations.

Infotheo ⭐ 60

A Coq formalization of information theory and linear error-correcting codes

Combine and clean word lists

Hsic Bottleneck ⭐ 56

The HSIC Bottleneck: Deep Learning without Back-Propagation

Latex notes on papers, courses, ideas: Pure math and computer science.

Official Implementation of Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction (2020)

Probabilistic question-asking system: the program asks, the users answer. The minimal goal of the program is to identify what the user needs (a target), even if the user is not aware of the existence of such a thing/product/service.

Uncertainty and causal emergence in complex networks

Linearcorex ⭐ 43

Fast, linear version of CorEx for covariance estimation, dimensionality reduction, and subspace clustering with very under-sampled, high-dimensional data

Tensorflow 2 source code for the PI-SAC agent from "Predictive Information Accelerates Learning in RL" (NeurIPS 2020)

Quantum Computing ⭐ 35

Projects in Quantum Computing and Quantum information Theory (Qiskit, Algorithms, Circuits, Graph Theory and Quantum Mechanics)

R package for estimating copula entropy (mutual information), transfer entropy (conditional independence), and the statistic for multivariate normality test and two-sample test

Information Dropout ⭐ 34

Implementation of Information Dropout

Course 5SSD0 - Bayesian Machine Learning and Information Processing

Limit Label Memorization ⭐ 31

Improving generalization by controlling label-noise information in neural network weights.

Generate any a-by-( b + c ) finite rectangle SVG containing potentially Infinitely many a-by-( 2 * b ) finite rectangles animated along a number line of ( ( c - b ) / a )^n scale symmetry.

Easy Nearest Neighbor Estimation of Mutual Information

Periodic time series analysis tools based on information theory

Miic_r_package ⭐ 24

Learning causal or non-causal graphical models using information theory

A cross platform C library for information analysis of dynamical systems

Jvhw_entropy_estimators ⭐ 20

MATLAB and Python 2.7/3 Implementations of the JVHW entropy and mutual information estimators in Jiao, Jiantao, Kartik Venkat, Yanjun Han, and Tsachy Weissman. "Minimax estimation of functionals of discrete distributions." IEEE Transactions on Information Theory 61, no. 5 (2015): 2835-2885.

Information Bottleneck ⭐ 20

demonstration of the information bottleneck theory for deep learning

Elefridge.jl ⭐ 20

Compressing atmospheric data into its real information

Lempel Ziv_complexity ⭐ 20

📦 Lempel-Ziv Complexity, fast implementations with 🐍 Python (naive, Numba or Cython for speedup), Open-Source (MIT) 👍 →

Astrobwt ⭐ 20

ASIC/FPGA/GPU resistant CPU mining algorithm.

Generated Wordlists ⭐ 20

A repository for word lists I've generated

Unsupervisedattentionmechanism ⭐ 19

Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".

Orchard Street Wordlists ⭐ 19

Wordlists for generating passphrases

Sparkfeatureselection ⭐ 19

Generic implementation of Information Theory-based Feature Selection methods. It also contains an Entropy Minimization Discretization implementation, as well as two artificial dataset generators.

Shannon.jl ⭐ 19

Entropy, Mutual Information, KL-Divergence related to Shannon's information theory and functions to binarize data

Deep Bottleneck ⭐ 17

Repository of the Study Project "Understanding learning in deep neural networks with the help of information theory"

Information Theory Toolkit

Infotopopy ⭐ 17

computes most of information functions (joint entropy, conditional, mutual information, total correlation information distance) and deep information networks

Biguq.jl ⭐ 17

Bayesian Information Gap Decision Theory

Microbiome Mvib ⭐ 16

Microbiome-based disease prediction with multimodal variational information bottlenecks, Grazioli et al., PLOS Computational Biology 2022

A simple lightweight set of implementations and bindings for compression algorithms written in Go.

Implementation of linear CorEx and temporal CorEx.

Mdl Complexity ⭐ 15

MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".

Informme ⭐ 15

An information-theoretic pipeline for methylation analysis of WGBS data

Information Theory Deep Learning ⭐ 15

Resources and Implementations (PyTorch) for Information Theoretical concepts in Deep Learning

Honest But Curious Nets ⭐ 14

Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs (ACM CCS'21)

Signal Processing Toolkit, including ML models with visualization

Neural Distributed Image Compression using Common Information (NDIC)

Kxy Python ⭐ 14

A toolkit to boost the productivity of machine learning engineers.

Rotation-Based Iterative Gaussianization algorithm.

Infomarl ⭐ 13

using information theory to encourage agents to cooperate and compete

Python Symbolic Information Theoretic Inequality Prover

Phfqitltx ⭐ 12

Collection of LaTeX utility packages for scientific documents

Bayes_infotheory ⭐ 12

Lectures on Bayesian statistics and information theory

Rasterdiv ⭐ 12

Diversity Indices for Numerical Matrices

Rl_info_theory ⭐ 11

A collection of code investigating the use of information theory for abstractions in RL

Infotheory ⭐ 11

C++/Python Information theoretic analyses tools

Generalized Mutual Information ⭐ 11

Alignment-free simulation, computation, and visualization of Low-compexity regions in biological data

Uach Info185 ⭐ 10

INFO239 (ex INFO185): Comunicaciones. Un curso de Ingeniería Civil Informática, Universidad Austral de Chile

Pattern-Based, Zoneless Method for Analysis and Visualization of Racial Topography

Programs for Information Topology Data Analysis

A framework for viewpoint selection of 3D models

Python implementation of block decomposition method for approximating algorithmic complexity

Ntrexample_frevnca ⭐ 8

Example code producing novelty, transience, and resonance for a sample of legislative speech during the French Revolution.

an r package for analyses with the maximum entropy theory of ecology

Polar Code ⭐ 8

matlab simulation for polar code

Cryptography And Information Theory ⭐ 7

Coursera Course on Cryptography and Information Theory part of larger Applied Cryptography 🔐 Specialization by Univrsity of Colorado 🎓 on Coursera.

Hybrid_rcc ⭐ 7

A C++ library for information theory and probability

Generalized Lloyd Quantization ⭐ 7

An implementation of the Generalized Lloyd method for vector quantization

Quantum computer simulator library

Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"

String.levenshtein ⭐ 7

A String.method MooTools which calculates Levenshtein distance between two strings.

Informationretrieval ⭐ 7

⇨ Designed and implemented a search engine architecture from scratch for CACM and a sample Wikipedia corpus. ⇨ Crawled the corpus, parsed and indexed the raw documents using simple word count program using Map Reduce, performed ranking using the standard Page Rank algorithm and retrieved the relevant pages using variations of four distinct IR approaches, BM25, TF-IDF, cosine similarity and Lucene based IR model. ⇨ Conducted a comparative study to evaluate the performance of the different searc

Entropyhub.jl ⭐ 6

An open-source toolkit for entropic time series analysis

Grokkingcs ⭐ 6

A computer science guide for people in hurry.

Entropytyping ⭐ 6

A repository for collaborating on our new manuscript investigating how keystroke dynamics conform to information theoretic measures of entropy in the letters people type.

Infectious_disease_predictability ⭐ 6

Code and data for On the Predictability of Infectious Disease Outbreaks by SV Scarpino & G Petri

Low Rank Phase Retrieval ⭐ 6

MATLAB implementation of "Phaseless Low Rank Matrix Recovery and Subspace Tracking", ICML 2019, longer version to appear in IEEE Transactions on Information Theory, 2020..

Predict Pattern ⭐ 6

A new brain puzzle game based on information theory.

Entropiccone.jl ⭐ 6

Entropic Cone approximation and optimization

Statistical Rethinking ⭐ 6

Code and Exercises for the book by Richard McElreath

Information ⭐ 6

Information Theoretic Tools in R

1-100 of 113 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.