Go to file
Igor Katson 88118dce0f Add max_parallel parameter to MySQL backend. (#2760)
* Add max_parallel parameter to MySQL backend.

This limits the number of concurrent connections, so that vault does not die
suddenly from "Too many connections".

This can happen when e.g. vault starts up, and tries to load all the
existing leases in parallel. At the time of writing this, the value
ExpirationRestoreWorkerCount in vault/helper/consts/const.go is set to
64, meaning that if there are enough leases in the vault's DB, it will
generate AT LEAST 64 concurrent connections to MySQL when loading the
data during start-up. On certain configurations, e.g. smaller AWS
RDS/Aurora instances, this will cause Vault to fail startup.

* Fix a typo in mysql storage readme
2017-06-01 15:20:32 -07:00
api add gofmt checks to Vault and format existing code (#2745) 2017-05-19 08:34:17 -04:00
audit Delay salt initialization for audit backends 2017-05-23 20:36:20 -04:00
builtin Improve EC2 describe instances performance (#2766) 2017-05-26 08:38:01 -04:00
cli Merge remote-tracking branch 'oss/master' into database-refactor 2017-05-04 12:40:00 -07:00
command Fix tests 2017-05-25 09:00:49 -04:00
helper Remove non-gRPC request forwarding 2017-05-24 09:34:59 -04:00
http Fix policy tests 2017-06-01 17:22:34 -04:00
logical Don't write salts in initialization, look up on demand (#2702) 2017-05-09 17:51:09 -04:00
meta Fix command docstring typo: wrappping -> wrapping. (#2696) 2017-05-09 09:56:54 -04:00
physical Add max_parallel parameter to MySQL backend. (#2760) 2017-06-01 15:20:32 -07:00
plugins Support custom renewal statements in Postgres (#2788) 2017-06-01 13:18:16 -07:00
scripts Bump Go version in cross Dockerfile 2017-05-30 14:33:56 -04:00
shamir Randomizing x coordinate in shamir split (#2621) 2017-04-28 07:47:05 -04:00
terraform/aws Bump versions 2017-05-08 16:19:41 -04:00
vault Add grpc keepalives as a fallback option for our heartbeating 2017-05-26 13:32:13 -04:00
vendor Finish dep update 2017-05-24 21:16:17 -04:00
version Bump version to 0.7.3-dev 2017-05-23 20:42:13 -04:00
website Add max_parallel parameter to MySQL backend. (#2760) 2017-06-01 15:20:32 -07:00
.gitattributes Update git attributes to fix Linguist 2016-07-01 15:54:16 -04:00
.gitignore Update gitignore 2016-12-14 15:51:27 -05:00
.travis.yml Bump Go version in Travis 2017-04-17 11:04:31 -04:00
CHANGELOG.md changelog ++ 2017-05-31 13:41:34 -05:00
CONTRIBUTING.md Update contribution guide 2016-01-27 15:17:11 -05:00
LICENSE Initial commit 2015-02-24 16:15:59 -08:00
Makefile Add govendor to bootstrap 2017-06-01 10:18:48 -04:00
README.md Update logo in README 2017-03-20 10:32:23 -07:00
main.go Add canonical import path to main package for those using golang-builder 2015-11-05 16:44:20 -05:00
main_test.go Add canonical import path to main package for those using golang-builder 2015-11-05 16:44:20 -05:00
make.bat s/TF_ACC/VAULT_ACC 2016-04-05 15:24:59 -04:00

README.md

Vault Build Status Join the chat at https://gitter.im/hashicorp-vault/Lobby

Please note: We take Vault's security and our users' trust very seriously. If you believe you have found a security issue in Vault, please responsibly disclose by contacting us at security@hashicorp.com.

=========

Vault Logo

Vault is a tool for securely accessing secrets. A secret is anything that you want to tightly control access to, such as API keys, passwords, certificates, and more. Vault provides a unified interface to any secret, while providing tight access control and recording a detailed audit log.

A modern system requires access to a multitude of secrets: database credentials, API keys for external services, credentials for service-oriented architecture communication, etc. Understanding who is accessing what secrets is already very difficult and platform-specific. Adding on key rolling, secure storage, and detailed audit logs is almost impossible without a custom solution. This is where Vault steps in.

The key features of Vault are:

  • Secure Secret Storage: Arbitrary key/value secrets can be stored in Vault. Vault encrypts these secrets prior to writing them to persistent storage, so gaining access to the raw storage isn't enough to access your secrets. Vault can write to disk, Consul, and more.

  • Dynamic Secrets: Vault can generate secrets on-demand for some systems, such as AWS or SQL databases. For example, when an application needs to access an S3 bucket, it asks Vault for credentials, and Vault will generate an AWS keypair with valid permissions on demand. After creating these dynamic secrets, Vault will also automatically revoke them after the lease is up.

  • Data Encryption: Vault can encrypt and decrypt data without storing it. This allows security teams to define encryption parameters and developers to store encrypted data in a location such as SQL without having to design their own encryption methods.

  • Leasing and Renewal: All secrets in Vault have a lease associated with it. At the end of the lease, Vault will automatically revoke that secret. Clients are able to renew leases via built-in renew APIs.

  • Revocation: Vault has built-in support for secret revocation. Vault can revoke not only single secrets, but a tree of secrets, for example all secrets read by a specific user, or all secrets of a particular type. Revocation assists in key rolling as well as locking down systems in the case of an intrusion.

For more information, see the introduction section of the Vault website.

Getting Started & Documentation

All documentation is available on the Vault website.

Developing Vault

If you wish to work on Vault itself or any of its built-in systems, you'll first need Go installed on your machine (version 1.8+ is required).

For local dev first make sure Go is properly installed, including setting up a GOPATH. Next, clone this repository into $GOPATH/src/github.com/hashicorp/vault. You can then download any required build tools by bootstrapping your environment:

$ make bootstrap
...

To compile a development version of Vault, run make or make dev. This will put the Vault binary in the bin and $GOPATH/bin folders:

$ make dev
...
$ bin/vault
...

To run tests, type make test. Note: this requires Docker to be installed. If this exits with exit status 0, then everything is working!

$ make test
...

If you're developing a specific package, you can run tests for just that package by specifying the TEST variable. For example below, only vault package tests will be run.

$ make test TEST=./vault
...

Acceptance Tests

Vault has comprehensive acceptance tests covering most of the features of the secret and auth backends.

If you're working on a feature of a secret or auth backend and want to verify it is functioning (and also hasn't broken anything else), we recommend running the acceptance tests.

Warning: The acceptance tests create/destroy/modify real resources, which may incur real costs in some cases. In the presence of a bug, it is technically possible that broken backends could leave dangling data behind. Therefore, please run the acceptance tests at your own risk. At the very least, we recommend running them in their own private account for whatever backend you're testing.

To run the acceptance tests, invoke make testacc:

$ make testacc TEST=./builtin/logical/consul
...

The TEST variable is required, and you should specify the folder where the backend is. The TESTARGS variable is recommended to filter down to a specific resource to test, since testing all of them at once can sometimes take a very long time.

Acceptance tests typically require other environment variables to be set for things such as access keys. The test itself should error early and tell you what to set, so it is not documented here.