proxy.golang.org : github.com/grailbio/bigmachine

Package bigmachine implements a vertically integrated stack for distributed computing in Go. Go programs written with bigmachine are transparently distributed across a number of machines as instantiated by the backend used. (Currently supported: EC2, local machines, unit tests.) Bigmachine clusters comprise a driver node and a number of bigmachine nodes (called "machines"). The driver node can create new machines and communicate with them; machines can call each other. On startup, a bigmachine program calls driver.Start. Driver.Start configures a bigmachine instance based on a set of standard flags and then starts it. (Users desiring a lower-level API can use bigmachine.Start directly.) When the program is run, driver.Start returns immediately: the program can then interact with the returned bigmachine B to create new machines, define services on those machines, and invoke methods on those services. Bigmachine bootstraps machines by running the same binary, but in these runs, driver.Start never returns; instead it launches a server to handle calls from the driver program and other machines. A machine is started by (*B).Start. Machines must be configured with at least one service: Users may then invoke methods on the services provided by the returned machine. A services's methods can be invoked so long as they are of the form: See package github.com/grailbio/bigmachine/rpc for more details. Methods are named by the sevice and method name, separated by a dot ('.'), e.g.: "MyService.MyMethod": Since service instances must be serialized so that they can be transmitted to the remote machine, and because we do not know the service types a priori, any type that can appear as a service must be registered with gob. This is usually done in an init function in the package that declares type: A bigmachine program attempts to appear and act like a single program: The driver program maintains keepalives to all of its machines. Once this is no longer maintained (e.g., because the driver finished, or crashed, or lost connectivity), the machines become idle and shut down. A service is any Go value that implements methods of the form given above. Services are instantiated by the user and registered with bigmachine. When a service is registered, bigmachine will also invoke an initialization method on the service if it exists. Per-machine initialization can be performed by this method.The form of the method is: If a non-nil error is returned, the machine is considered failed.

Registry - Source - Documentation - JSON
purl: pkg:golang/github.com/grailbio/bigmachine
Keywords: cloud , distributed-systems , golang , parallel-computing , serverless-framework
License: Apache-2.0
Latest release: almost 5 years ago
First release: over 5 years ago
Namespace: github.com/grailbio
Dependent packages: 2
Dependent repositories: 1
Stars: 180 on GitHub
Forks: 21 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 27 days ago

• Readme
• Versions 9
• Dependent Packages 2
• Maintainers 0