Skip to content

POC Mesos Framework with automatic dynamic cluster capacity management

Notifications You must be signed in to change notification settings

maximskripnik/miknik

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Miknik


⚠️ Work in progress 🚧 Build Status Coverage Status

Miknik is a temporary name which will be changed soon

Miknik is a Mesos Framework that manages cluster capacity management automatically based on the workload. It is useful for use cases where it is hard or not practically possible to predict the workload in form of batch jobs to be scheduled for run in the Mesos cluster. Miknik will scale up your Mesos cluster by renting the resources from the cloud provider (Digital Ocean is currently supported, more planned) if number of pending jobs will exceed the configured value. It will also give the rented resources back to the cloud provider (i.e. scale cluster down) if newly rented resources keep being unused for a while.

If you happen to know Russian, check out this 'white paper' (bachelor thesis) for more details: http://vital.lib.tsu.ru/vital/access/manager/Repository/vital:11294

Currently Miknik is not production ready and should be considered a POC project. However, today it already lets you run jobs in form of docker containers with custom resource requirements that consist of CPU, memory and disk capacity.

For usage, see HTTP API specification: http://maximskripnik.com:5161/

About

POC Mesos Framework with automatic dynamic cluster capacity management

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages